Jun 13 01:08:23.705766 ip-10-0-136-115 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 13 01:08:23.705779 ip-10-0-136-115 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 13 01:08:23.705788 ip-10-0-136-115 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 13 01:08:23.706107 ip-10-0-136-115 systemd[1]: Failed to start Kubernetes Kubelet. Jun 13 01:08:33.787850 ip-10-0-136-115 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 13 01:08:33.787875 ip-10-0-136-115 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 86d6afe67ad9418d9e1309217a2fdba0 -- Jun 13 01:11:05.253432 ip-10-0-136-115 systemd[1]: Starting Kubernetes Kubelet... Jun 13 01:11:05.689706 ip-10-0-136-115 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 01:11:05.689706 ip-10-0-136-115 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 13 01:11:05.689706 ip-10-0-136-115 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 01:11:05.689706 ip-10-0-136-115 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 13 01:11:05.689706 ip-10-0-136-115 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 01:11:05.690933 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.689785 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 13 01:11:05.694821 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694796 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 01:11:05.694821 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694817 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 01:11:05.694821 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694822 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 01:11:05.694821 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694827 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 01:11:05.694821 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694831 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 01:11:05.695032 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694835 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 01:11:05.695032 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694838 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 01:11:05.695032 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694841 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 01:11:05.695032 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694843 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 01:11:05.695032 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694846 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 01:11:05.695032 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694849 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 01:11:05.695032 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694851 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 01:11:05.695032 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694854 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 01:11:05.695032 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694856 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 01:11:05.695032 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694860 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 01:11:05.695032 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694862 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 01:11:05.695032 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694865 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 01:11:05.695032 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694867 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 01:11:05.695032 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694870 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 01:11:05.695032 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694872 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 01:11:05.695032 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694875 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 01:11:05.695032 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694877 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 01:11:05.695032 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694880 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 01:11:05.695032 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694883 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 01:11:05.695032 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694885 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 01:11:05.695540 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694888 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 01:11:05.695540 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694890 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 01:11:05.695540 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694893 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 01:11:05.695540 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694895 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 01:11:05.695540 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694898 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 01:11:05.695540 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694901 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 01:11:05.695540 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694903 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 01:11:05.695540 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694906 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 01:11:05.695540 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694909 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 01:11:05.695540 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694911 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 01:11:05.695540 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694913 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 01:11:05.695540 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694916 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 01:11:05.695540 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694918 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 01:11:05.695540 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694922 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 01:11:05.695540 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694925 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 01:11:05.695540 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694927 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 01:11:05.695540 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694930 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 01:11:05.695540 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694932 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 01:11:05.695540 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694935 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 01:11:05.696006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694937 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 01:11:05.696006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694940 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 01:11:05.696006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694943 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 01:11:05.696006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694945 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 01:11:05.696006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694948 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 01:11:05.696006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694951 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 01:11:05.696006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694954 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 01:11:05.696006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694956 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 01:11:05.696006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694959 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 01:11:05.696006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694961 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 01:11:05.696006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694964 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 01:11:05.696006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694966 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 01:11:05.696006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694969 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 01:11:05.696006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694972 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 01:11:05.696006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694974 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 01:11:05.696006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694977 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 01:11:05.696006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694979 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 01:11:05.696006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694982 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 01:11:05.696006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694984 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 01:11:05.696006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694987 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 01:11:05.696529 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694990 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 01:11:05.696529 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694993 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 01:11:05.696529 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694995 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 01:11:05.696529 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.694998 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 01:11:05.696529 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695000 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 01:11:05.696529 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695003 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 01:11:05.696529 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695007 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 01:11:05.696529 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695010 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 01:11:05.696529 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695012 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 01:11:05.696529 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695015 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 13 01:11:05.696529 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695022 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 01:11:05.696529 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695024 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 01:11:05.696529 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695027 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 01:11:05.696529 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695031 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 01:11:05.696529 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695033 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 01:11:05.696529 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695036 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 01:11:05.696529 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695040 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 01:11:05.696529 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695044 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 01:11:05.696529 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695047 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 01:11:05.696529 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695051 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 01:11:05.697108 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695053 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 01:11:05.697108 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695056 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 01:11:05.697108 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695059 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 01:11:05.697108 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695061 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 01:11:05.697108 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695064 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 01:11:05.697108 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695066 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 01:11:05.697108 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695069 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 01:11:05.697108 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695071 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 01:11:05.697108 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695073 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 01:11:05.697108 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695076 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 01:11:05.697108 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695079 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 01:11:05.697108 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695081 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 01:11:05.697108 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695084 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 01:11:05.697108 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695087 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 01:11:05.697108 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695089 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 01:11:05.697108 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695809 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 01:11:05.697108 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695816 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 01:11:05.697108 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695820 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 01:11:05.697108 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695823 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 01:11:05.697108 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695826 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 01:11:05.697617 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695829 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 01:11:05.697617 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695832 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 01:11:05.697617 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695835 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 01:11:05.697617 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695838 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 01:11:05.697617 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695841 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 01:11:05.697617 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695843 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 01:11:05.697617 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695846 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 01:11:05.697617 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695848 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 01:11:05.697617 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695851 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 01:11:05.697617 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695854 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 01:11:05.697617 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695856 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 01:11:05.697617 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695859 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 01:11:05.697617 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695862 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 01:11:05.697617 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695865 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 01:11:05.697617 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695868 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 01:11:05.697617 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695870 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 01:11:05.697617 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695873 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 01:11:05.697617 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695875 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 01:11:05.697617 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695878 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 01:11:05.697617 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695880 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 01:11:05.698121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695883 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 01:11:05.698121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695886 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 01:11:05.698121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695888 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 01:11:05.698121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695891 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 01:11:05.698121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695894 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 01:11:05.698121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695897 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 01:11:05.698121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695899 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 01:11:05.698121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695902 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 01:11:05.698121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695904 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 01:11:05.698121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695907 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 01:11:05.698121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695912 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 01:11:05.698121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695916 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 01:11:05.698121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695919 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 01:11:05.698121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695922 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 01:11:05.698121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695925 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 01:11:05.698121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695928 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 01:11:05.698121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695931 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 01:11:05.698121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695934 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 01:11:05.698121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695936 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 01:11:05.698604 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695939 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 01:11:05.698604 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695942 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 01:11:05.698604 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695945 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 01:11:05.698604 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695948 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 01:11:05.698604 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695950 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 01:11:05.698604 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695953 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 01:11:05.698604 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695956 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 01:11:05.698604 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695959 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 01:11:05.698604 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695962 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 01:11:05.698604 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695964 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 01:11:05.698604 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695967 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 01:11:05.698604 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695969 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 01:11:05.698604 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695972 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 01:11:05.698604 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695977 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 01:11:05.698604 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695981 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 01:11:05.698604 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695985 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 01:11:05.698604 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695988 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 01:11:05.698604 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695991 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 01:11:05.698604 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695994 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 01:11:05.699149 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.695997 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 01:11:05.699149 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696000 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 01:11:05.699149 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696003 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 01:11:05.699149 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696006 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 01:11:05.699149 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696009 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 01:11:05.699149 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696013 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 01:11:05.699149 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696015 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 01:11:05.699149 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696018 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 01:11:05.699149 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696021 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 01:11:05.699149 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696024 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 01:11:05.699149 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696026 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 01:11:05.699149 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696029 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 01:11:05.699149 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696032 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 01:11:05.699149 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696036 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 13 01:11:05.699149 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696039 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 01:11:05.699149 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696042 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 01:11:05.699149 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696044 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 01:11:05.699149 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696047 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 01:11:05.699149 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696049 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 01:11:05.699149 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696052 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 01:11:05.699652 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696055 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 01:11:05.699652 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696057 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 01:11:05.699652 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696060 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 01:11:05.699652 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696063 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 01:11:05.699652 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696065 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 01:11:05.699652 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696068 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 01:11:05.699652 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696071 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 01:11:05.699652 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696078 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 01:11:05.699652 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696080 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 01:11:05.699652 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696083 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 01:11:05.699652 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696085 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 01:11:05.699652 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696088 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 01:11:05.699652 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696091 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 01:11:05.699652 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696093 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 01:11:05.699652 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696096 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 01:11:05.699652 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696098 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 01:11:05.699652 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696505 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 01:11:05.699652 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696510 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 01:11:05.699652 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696513 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 01:11:05.700121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696516 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 01:11:05.700121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696519 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 01:11:05.700121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696521 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 01:11:05.700121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696524 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 01:11:05.700121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696526 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 01:11:05.700121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696529 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 01:11:05.700121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696532 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 01:11:05.700121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696535 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 01:11:05.700121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696538 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 01:11:05.700121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696541 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 01:11:05.700121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696544 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 01:11:05.700121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696546 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 01:11:05.700121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696549 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 01:11:05.700121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696552 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 01:11:05.700121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696555 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 01:11:05.700121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696558 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 01:11:05.700121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696560 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 01:11:05.700121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696563 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 01:11:05.700121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696566 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 01:11:05.700121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696568 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 01:11:05.700672 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696571 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 01:11:05.700672 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696574 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 01:11:05.700672 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696577 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 01:11:05.700672 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696581 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 01:11:05.700672 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696584 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 01:11:05.700672 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696587 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 01:11:05.700672 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696590 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 01:11:05.700672 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696592 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 01:11:05.700672 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696595 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 01:11:05.700672 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696598 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 01:11:05.700672 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696601 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 01:11:05.700672 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696603 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 01:11:05.700672 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696606 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 01:11:05.700672 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696608 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 01:11:05.700672 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696611 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 01:11:05.700672 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696613 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 01:11:05.700672 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696615 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 01:11:05.700672 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696618 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 01:11:05.700672 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696620 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 01:11:05.701162 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696623 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 01:11:05.701162 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696625 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 01:11:05.701162 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696628 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 01:11:05.701162 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696631 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 01:11:05.701162 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696634 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 01:11:05.701162 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696637 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 01:11:05.701162 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696640 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 01:11:05.701162 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696643 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 01:11:05.701162 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696646 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 01:11:05.701162 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696650 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 01:11:05.701162 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696652 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 01:11:05.701162 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696655 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 01:11:05.701162 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696657 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 01:11:05.701162 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696660 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 01:11:05.701162 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696663 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 01:11:05.701162 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696665 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 13 01:11:05.701162 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696668 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 01:11:05.701162 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696670 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 01:11:05.701162 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696673 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 01:11:05.701630 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696675 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 01:11:05.701630 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696678 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 01:11:05.701630 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696680 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 01:11:05.701630 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696683 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 01:11:05.701630 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696686 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 01:11:05.701630 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696688 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 01:11:05.701630 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696691 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 01:11:05.701630 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696693 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 01:11:05.701630 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696696 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 01:11:05.701630 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696699 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 01:11:05.701630 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696701 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 01:11:05.701630 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696704 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 01:11:05.701630 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696706 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 01:11:05.701630 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696709 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 01:11:05.701630 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696712 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 01:11:05.701630 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696718 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 01:11:05.701630 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696721 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 01:11:05.701630 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696723 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 01:11:05.701630 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696726 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 01:11:05.701630 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696729 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 01:11:05.702169 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696732 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 01:11:05.702169 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696735 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 01:11:05.702169 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696738 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 01:11:05.702169 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696740 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 01:11:05.702169 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696743 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 01:11:05.702169 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696745 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 01:11:05.702169 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696748 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 01:11:05.702169 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696751 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 01:11:05.702169 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696753 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 01:11:05.702169 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696756 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 01:11:05.702169 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696759 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 01:11:05.702169 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696761 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 01:11:05.702169 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696764 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 01:11:05.702169 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696767 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 01:11:05.702169 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696770 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 01:11:05.702169 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696773 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 01:11:05.702169 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696775 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 01:11:05.702169 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.696777 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 01:11:05.702169 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696846 2563 flags.go:64] FLAG: --address="0.0.0.0" Jun 13 01:11:05.702169 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696853 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 13 01:11:05.702666 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696859 2563 flags.go:64] FLAG: --anonymous-auth="true" Jun 13 01:11:05.702666 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696864 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 13 01:11:05.702666 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696868 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 13 01:11:05.702666 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696871 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 13 01:11:05.702666 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696876 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 13 01:11:05.702666 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696880 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 13 01:11:05.702666 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696884 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 13 01:11:05.702666 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696887 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 13 01:11:05.702666 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696890 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 13 01:11:05.702666 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696894 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 13 01:11:05.702666 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696896 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 13 01:11:05.702666 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696900 2563 flags.go:64] FLAG: --cgroup-root="" Jun 13 01:11:05.702666 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696903 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 13 01:11:05.702666 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696906 2563 flags.go:64] FLAG: --client-ca-file="" Jun 13 01:11:05.702666 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696910 2563 flags.go:64] FLAG: --cloud-provider="external" Jun 13 01:11:05.702666 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696913 2563 flags.go:64] FLAG: --cluster-dns="[]" Jun 13 01:11:05.702666 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696917 2563 flags.go:64] FLAG: --cluster-domain="" Jun 13 01:11:05.702666 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696920 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 13 01:11:05.702666 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696923 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 13 01:11:05.702666 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696926 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 13 01:11:05.702666 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696930 2563 flags.go:64] FLAG: --container-log-max-files="5" Jun 13 01:11:05.702666 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696933 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 13 01:11:05.702666 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696936 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 13 01:11:05.703270 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696940 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 13 01:11:05.703270 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696943 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 13 01:11:05.703270 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696946 2563 flags.go:64] FLAG: --contention-profiling="false" Jun 13 01:11:05.703270 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696949 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 13 01:11:05.703270 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696952 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 13 01:11:05.703270 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696955 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 13 01:11:05.703270 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696958 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 13 01:11:05.703270 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696962 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 13 01:11:05.703270 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696965 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 13 01:11:05.703270 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696968 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 13 01:11:05.703270 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696971 2563 flags.go:64] FLAG: --enable-load-reader="false" Jun 13 01:11:05.703270 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696974 2563 flags.go:64] FLAG: --enable-server="true" Jun 13 01:11:05.703270 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696977 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 13 01:11:05.703270 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696982 2563 flags.go:64] FLAG: --event-burst="100" Jun 13 01:11:05.703270 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696985 2563 flags.go:64] FLAG: --event-qps="50" Jun 13 01:11:05.703270 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696988 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 13 01:11:05.703270 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696991 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 13 01:11:05.703270 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696994 2563 flags.go:64] FLAG: --eviction-hard="" Jun 13 01:11:05.703270 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.696998 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 13 01:11:05.703270 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697000 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 13 01:11:05.703270 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697003 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 13 01:11:05.703270 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697006 2563 flags.go:64] FLAG: --eviction-soft="" Jun 13 01:11:05.703270 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697009 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 13 01:11:05.703270 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697012 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 13 01:11:05.703270 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697016 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 13 01:11:05.704146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697019 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jun 13 01:11:05.704146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697021 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 13 01:11:05.704146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697026 2563 flags.go:64] FLAG: --fail-swap-on="true" Jun 13 01:11:05.704146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697029 2563 flags.go:64] FLAG: --feature-gates="" Jun 13 01:11:05.704146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697033 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jun 13 01:11:05.704146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697036 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 13 01:11:05.704146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697039 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 13 01:11:05.704146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697042 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 13 01:11:05.704146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697045 2563 flags.go:64] FLAG: --healthz-port="10248" Jun 13 01:11:05.704146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697048 2563 flags.go:64] FLAG: --help="false" Jun 13 01:11:05.704146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697051 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-136-115.ec2.internal" Jun 13 01:11:05.704146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697059 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 13 01:11:05.704146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697062 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jun 13 01:11:05.704146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697065 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 13 01:11:05.704146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697068 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 13 01:11:05.704146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697072 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 13 01:11:05.704146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697075 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 13 01:11:05.704146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697078 2563 flags.go:64] FLAG: --image-service-endpoint="" Jun 13 01:11:05.704146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697081 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 13 01:11:05.704146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697084 2563 flags.go:64] FLAG: --kube-api-burst="100" Jun 13 01:11:05.704146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697087 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 13 01:11:05.704146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697090 2563 flags.go:64] FLAG: --kube-api-qps="50" Jun 13 01:11:05.704146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697093 2563 flags.go:64] FLAG: --kube-reserved="" Jun 13 01:11:05.704146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697096 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 13 01:11:05.705226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697098 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 13 01:11:05.705226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697101 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jun 13 01:11:05.705226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697104 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 13 01:11:05.705226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697107 2563 flags.go:64] FLAG: --lock-file="" Jun 13 01:11:05.705226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697110 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 13 01:11:05.705226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697113 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 13 01:11:05.705226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697116 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 13 01:11:05.705226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697141 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jun 13 01:11:05.705226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697145 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 13 01:11:05.705226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697148 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jun 13 01:11:05.705226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697153 2563 flags.go:64] FLAG: --logging-format="text" Jun 13 01:11:05.705226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697156 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 13 01:11:05.705226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697159 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 13 01:11:05.705226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697162 2563 flags.go:64] FLAG: --manifest-url="" Jun 13 01:11:05.705226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697165 2563 flags.go:64] FLAG: --manifest-url-header="" Jun 13 01:11:05.705226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697170 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 13 01:11:05.705226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697173 2563 flags.go:64] FLAG: --max-open-files="1000000" Jun 13 01:11:05.705226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697177 2563 flags.go:64] FLAG: --max-pods="110" Jun 13 01:11:05.705226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697180 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 13 01:11:05.705226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697186 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 13 01:11:05.705226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697189 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jun 13 01:11:05.705226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697192 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 13 01:11:05.705226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697195 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 13 01:11:05.705226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697199 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 13 01:11:05.705226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697202 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 13 01:11:05.706324 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697209 2563 flags.go:64] FLAG: --node-status-max-images="50" Jun 13 01:11:05.706324 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697212 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 13 01:11:05.706324 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697215 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jun 13 01:11:05.706324 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697218 2563 flags.go:64] FLAG: --pod-cidr="" Jun 13 01:11:05.706324 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697220 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 13 01:11:05.706324 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697226 2563 flags.go:64] FLAG: --pod-manifest-path="" Jun 13 01:11:05.706324 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697229 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jun 13 01:11:05.706324 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697232 2563 flags.go:64] FLAG: --pods-per-core="0" Jun 13 01:11:05.706324 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697235 2563 flags.go:64] FLAG: --port="10250" Jun 13 01:11:05.706324 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697238 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 13 01:11:05.706324 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697241 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-061acc20710e16ed4" Jun 13 01:11:05.706324 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697244 2563 flags.go:64] FLAG: --qos-reserved="" Jun 13 01:11:05.706324 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697247 2563 flags.go:64] FLAG: --read-only-port="10255" Jun 13 01:11:05.706324 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697250 2563 flags.go:64] FLAG: --register-node="true" Jun 13 01:11:05.706324 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697253 2563 flags.go:64] FLAG: --register-with-taints="" Jun 13 01:11:05.706324 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697256 2563 flags.go:64] FLAG: --registry-burst="10" Jun 13 01:11:05.706324 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697260 2563 flags.go:64] FLAG: --registry-qps="5" Jun 13 01:11:05.706324 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697262 2563 flags.go:64] FLAG: --reserved-cpus="" Jun 13 01:11:05.706324 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697267 2563 flags.go:64] FLAG: --reserved-memory="" Jun 13 01:11:05.706324 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697275 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 13 01:11:05.706324 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697278 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 13 01:11:05.706324 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697281 2563 flags.go:64] FLAG: --rotate-certificates="false" Jun 13 01:11:05.706324 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697284 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 13 01:11:05.706324 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697287 2563 flags.go:64] FLAG: --runonce="false" Jun 13 01:11:05.706324 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697290 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 13 01:11:05.707544 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697294 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 13 01:11:05.707544 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697298 2563 flags.go:64] FLAG: --seccomp-default="false" Jun 13 01:11:05.707544 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697301 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 13 01:11:05.707544 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697303 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 13 01:11:05.707544 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697306 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 13 01:11:05.707544 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697309 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 13 01:11:05.707544 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697312 2563 flags.go:64] FLAG: --storage-driver-password="root" Jun 13 01:11:05.707544 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697315 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jun 13 01:11:05.707544 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697318 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jun 13 01:11:05.707544 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697321 2563 flags.go:64] FLAG: --storage-driver-user="root" Jun 13 01:11:05.707544 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697324 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 13 01:11:05.707544 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697327 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 13 01:11:05.707544 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697330 2563 flags.go:64] FLAG: --system-cgroups="" Jun 13 01:11:05.707544 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697333 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 13 01:11:05.707544 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697338 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 13 01:11:05.707544 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697341 2563 flags.go:64] FLAG: --tls-cert-file="" Jun 13 01:11:05.707544 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697343 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 13 01:11:05.707544 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697348 2563 flags.go:64] FLAG: --tls-min-version="" Jun 13 01:11:05.707544 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697350 2563 flags.go:64] FLAG: --tls-private-key-file="" Jun 13 01:11:05.707544 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697353 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jun 13 01:11:05.707544 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697356 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 13 01:11:05.707544 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697359 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jun 13 01:11:05.707544 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697362 2563 flags.go:64] FLAG: --v="2" Jun 13 01:11:05.707544 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697366 2563 flags.go:64] FLAG: --version="false" Jun 13 01:11:05.707544 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697371 2563 flags.go:64] FLAG: --vmodule="" Jun 13 01:11:05.708357 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697377 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 13 01:11:05.708357 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.697380 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 13 01:11:05.708357 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697519 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 01:11:05.708357 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697523 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 01:11:05.708357 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697527 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 01:11:05.708357 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697530 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 01:11:05.708357 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697532 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 01:11:05.708357 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697535 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 01:11:05.708357 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697539 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 01:11:05.708357 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697542 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 01:11:05.708357 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697545 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 01:11:05.708357 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697547 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 01:11:05.708357 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697550 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 01:11:05.708357 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697552 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 01:11:05.708357 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697555 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 01:11:05.708357 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697557 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 01:11:05.708357 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697560 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 01:11:05.708357 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697562 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 01:11:05.708357 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697565 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 01:11:05.708357 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697567 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 01:11:05.709243 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697570 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 01:11:05.709243 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697572 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 01:11:05.709243 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697575 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 01:11:05.709243 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697577 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 01:11:05.709243 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697580 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 01:11:05.709243 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697584 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 01:11:05.709243 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697588 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 01:11:05.709243 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697591 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 01:11:05.709243 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697594 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 01:11:05.709243 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697596 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 01:11:05.709243 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697599 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 01:11:05.709243 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697602 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 01:11:05.709243 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697607 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 01:11:05.709243 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697610 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 01:11:05.709243 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697613 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 01:11:05.709243 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697616 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 01:11:05.709243 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697619 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 01:11:05.709243 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697622 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 01:11:05.709243 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697624 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 01:11:05.709821 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697627 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 01:11:05.709821 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697631 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 01:11:05.709821 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697634 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 01:11:05.709821 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697636 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 01:11:05.709821 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697639 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 01:11:05.709821 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697641 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 01:11:05.709821 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697644 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 01:11:05.709821 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697647 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 01:11:05.709821 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697649 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 01:11:05.709821 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697652 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 01:11:05.709821 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697655 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 01:11:05.709821 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697657 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 01:11:05.709821 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697660 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 01:11:05.709821 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697663 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 01:11:05.709821 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697665 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 01:11:05.709821 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697668 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 01:11:05.709821 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697670 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 01:11:05.709821 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697673 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 01:11:05.709821 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697675 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 01:11:05.709821 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697678 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 01:11:05.710469 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697680 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 01:11:05.710469 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697683 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 01:11:05.710469 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697686 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 01:11:05.710469 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697688 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 01:11:05.710469 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697691 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 01:11:05.710469 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697697 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 01:11:05.710469 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697700 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 01:11:05.710469 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697704 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 01:11:05.710469 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697706 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 01:11:05.710469 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697709 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 01:11:05.710469 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697712 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 01:11:05.710469 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697714 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 01:11:05.710469 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697717 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 01:11:05.710469 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697720 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 01:11:05.710469 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697723 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 01:11:05.710469 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697726 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 01:11:05.710469 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697728 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 01:11:05.710469 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697731 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 13 01:11:05.710469 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697733 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 01:11:05.710469 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697736 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 01:11:05.710964 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697740 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 01:11:05.710964 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697743 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 01:11:05.710964 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697746 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 01:11:05.710964 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697749 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 01:11:05.710964 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697751 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 01:11:05.710964 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697754 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 01:11:05.710964 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697756 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 01:11:05.710964 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697759 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 01:11:05.710964 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697762 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 01:11:05.710964 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697764 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 01:11:05.710964 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697767 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 01:11:05.710964 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697769 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 01:11:05.710964 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697771 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 01:11:05.710964 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697774 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 01:11:05.710964 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697776 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 01:11:05.710964 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697779 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 01:11:05.710964 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697781 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 01:11:05.710964 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697785 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 01:11:05.710964 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697788 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 01:11:05.711565 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697791 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 01:11:05.711565 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697793 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 01:11:05.711565 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.697796 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 01:11:05.711565 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.698459 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 01:11:05.711565 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.705853 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 13 01:11:05.711565 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.705874 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 13 01:11:05.711565 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.705899 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 13 01:11:05.711565 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.705908 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 13 01:11:05.711565 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706002 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 01:11:05.711565 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706010 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 01:11:05.711565 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706015 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 01:11:05.711565 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706020 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 01:11:05.711565 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706025 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 01:11:05.711565 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706030 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 01:11:05.711953 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706034 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 01:11:05.711953 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706039 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 01:11:05.711953 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706043 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 01:11:05.711953 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706048 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 01:11:05.711953 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706052 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 01:11:05.711953 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706056 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 01:11:05.711953 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706061 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 01:11:05.711953 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706065 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 01:11:05.711953 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706070 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 01:11:05.711953 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706074 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 01:11:05.711953 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706079 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 01:11:05.711953 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706083 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 01:11:05.711953 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706087 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 01:11:05.711953 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706092 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 01:11:05.711953 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706097 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 01:11:05.711953 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706101 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 01:11:05.711953 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706108 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 01:11:05.711953 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706114 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 01:11:05.711953 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706120 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 01:11:05.711953 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706124 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 01:11:05.712499 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706146 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 01:11:05.712499 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706151 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 01:11:05.712499 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706155 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 01:11:05.712499 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706160 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 01:11:05.712499 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706165 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 01:11:05.712499 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706170 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 01:11:05.712499 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706175 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 01:11:05.712499 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706179 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 01:11:05.712499 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706184 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 01:11:05.712499 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706190 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 01:11:05.712499 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706194 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 01:11:05.712499 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706199 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 01:11:05.712499 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706203 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 01:11:05.712499 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706208 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 01:11:05.712499 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706212 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 01:11:05.712499 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706217 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 01:11:05.712499 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706221 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 01:11:05.712499 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706226 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 13 01:11:05.712499 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706230 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 01:11:05.712499 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706235 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 01:11:05.712988 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706239 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 01:11:05.712988 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706243 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 01:11:05.712988 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706248 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 01:11:05.712988 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706252 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 01:11:05.712988 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706256 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 01:11:05.712988 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706261 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 01:11:05.712988 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706265 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 01:11:05.712988 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706270 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 01:11:05.712988 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706275 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 01:11:05.712988 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706279 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 01:11:05.712988 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706283 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 01:11:05.712988 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706289 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 01:11:05.712988 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706294 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 01:11:05.712988 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706298 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 01:11:05.712988 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706302 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 01:11:05.712988 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706308 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 01:11:05.712988 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706312 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 01:11:05.712988 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706317 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 01:11:05.712988 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706323 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 01:11:05.713480 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706328 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 01:11:05.713480 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706332 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 01:11:05.713480 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706336 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 01:11:05.713480 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706340 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 01:11:05.713480 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706345 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 01:11:05.713480 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706349 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 01:11:05.713480 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706353 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 01:11:05.713480 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706358 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 01:11:05.713480 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706363 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 01:11:05.713480 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706367 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 01:11:05.713480 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706371 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 01:11:05.713480 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706376 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 01:11:05.713480 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706381 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 01:11:05.713480 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706386 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 01:11:05.713480 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706390 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 01:11:05.713480 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706394 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 01:11:05.713480 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706399 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 01:11:05.713480 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706403 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 01:11:05.713480 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706408 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 01:11:05.713480 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706412 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 01:11:05.714006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706417 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 01:11:05.714006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706422 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 01:11:05.714006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706426 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 01:11:05.714006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706431 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 01:11:05.714006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706435 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 01:11:05.714006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706440 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 01:11:05.714006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706445 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 01:11:05.714006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706450 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 01:11:05.714006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706455 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 01:11:05.714006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706459 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 01:11:05.714006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706464 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 01:11:05.714006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706470 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 01:11:05.714006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706476 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 01:11:05.714006 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706481 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 01:11:05.714362 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.706490 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 01:11:05.714362 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706672 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 01:11:05.714362 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706680 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 01:11:05.714362 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706686 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 01:11:05.714362 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706691 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 01:11:05.714362 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706695 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 01:11:05.714362 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706699 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 01:11:05.714362 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706703 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 01:11:05.714362 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706708 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 01:11:05.714362 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706712 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 01:11:05.714362 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706717 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 01:11:05.714362 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706721 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 01:11:05.714362 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706725 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 01:11:05.714362 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706730 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 01:11:05.714362 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706735 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 01:11:05.714738 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706740 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 01:11:05.714738 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706744 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 01:11:05.714738 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706749 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 01:11:05.714738 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706754 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 01:11:05.714738 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706760 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 01:11:05.714738 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706765 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 01:11:05.714738 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706769 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 01:11:05.714738 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706774 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 01:11:05.714738 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706778 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 01:11:05.714738 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706783 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 01:11:05.714738 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706787 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 01:11:05.714738 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706792 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 01:11:05.714738 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706796 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 01:11:05.714738 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706800 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 01:11:05.714738 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706804 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 01:11:05.714738 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706809 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 01:11:05.714738 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706813 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 01:11:05.714738 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706817 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 01:11:05.714738 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706822 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 01:11:05.715261 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706826 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 01:11:05.715261 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706830 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 01:11:05.715261 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706835 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 01:11:05.715261 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706842 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 01:11:05.715261 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706848 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 01:11:05.715261 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706852 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 01:11:05.715261 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706857 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 13 01:11:05.715261 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706861 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 01:11:05.715261 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706865 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 01:11:05.715261 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706869 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 01:11:05.715261 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706873 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 01:11:05.715261 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706877 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 01:11:05.715261 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706882 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 01:11:05.715261 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706886 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 01:11:05.715261 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706891 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 01:11:05.715261 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706897 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 01:11:05.715261 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706902 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 01:11:05.715261 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706907 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 01:11:05.715261 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706912 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 01:11:05.715261 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706916 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 01:11:05.715801 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706921 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 01:11:05.715801 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706925 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 01:11:05.715801 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706930 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 01:11:05.715801 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706937 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 01:11:05.715801 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706943 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 01:11:05.715801 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706948 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 01:11:05.715801 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706954 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 01:11:05.715801 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706959 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 01:11:05.715801 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706965 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 01:11:05.715801 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706971 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 01:11:05.715801 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706976 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 01:11:05.715801 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706981 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 01:11:05.715801 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706985 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 01:11:05.715801 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706990 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 01:11:05.715801 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706994 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 01:11:05.715801 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.706999 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 01:11:05.715801 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707003 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 01:11:05.715801 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707007 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 01:11:05.715801 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707012 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 01:11:05.716305 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707016 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 01:11:05.716305 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707020 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 01:11:05.716305 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707025 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 01:11:05.716305 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707030 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 01:11:05.716305 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707034 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 01:11:05.716305 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707039 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 01:11:05.716305 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707043 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 01:11:05.716305 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707048 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 01:11:05.716305 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707052 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 01:11:05.716305 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707057 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 01:11:05.716305 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707061 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 01:11:05.716305 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707066 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 01:11:05.716305 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707070 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 01:11:05.716305 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707075 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 01:11:05.716305 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707079 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 01:11:05.716305 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707083 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 01:11:05.716305 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707088 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 01:11:05.716305 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707093 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 01:11:05.716305 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707097 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 01:11:05.716305 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707101 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 01:11:05.716865 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707106 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 01:11:05.716865 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707110 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 01:11:05.716865 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707115 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 01:11:05.716865 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707119 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 01:11:05.716865 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707123 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 01:11:05.716865 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707144 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 01:11:05.716865 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:05.707149 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 01:11:05.716865 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.707156 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 01:11:05.716865 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.707313 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jun 13 01:11:05.716865 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.710223 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 13 01:11:05.716865 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.711904 2563 server.go:1019] "Starting client certificate rotation" Jun 13 01:11:05.716865 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.712012 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 13 01:11:05.716865 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.714441 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 13 01:11:05.717453 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.717356 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 13 01:11:05.723384 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.723359 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 13 01:11:05.735256 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.735237 2563 log.go:25] "Validated CRI v1 runtime API" Jun 13 01:11:05.738219 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.738205 2563 log.go:25] "Validated CRI v1 image API" Jun 13 01:11:05.739008 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.738984 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 13 01:11:05.741677 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.741659 2563 fs.go:135] Filesystem UUIDs: map[2be02ceb-0d2c-4207-b899-a7b5e39b6716:/dev/nvme0n1p4 53f938c8-672a-4e11-aeb0-0dede0e82138:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 13 01:11:05.741744 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.741677 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 13 01:11:05.742016 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.741999 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 13 01:11:05.746769 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.746658 2563 manager.go:216] Machine: {Timestamp:2026-06-13 01:11:05.745335205 +0000 UTC m=+0.361350972 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101075 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b0d9991253d3980cb9d469d88333b SystemUUID:ec2b0d99-9125-3d39-80cb-9d469d88333b BootID:86d6afe6-7ad9-418d-9e13-09217a2fdba0 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a0:b5:98:8d:8d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a0:b5:98:8d:8d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:86:41:9c:43:e2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 13 01:11:05.746769 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.746766 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 13 01:11:05.746882 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.746843 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 13 01:11:05.750124 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.750094 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 13 01:11:05.750282 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.750141 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-115.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 13 01:11:05.751696 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.751686 2563 topology_manager.go:138] "Creating topology manager with none policy" Jun 13 01:11:05.751729 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.751699 2563 container_manager_linux.go:309] "Creating device plugin manager" Jun 13 01:11:05.751729 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.751707 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 13 01:11:05.752517 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.752506 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 13 01:11:05.754041 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.754031 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 13 01:11:05.757471 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.757459 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 13 01:11:05.757614 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.757604 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 13 01:11:05.757649 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.757636 2563 kubelet.go:486] "Attempting to sync node with API server" Jun 13 01:11:05.757649 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.757647 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 13 01:11:05.757704 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.757662 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 13 01:11:05.757704 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.757671 2563 kubelet.go:398] "Adding apiserver pod source" Jun 13 01:11:05.757704 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.757680 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 13 01:11:05.758142 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.758110 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 13 01:11:05.758188 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.758156 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 13 01:11:05.761118 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.761102 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 13 01:11:05.763019 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.763004 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 13 01:11:05.763110 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.763042 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 13 01:11:05.763256 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.763244 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 13 01:11:05.763323 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.763285 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 13 01:11:05.763323 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.763296 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 13 01:11:05.763323 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.763305 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 13 01:11:05.763323 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.763320 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 13 01:11:05.763438 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.763328 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 13 01:11:05.763849 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.763838 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 13 01:11:05.763902 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.763850 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 13 01:11:05.763902 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.763861 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 13 01:11:05.763902 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.763869 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 13 01:11:05.763902 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.763882 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 13 01:11:05.763902 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.763894 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 13 01:11:05.764722 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.764712 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 13 01:11:05.764785 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.764732 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 13 01:11:05.769014 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.768994 2563 server.go:1268] "Started kubelet" Jun 13 01:11:05.769185 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.769097 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 13 01:11:05.769319 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.769291 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 13 01:11:05.769385 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.769342 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 13 01:11:05.769448 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.769430 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-115.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 13 01:11:05.769896 ip-10-0-136-115 systemd[1]: Started Kubernetes Kubelet. Jun 13 01:11:05.770226 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:05.770192 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-115.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 13 01:11:05.770226 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:05.770192 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 13 01:11:05.771095 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.771079 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 13 01:11:05.771885 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.771870 2563 server.go:310] "Adding debug handlers to kubelet server" Jun 13 01:11:05.775304 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:05.774191 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-115.ec2.internal.18b87ecba6ea8fcc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-115.ec2.internal,UID:ip-10-0-136-115.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-115.ec2.internal,},FirstTimestamp:2026-06-13 01:11:05.768882124 +0000 UTC m=+0.384897893,LastTimestamp:2026-06-13 01:11:05.768882124 +0000 UTC m=+0.384897893,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-115.ec2.internal,}" Jun 13 01:11:05.776827 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.776810 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 13 01:11:05.776923 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.776863 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 13 01:11:05.776923 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:05.776890 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 13 01:11:05.776923 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:05.776909 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-115.ec2.internal\" not found" Jun 13 01:11:05.777552 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.777505 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 13 01:11:05.777552 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.777523 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 13 01:11:05.777552 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.777534 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 13 01:11:05.777990 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.777970 2563 factory.go:55] Registering systemd factory Jun 13 01:11:05.777990 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.777993 2563 factory.go:223] Registration of the systemd container factory successfully Jun 13 01:11:05.778155 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.778018 2563 reconstruct.go:97] "Volume reconstruction finished" Jun 13 01:11:05.778155 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.778027 2563 reconciler.go:29] "Reconciler: start to sync state" Jun 13 01:11:05.778240 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.778225 2563 factory.go:153] Registering CRI-O factory Jun 13 01:11:05.778240 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.778236 2563 factory.go:223] Registration of the crio container factory successfully Jun 13 01:11:05.778299 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.778281 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 13 01:11:05.778330 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.778318 2563 factory.go:103] Registering Raw factory Jun 13 01:11:05.778357 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.778338 2563 manager.go:1196] Started watching for new ooms in manager Jun 13 01:11:05.778815 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.778799 2563 manager.go:349] Starting recovery of all containers Jun 13 01:11:05.781580 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.781553 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mgvtv" Jun 13 01:11:05.785875 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:05.785852 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 13 01:11:05.785875 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:05.785853 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-115.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 13 01:11:05.789298 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.789086 2563 manager.go:354] Recovery completed Jun 13 01:11:05.790684 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.790663 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mgvtv" Jun 13 01:11:05.794332 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.794320 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 01:11:05.797588 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.797573 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-115.ec2.internal" event="NodeHasSufficientMemory" Jun 13 01:11:05.797646 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.797602 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-115.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 01:11:05.797646 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.797612 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-115.ec2.internal" event="NodeHasSufficientPID" Jun 13 01:11:05.798209 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.798196 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 13 01:11:05.798209 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.798209 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 13 01:11:05.798329 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.798213 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 01:11:05.798329 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.798227 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 13 01:11:05.798961 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.798945 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-115.ec2.internal" event="NodeHasSufficientMemory" Jun 13 01:11:05.799046 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.798976 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-115.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 01:11:05.799046 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.798990 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-115.ec2.internal" event="NodeHasSufficientPID" Jun 13 01:11:05.799442 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.799427 2563 policy_none.go:49] "None policy: Start" Jun 13 01:11:05.799502 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.799445 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 13 01:11:05.799502 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.799457 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 13 01:11:05.799881 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:05.799786 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-115.ec2.internal.18b87ecba8a093ad default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-115.ec2.internal,UID:ip-10-0-136-115.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-115.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-115.ec2.internal,},FirstTimestamp:2026-06-13 01:11:05.797587885 +0000 UTC m=+0.413603654,LastTimestamp:2026-06-13 01:11:05.797587885 +0000 UTC m=+0.413603654,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-115.ec2.internal,}" Jun 13 01:11:05.800692 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.800680 2563 policy_none.go:47] "Start" Jun 13 01:11:05.839779 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.839755 2563 manager.go:337] "Starting Device Plugin manager" Jun 13 01:11:05.850000 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:05.839794 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 13 01:11:05.850000 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.839808 2563 server.go:87] "Starting device plugin registration server" Jun 13 01:11:05.850000 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.840084 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 13 01:11:05.850000 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.840100 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 13 01:11:05.850000 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.840196 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 13 01:11:05.850000 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.840285 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 13 01:11:05.850000 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.840295 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 13 01:11:05.850000 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:05.841049 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 13 01:11:05.850000 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:05.841098 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-115.ec2.internal\" not found" Jun 13 01:11:05.850000 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.844658 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 13 01:11:05.850000 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.845775 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 13 01:11:05.850000 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.845808 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 13 01:11:05.850000 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.845827 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jun 13 01:11:05.850000 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:05.845856 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 13 01:11:05.850000 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.847830 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 01:11:05.940941 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.940835 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 01:11:05.942161 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.942115 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-115.ec2.internal" event="NodeHasSufficientMemory" Jun 13 01:11:05.942279 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.942175 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-115.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 01:11:05.942279 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.942188 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-115.ec2.internal" event="NodeHasSufficientPID" Jun 13 01:11:05.942279 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.942213 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-115.ec2.internal" Jun 13 01:11:05.946112 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.946093 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-115.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-115.ec2.internal"] Jun 13 01:11:05.946191 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.946169 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 01:11:05.947622 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.947604 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-115.ec2.internal" event="NodeHasSufficientMemory" Jun 13 01:11:05.947722 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.947639 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-115.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 01:11:05.947722 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.947657 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-115.ec2.internal" event="NodeHasSufficientPID" Jun 13 01:11:05.949214 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.949200 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 01:11:05.949325 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.949310 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-115.ec2.internal" Jun 13 01:11:05.949371 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.949350 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 01:11:05.949899 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.949878 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-115.ec2.internal" event="NodeHasSufficientMemory" Jun 13 01:11:05.949899 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.949888 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-115.ec2.internal" event="NodeHasSufficientMemory" Jun 13 01:11:05.950008 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.949903 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-115.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 01:11:05.950008 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.949913 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-115.ec2.internal" event="NodeHasSufficientPID" Jun 13 01:11:05.950008 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.949912 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-115.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 01:11:05.950008 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.950007 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-115.ec2.internal" event="NodeHasSufficientPID" Jun 13 01:11:05.951408 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.951392 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-115.ec2.internal" Jun 13 01:11:05.951484 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.951421 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 01:11:05.952141 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.952114 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-115.ec2.internal" event="NodeHasSufficientMemory" Jun 13 01:11:05.952224 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.952151 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-115.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 01:11:05.952224 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.952161 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-115.ec2.internal" event="NodeHasSufficientPID" Jun 13 01:11:05.953462 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.953446 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-115.ec2.internal" Jun 13 01:11:05.953543 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:05.953472 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-115.ec2.internal\": node \"ip-10-0-136-115.ec2.internal\" not found" Jun 13 01:11:05.975862 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:05.975843 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-115.ec2.internal\" not found" node="ip-10-0-136-115.ec2.internal" Jun 13 01:11:05.979086 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.979068 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b9f82f31f8f0a5ba85ef22128acf9d31-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-115.ec2.internal\" (UID: \"b9f82f31f8f0a5ba85ef22128acf9d31\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-115.ec2.internal" Jun 13 01:11:05.979187 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.979098 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9f82f31f8f0a5ba85ef22128acf9d31-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-115.ec2.internal\" (UID: \"b9f82f31f8f0a5ba85ef22128acf9d31\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-115.ec2.internal" Jun 13 01:11:05.979187 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:05.979101 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-115.ec2.internal\" not found" node="ip-10-0-136-115.ec2.internal" Jun 13 01:11:05.979269 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:05.979140 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7401f1fc17763ddc1d839785e91b064c-config\") pod \"kube-apiserver-proxy-ip-10-0-136-115.ec2.internal\" (UID: \"7401f1fc17763ddc1d839785e91b064c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-115.ec2.internal" Jun 13 01:11:05.986193 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:05.986176 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-115.ec2.internal\" not found" Jun 13 01:11:06.080301 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:06.080270 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b9f82f31f8f0a5ba85ef22128acf9d31-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-115.ec2.internal\" (UID: \"b9f82f31f8f0a5ba85ef22128acf9d31\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-115.ec2.internal" Jun 13 01:11:06.080301 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:06.080308 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9f82f31f8f0a5ba85ef22128acf9d31-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-115.ec2.internal\" (UID: \"b9f82f31f8f0a5ba85ef22128acf9d31\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-115.ec2.internal" Jun 13 01:11:06.080534 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:06.080334 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7401f1fc17763ddc1d839785e91b064c-config\") pod \"kube-apiserver-proxy-ip-10-0-136-115.ec2.internal\" (UID: \"7401f1fc17763ddc1d839785e91b064c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-115.ec2.internal" Jun 13 01:11:06.080534 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:06.080369 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7401f1fc17763ddc1d839785e91b064c-config\") pod \"kube-apiserver-proxy-ip-10-0-136-115.ec2.internal\" (UID: \"7401f1fc17763ddc1d839785e91b064c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-115.ec2.internal" Jun 13 01:11:06.080534 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:06.080375 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b9f82f31f8f0a5ba85ef22128acf9d31-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-115.ec2.internal\" (UID: \"b9f82f31f8f0a5ba85ef22128acf9d31\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-115.ec2.internal" Jun 13 01:11:06.080534 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:06.080380 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9f82f31f8f0a5ba85ef22128acf9d31-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-115.ec2.internal\" (UID: \"b9f82f31f8f0a5ba85ef22128acf9d31\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-115.ec2.internal" Jun 13 01:11:06.086382 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:06.086364 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-115.ec2.internal\" not found" Jun 13 01:11:06.187205 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:06.187169 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-115.ec2.internal\" not found" Jun 13 01:11:06.278797 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:06.278730 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-115.ec2.internal" Jun 13 01:11:06.284100 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:06.284078 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-115.ec2.internal" Jun 13 01:11:06.287488 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:06.287469 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-115.ec2.internal\" not found" Jun 13 01:11:06.388383 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:06.388343 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-115.ec2.internal\" not found" Jun 13 01:11:06.488916 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:06.488881 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-115.ec2.internal\" not found" Jun 13 01:11:06.589419 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:06.589387 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-115.ec2.internal\" not found" Jun 13 01:11:06.619060 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:06.619029 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 01:11:06.690353 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:06.690325 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-115.ec2.internal\" not found" Jun 13 01:11:06.711495 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:06.711465 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 13 01:11:06.711661 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:06.711642 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 13 01:11:06.711726 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:06.711667 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 13 01:11:06.779086 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:06.779052 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9f82f31f8f0a5ba85ef22128acf9d31.slice/crio-cc8c2d5da35bffb945fc53aa0031ff119b0b642f16e96f3bb4d19398b9d44b2c WatchSource:0}: Error finding container cc8c2d5da35bffb945fc53aa0031ff119b0b642f16e96f3bb4d19398b9d44b2c: Status 404 returned error can't find the container with id cc8c2d5da35bffb945fc53aa0031ff119b0b642f16e96f3bb4d19398b9d44b2c Jun 13 01:11:06.779536 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:06.779517 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7401f1fc17763ddc1d839785e91b064c.slice/crio-b0ec242fc66a8b96b47b3511f28c8d5f121518974a711c047653c99fd9d688fa WatchSource:0}: Error finding container b0ec242fc66a8b96b47b3511f28c8d5f121518974a711c047653c99fd9d688fa: Status 404 returned error can't find the container with id b0ec242fc66a8b96b47b3511f28c8d5f121518974a711c047653c99fd9d688fa Jun 13 01:11:06.784785 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:06.784772 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 01:11:06.790676 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:06.790659 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-115.ec2.internal\" not found" Jun 13 01:11:06.795496 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:06.795465 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-12 01:06:05 +0000 UTC" deadline="2027-11-06 13:29:43.065819191 +0000 UTC" Jun 13 01:11:06.795496 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:06.795495 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12276h18m36.270327368s" Jun 13 01:11:06.849304 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:06.849192 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-115.ec2.internal" event={"ID":"b9f82f31f8f0a5ba85ef22128acf9d31","Type":"ContainerStarted","Data":"cc8c2d5da35bffb945fc53aa0031ff119b0b642f16e96f3bb4d19398b9d44b2c"} Jun 13 01:11:06.850066 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:06.850047 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-115.ec2.internal" event={"ID":"7401f1fc17763ddc1d839785e91b064c","Type":"ContainerStarted","Data":"b0ec242fc66a8b96b47b3511f28c8d5f121518974a711c047653c99fd9d688fa"} Jun 13 01:11:06.891575 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:06.891543 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-115.ec2.internal\" not found" Jun 13 01:11:06.992076 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:06.992030 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-115.ec2.internal\" not found" Jun 13 01:11:07.092552 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:07.092524 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-115.ec2.internal\" not found" Jun 13 01:11:07.193168 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:07.193066 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-115.ec2.internal\" not found" Jun 13 01:11:07.293921 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:07.293888 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-115.ec2.internal\" not found" Jun 13 01:11:07.340050 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.340018 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 01:11:07.346285 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.346259 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 01:11:07.377177 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.377146 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-115.ec2.internal" Jun 13 01:11:07.390097 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.390073 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 13 01:11:07.391379 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.391357 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-115.ec2.internal" Jun 13 01:11:07.401144 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.401099 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 13 01:11:07.758869 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.758832 2563 apiserver.go:52] "Watching apiserver" Jun 13 01:11:07.765002 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.764975 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 13 01:11:07.766157 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.766116 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-qjntx","openshift-network-operator/iptables-alerter-vl6c6","kube-system/konnectivity-agent-cw7n2","openshift-dns/node-resolver-t6xgs","openshift-image-registry/node-ca-29fpw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-115.ec2.internal","openshift-multus/multus-additional-cni-plugins-wf2vg","openshift-multus/multus-ht6wg","openshift-ovn-kubernetes/ovnkube-node-ppvdn","kube-system/global-pull-secret-syncer-56c2g","kube-system/kube-apiserver-proxy-ip-10-0-136-115.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7","openshift-cluster-node-tuning-operator/tuned-g299k","openshift-multus/network-metrics-daemon-mthf7"] Jun 13 01:11:07.768018 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.767996 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t6xgs" Jun 13 01:11:07.769324 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.769302 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wf2vg" Jun 13 01:11:07.770371 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.770351 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7tlx4\"" Jun 13 01:11:07.770652 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.770633 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cw7n2" Jun 13 01:11:07.770737 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.770673 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 13 01:11:07.771647 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.771622 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 13 01:11:07.771787 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.771648 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 13 01:11:07.772035 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.771969 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vl6c6" Jun 13 01:11:07.772147 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.772108 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 13 01:11:07.772672 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.772655 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 13 01:11:07.773348 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.773329 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-29fpw" Jun 13 01:11:07.774017 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.773788 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 13 01:11:07.774017 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.773874 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 13 01:11:07.774017 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.773893 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 13 01:11:07.774017 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.773912 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 13 01:11:07.774291 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.774067 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cbtkt\"" Jun 13 01:11:07.775005 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.774760 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kqrb2\"" Jun 13 01:11:07.775005 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.774798 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 13 01:11:07.775207 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.775045 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:11:07.775267 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:07.775225 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjntx" podUID="9e49a00c-03c7-4083-9e34-e59e0d37cc3d" Jun 13 01:11:07.776061 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.775642 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 13 01:11:07.776061 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.775691 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qxs79\"" Jun 13 01:11:07.776061 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.775750 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 13 01:11:07.776061 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.775885 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 13 01:11:07.776061 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.775903 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 13 01:11:07.776061 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.775935 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 13 01:11:07.776405 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.776109 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cmpgt\"" Jun 13 01:11:07.776405 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.776382 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.778464 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.777502 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 13 01:11:07.778464 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.778210 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.779210 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.779188 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 13 01:11:07.779305 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.779247 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qkx9r\"" Jun 13 01:11:07.779634 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.779614 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:07.779718 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:07.779682 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56c2g" podUID="84d32cae-48d5-4aba-af49-e6ad82ff2e47" Jun 13 01:11:07.780401 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.780232 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 13 01:11:07.780743 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.780725 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 13 01:11:07.781226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.781210 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7" Jun 13 01:11:07.781670 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.781554 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-swn2n\"" Jun 13 01:11:07.781756 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.781713 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 13 01:11:07.781756 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.781726 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 13 01:11:07.781861 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.781768 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 13 01:11:07.781861 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.781731 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 13 01:11:07.783702 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.783683 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.784629 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.784611 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 13 01:11:07.784898 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.784881 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7j64s\"" Jun 13 01:11:07.785003 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.784985 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 13 01:11:07.785100 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.785081 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 13 01:11:07.785197 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.785085 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:07.785257 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:07.785200 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthf7" podUID="4b218b9d-0f16-40fc-9753-0892624afc14" Jun 13 01:11:07.786192 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.786170 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-g2djh\"" Jun 13 01:11:07.786702 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.786681 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 13 01:11:07.787992 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.787969 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 13 01:11:07.789569 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.789534 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2a2385b8-b719-4fbb-a0ec-75b6dadeee56-hosts-file\") pod \"node-resolver-t6xgs\" (UID: \"2a2385b8-b719-4fbb-a0ec-75b6dadeee56\") " pod="openshift-dns/node-resolver-t6xgs" Jun 13 01:11:07.789662 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.789586 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-var-lib-openvswitch\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.789662 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.789620 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8pvw\" (UniqueName: \"kubernetes.io/projected/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-kube-api-access-s8pvw\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.789662 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.789651 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-host-var-lib-cni-multus\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.789791 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.789683 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-host-run-netns\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.789791 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.789714 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-host-cni-bin\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.789791 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.789741 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.789791 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.789773 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/927341bf-fe3e-40c1-a95c-061b6571c321-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wf2vg\" (UID: \"927341bf-fe3e-40c1-a95c-061b6571c321\") " pod="openshift-multus/multus-additional-cni-plugins-wf2vg" Jun 13 01:11:07.789972 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.789804 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-etc-openvswitch\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.790271 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.790244 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/927341bf-fe3e-40c1-a95c-061b6571c321-os-release\") pod \"multus-additional-cni-plugins-wf2vg\" (UID: \"927341bf-fe3e-40c1-a95c-061b6571c321\") " pod="openshift-multus/multus-additional-cni-plugins-wf2vg" Jun 13 01:11:07.790326 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.790293 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-cni-binary-copy\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.790377 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.790327 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-run-ovn\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.790377 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.790362 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d914e0b-d762-4948-80f6-79317ccb0a92-host-slash\") pod \"iptables-alerter-vl6c6\" (UID: \"4d914e0b-d762-4948-80f6-79317ccb0a92\") " pod="openshift-network-operator/iptables-alerter-vl6c6" Jun 13 01:11:07.790472 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.790392 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bww54\" (UniqueName: \"kubernetes.io/projected/9e49a00c-03c7-4083-9e34-e59e0d37cc3d-kube-api-access-bww54\") pod \"network-check-target-qjntx\" (UID: \"9e49a00c-03c7-4083-9e34-e59e0d37cc3d\") " pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:11:07.790472 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.790443 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c3364a81-6e76-4d46-ac19-63a163ecb01a-agent-certs\") pod \"konnectivity-agent-cw7n2\" (UID: \"c3364a81-6e76-4d46-ac19-63a163ecb01a\") " pod="kube-system/konnectivity-agent-cw7n2" Jun 13 01:11:07.790579 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.790505 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-host-var-lib-kubelet\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.790579 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.790549 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e98f7500-070e-4c57-a4b0-a711e20b8c26-ovnkube-config\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.790681 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.790584 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcck6\" (UniqueName: \"kubernetes.io/projected/927341bf-fe3e-40c1-a95c-061b6571c321-kube-api-access-wcck6\") pod \"multus-additional-cni-plugins-wf2vg\" (UID: \"927341bf-fe3e-40c1-a95c-061b6571c321\") " pod="openshift-multus/multus-additional-cni-plugins-wf2vg" Jun 13 01:11:07.790681 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.790612 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-host-run-netns\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.790681 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.790655 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-host-var-lib-cni-bin\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.790817 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.790713 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4ngw\" (UniqueName: \"kubernetes.io/projected/e98f7500-070e-4c57-a4b0-a711e20b8c26-kube-api-access-t4ngw\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.790868 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.790824 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c3364a81-6e76-4d46-ac19-63a163ecb01a-konnectivity-ca\") pod \"konnectivity-agent-cw7n2\" (UID: \"c3364a81-6e76-4d46-ac19-63a163ecb01a\") " pod="kube-system/konnectivity-agent-cw7n2" Jun 13 01:11:07.790925 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.790863 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-cnibin\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.790976 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.790896 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-run-systemd\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.791026 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.790967 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-host-run-ovn-kubernetes\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.791026 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.791002 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-host-cni-netd\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.791232 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.791031 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/927341bf-fe3e-40c1-a95c-061b6571c321-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wf2vg\" (UID: \"927341bf-fe3e-40c1-a95c-061b6571c321\") " pod="openshift-multus/multus-additional-cni-plugins-wf2vg" Jun 13 01:11:07.791232 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.791118 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-multus-daemon-config\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.792321 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.791535 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-node-log\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.792321 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.791585 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/927341bf-fe3e-40c1-a95c-061b6571c321-cnibin\") pod \"multus-additional-cni-plugins-wf2vg\" (UID: \"927341bf-fe3e-40c1-a95c-061b6571c321\") " pod="openshift-multus/multus-additional-cni-plugins-wf2vg" Jun 13 01:11:07.792321 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.791610 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-etc-kubernetes\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.792321 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.791633 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-host-kubelet\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.792321 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.791655 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a2385b8-b719-4fbb-a0ec-75b6dadeee56-tmp-dir\") pod \"node-resolver-t6xgs\" (UID: \"2a2385b8-b719-4fbb-a0ec-75b6dadeee56\") " pod="openshift-dns/node-resolver-t6xgs" Jun 13 01:11:07.792321 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.791679 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd448\" (UniqueName: \"kubernetes.io/projected/2a2385b8-b719-4fbb-a0ec-75b6dadeee56-kube-api-access-xd448\") pod \"node-resolver-t6xgs\" (UID: \"2a2385b8-b719-4fbb-a0ec-75b6dadeee56\") " pod="openshift-dns/node-resolver-t6xgs" Jun 13 01:11:07.792321 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.791704 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4d914e0b-d762-4948-80f6-79317ccb0a92-iptables-alerter-script\") pod \"iptables-alerter-vl6c6\" (UID: \"4d914e0b-d762-4948-80f6-79317ccb0a92\") " pod="openshift-network-operator/iptables-alerter-vl6c6" Jun 13 01:11:07.792321 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.791728 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-host-run-k8s-cni-cncf-io\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.792321 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.791750 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-hostroot\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.792321 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.791774 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-host-slash\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.792321 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.791797 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/927341bf-fe3e-40c1-a95c-061b6571c321-system-cni-dir\") pod \"multus-additional-cni-plugins-wf2vg\" (UID: \"927341bf-fe3e-40c1-a95c-061b6571c321\") " pod="openshift-multus/multus-additional-cni-plugins-wf2vg" Jun 13 01:11:07.792321 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.791819 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-multus-cni-dir\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.792321 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.791841 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-multus-socket-dir-parent\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.792321 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.791862 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-systemd-units\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.792321 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.791884 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b95fc5d7-d3d7-4d28-94d6-ec2ae9ac65b4-serviceca\") pod \"node-ca-29fpw\" (UID: \"b95fc5d7-d3d7-4d28-94d6-ec2ae9ac65b4\") " pod="openshift-image-registry/node-ca-29fpw" Jun 13 01:11:07.792321 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.791912 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-system-cni-dir\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.792321 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.791936 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-host-run-multus-certs\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.793224 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.791959 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-run-openvswitch\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.793224 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.791998 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-log-socket\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.793224 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.792022 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e98f7500-070e-4c57-a4b0-a711e20b8c26-env-overrides\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.793224 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.792046 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-multus-conf-dir\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.793224 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.792072 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw6dn\" (UniqueName: \"kubernetes.io/projected/b95fc5d7-d3d7-4d28-94d6-ec2ae9ac65b4-kube-api-access-sw6dn\") pod \"node-ca-29fpw\" (UID: \"b95fc5d7-d3d7-4d28-94d6-ec2ae9ac65b4\") " pod="openshift-image-registry/node-ca-29fpw" Jun 13 01:11:07.793224 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.792097 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/84d32cae-48d5-4aba-af49-e6ad82ff2e47-kubelet-config\") pod \"global-pull-secret-syncer-56c2g\" (UID: \"84d32cae-48d5-4aba-af49-e6ad82ff2e47\") " pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:07.793224 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.792120 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-os-release\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.793224 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.792175 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84d32cae-48d5-4aba-af49-e6ad82ff2e47-original-pull-secret\") pod \"global-pull-secret-syncer-56c2g\" (UID: \"84d32cae-48d5-4aba-af49-e6ad82ff2e47\") " pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:07.793224 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.792217 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/927341bf-fe3e-40c1-a95c-061b6571c321-cni-binary-copy\") pod \"multus-additional-cni-plugins-wf2vg\" (UID: \"927341bf-fe3e-40c1-a95c-061b6571c321\") " pod="openshift-multus/multus-additional-cni-plugins-wf2vg" Jun 13 01:11:07.793224 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.792261 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/927341bf-fe3e-40c1-a95c-061b6571c321-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wf2vg\" (UID: \"927341bf-fe3e-40c1-a95c-061b6571c321\") " pod="openshift-multus/multus-additional-cni-plugins-wf2vg" Jun 13 01:11:07.793224 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.792292 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b95fc5d7-d3d7-4d28-94d6-ec2ae9ac65b4-host\") pod \"node-ca-29fpw\" (UID: \"b95fc5d7-d3d7-4d28-94d6-ec2ae9ac65b4\") " pod="openshift-image-registry/node-ca-29fpw" Jun 13 01:11:07.793224 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.792319 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfnhx\" (UniqueName: \"kubernetes.io/projected/4d914e0b-d762-4948-80f6-79317ccb0a92-kube-api-access-hfnhx\") pod \"iptables-alerter-vl6c6\" (UID: \"4d914e0b-d762-4948-80f6-79317ccb0a92\") " pod="openshift-network-operator/iptables-alerter-vl6c6" Jun 13 01:11:07.793224 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.792344 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/84d32cae-48d5-4aba-af49-e6ad82ff2e47-dbus\") pod \"global-pull-secret-syncer-56c2g\" (UID: \"84d32cae-48d5-4aba-af49-e6ad82ff2e47\") " pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:07.793224 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.792371 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e98f7500-070e-4c57-a4b0-a711e20b8c26-ovn-node-metrics-cert\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.793224 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.792394 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e98f7500-070e-4c57-a4b0-a711e20b8c26-ovnkube-script-lib\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.794064 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.793741 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 13 01:11:07.856279 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.856255 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-g4k8r" Jun 13 01:11:07.878016 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.877984 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-g4k8r" Jun 13 01:11:07.878610 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.878592 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 13 01:11:07.893300 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.893277 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84d32cae-48d5-4aba-af49-e6ad82ff2e47-original-pull-secret\") pod \"global-pull-secret-syncer-56c2g\" (UID: \"84d32cae-48d5-4aba-af49-e6ad82ff2e47\") " pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:07.893434 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.893306 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/927341bf-fe3e-40c1-a95c-061b6571c321-cni-binary-copy\") pod \"multus-additional-cni-plugins-wf2vg\" (UID: \"927341bf-fe3e-40c1-a95c-061b6571c321\") " pod="openshift-multus/multus-additional-cni-plugins-wf2vg" Jun 13 01:11:07.893434 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.893325 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/927341bf-fe3e-40c1-a95c-061b6571c321-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wf2vg\" (UID: \"927341bf-fe3e-40c1-a95c-061b6571c321\") " pod="openshift-multus/multus-additional-cni-plugins-wf2vg" Jun 13 01:11:07.893434 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.893344 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b95fc5d7-d3d7-4d28-94d6-ec2ae9ac65b4-host\") pod \"node-ca-29fpw\" (UID: \"b95fc5d7-d3d7-4d28-94d6-ec2ae9ac65b4\") " pod="openshift-image-registry/node-ca-29fpw" Jun 13 01:11:07.893434 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.893371 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-run\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.893434 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.893394 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-var-lib-kubelet\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.893434 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.893418 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjvtd\" (UniqueName: \"kubernetes.io/projected/72977bd4-f568-4f1c-b130-51af03613060-kube-api-access-hjvtd\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.893733 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.893445 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b95fc5d7-d3d7-4d28-94d6-ec2ae9ac65b4-host\") pod \"node-ca-29fpw\" (UID: \"b95fc5d7-d3d7-4d28-94d6-ec2ae9ac65b4\") " pod="openshift-image-registry/node-ca-29fpw" Jun 13 01:11:07.893733 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:07.893458 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:07.893733 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.893448 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfnhx\" (UniqueName: \"kubernetes.io/projected/4d914e0b-d762-4948-80f6-79317ccb0a92-kube-api-access-hfnhx\") pod \"iptables-alerter-vl6c6\" (UID: \"4d914e0b-d762-4948-80f6-79317ccb0a92\") " pod="openshift-network-operator/iptables-alerter-vl6c6" Jun 13 01:11:07.893733 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.893502 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/84d32cae-48d5-4aba-af49-e6ad82ff2e47-dbus\") pod \"global-pull-secret-syncer-56c2g\" (UID: \"84d32cae-48d5-4aba-af49-e6ad82ff2e47\") " pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:07.893733 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.893536 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/927341bf-fe3e-40c1-a95c-061b6571c321-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wf2vg\" (UID: \"927341bf-fe3e-40c1-a95c-061b6571c321\") " pod="openshift-multus/multus-additional-cni-plugins-wf2vg" Jun 13 01:11:07.893733 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.893573 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/84d32cae-48d5-4aba-af49-e6ad82ff2e47-dbus\") pod \"global-pull-secret-syncer-56c2g\" (UID: \"84d32cae-48d5-4aba-af49-e6ad82ff2e47\") " pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:07.893733 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:07.893709 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84d32cae-48d5-4aba-af49-e6ad82ff2e47-original-pull-secret podName:84d32cae-48d5-4aba-af49-e6ad82ff2e47 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:08.393514169 +0000 UTC m=+3.009529936 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84d32cae-48d5-4aba-af49-e6ad82ff2e47-original-pull-secret") pod "global-pull-secret-syncer-56c2g" (UID: "84d32cae-48d5-4aba-af49-e6ad82ff2e47") : object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:07.894035 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.893741 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e98f7500-070e-4c57-a4b0-a711e20b8c26-ovn-node-metrics-cert\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.894035 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.893771 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e98f7500-070e-4c57-a4b0-a711e20b8c26-ovnkube-script-lib\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.894035 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.893802 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/97db085b-86c6-4ef9-b6e1-ba915bec57a3-device-dir\") pod \"aws-ebs-csi-driver-node-slfd7\" (UID: \"97db085b-86c6-4ef9-b6e1-ba915bec57a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7" Jun 13 01:11:07.894035 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.893830 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfmdw\" (UniqueName: \"kubernetes.io/projected/97db085b-86c6-4ef9-b6e1-ba915bec57a3-kube-api-access-nfmdw\") pod \"aws-ebs-csi-driver-node-slfd7\" (UID: \"97db085b-86c6-4ef9-b6e1-ba915bec57a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7" Jun 13 01:11:07.894035 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.893856 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2a2385b8-b719-4fbb-a0ec-75b6dadeee56-hosts-file\") pod \"node-resolver-t6xgs\" (UID: \"2a2385b8-b719-4fbb-a0ec-75b6dadeee56\") " pod="openshift-dns/node-resolver-t6xgs" Jun 13 01:11:07.894035 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.893901 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-var-lib-openvswitch\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.894035 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.893941 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/927341bf-fe3e-40c1-a95c-061b6571c321-cni-binary-copy\") pod \"multus-additional-cni-plugins-wf2vg\" (UID: \"927341bf-fe3e-40c1-a95c-061b6571c321\") " pod="openshift-multus/multus-additional-cni-plugins-wf2vg" Jun 13 01:11:07.894035 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.893949 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2a2385b8-b719-4fbb-a0ec-75b6dadeee56-hosts-file\") pod \"node-resolver-t6xgs\" (UID: \"2a2385b8-b719-4fbb-a0ec-75b6dadeee56\") " pod="openshift-dns/node-resolver-t6xgs" Jun 13 01:11:07.894035 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894003 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8pvw\" (UniqueName: \"kubernetes.io/projected/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-kube-api-access-s8pvw\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.894035 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894016 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-var-lib-openvswitch\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.894543 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894079 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 13 01:11:07.894543 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894109 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-etc-modprobe-d\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.894543 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894164 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-host-var-lib-cni-multus\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.894543 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894186 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-host-run-netns\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.894543 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894219 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-host-cni-bin\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.894543 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894262 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-host-run-netns\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.894543 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894270 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.894543 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894334 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-host-var-lib-cni-multus\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.894543 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894330 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/927341bf-fe3e-40c1-a95c-061b6571c321-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wf2vg\" (UID: \"927341bf-fe3e-40c1-a95c-061b6571c321\") " pod="openshift-multus/multus-additional-cni-plugins-wf2vg" Jun 13 01:11:07.894543 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894371 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-host-cni-bin\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.894543 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894492 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-etc-openvswitch\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.894543 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894509 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e98f7500-070e-4c57-a4b0-a711e20b8c26-ovnkube-script-lib\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.894543 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894522 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72977bd4-f568-4f1c-b130-51af03613060-etc-tuned\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.895183 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894565 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs\") pod \"network-metrics-daemon-mthf7\" (UID: \"4b218b9d-0f16-40fc-9753-0892624afc14\") " pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:07.895183 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894571 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-etc-openvswitch\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.895183 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894583 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/927341bf-fe3e-40c1-a95c-061b6571c321-os-release\") pod \"multus-additional-cni-plugins-wf2vg\" (UID: \"927341bf-fe3e-40c1-a95c-061b6571c321\") " pod="openshift-multus/multus-additional-cni-plugins-wf2vg" Jun 13 01:11:07.895183 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894610 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-cni-binary-copy\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.895183 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894637 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/927341bf-fe3e-40c1-a95c-061b6571c321-os-release\") pod \"multus-additional-cni-plugins-wf2vg\" (UID: \"927341bf-fe3e-40c1-a95c-061b6571c321\") " pod="openshift-multus/multus-additional-cni-plugins-wf2vg" Jun 13 01:11:07.895183 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894669 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.895183 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894690 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/97db085b-86c6-4ef9-b6e1-ba915bec57a3-socket-dir\") pod \"aws-ebs-csi-driver-node-slfd7\" (UID: \"97db085b-86c6-4ef9-b6e1-ba915bec57a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7" Jun 13 01:11:07.895183 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894790 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-run-ovn\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.895183 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894823 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d914e0b-d762-4948-80f6-79317ccb0a92-host-slash\") pod \"iptables-alerter-vl6c6\" (UID: \"4d914e0b-d762-4948-80f6-79317ccb0a92\") " pod="openshift-network-operator/iptables-alerter-vl6c6" Jun 13 01:11:07.895183 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894823 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/927341bf-fe3e-40c1-a95c-061b6571c321-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wf2vg\" (UID: \"927341bf-fe3e-40c1-a95c-061b6571c321\") " pod="openshift-multus/multus-additional-cni-plugins-wf2vg" Jun 13 01:11:07.895183 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894859 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-run-ovn\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.895183 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894868 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bww54\" (UniqueName: \"kubernetes.io/projected/9e49a00c-03c7-4083-9e34-e59e0d37cc3d-kube-api-access-bww54\") pod \"network-check-target-qjntx\" (UID: \"9e49a00c-03c7-4083-9e34-e59e0d37cc3d\") " pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:11:07.895183 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894884 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d914e0b-d762-4948-80f6-79317ccb0a92-host-slash\") pod \"iptables-alerter-vl6c6\" (UID: \"4d914e0b-d762-4948-80f6-79317ccb0a92\") " pod="openshift-network-operator/iptables-alerter-vl6c6" Jun 13 01:11:07.895183 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894921 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c3364a81-6e76-4d46-ac19-63a163ecb01a-agent-certs\") pod \"konnectivity-agent-cw7n2\" (UID: \"c3364a81-6e76-4d46-ac19-63a163ecb01a\") " pod="kube-system/konnectivity-agent-cw7n2" Jun 13 01:11:07.895183 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.894968 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-host-var-lib-kubelet\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.895183 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895051 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e98f7500-070e-4c57-a4b0-a711e20b8c26-ovnkube-config\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.895183 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895099 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-etc-kubernetes\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.895994 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895155 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcck6\" (UniqueName: \"kubernetes.io/projected/927341bf-fe3e-40c1-a95c-061b6571c321-kube-api-access-wcck6\") pod \"multus-additional-cni-plugins-wf2vg\" (UID: \"927341bf-fe3e-40c1-a95c-061b6571c321\") " pod="openshift-multus/multus-additional-cni-plugins-wf2vg" Jun 13 01:11:07.895994 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895178 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-host-run-netns\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.895994 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895197 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-host-var-lib-cni-bin\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.895994 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895202 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-cni-binary-copy\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.895994 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895247 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-host-run-netns\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.895994 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895248 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4ngw\" (UniqueName: \"kubernetes.io/projected/e98f7500-070e-4c57-a4b0-a711e20b8c26-kube-api-access-t4ngw\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.895994 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895281 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-etc-systemd\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.895994 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895302 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/97db085b-86c6-4ef9-b6e1-ba915bec57a3-etc-selinux\") pod \"aws-ebs-csi-driver-node-slfd7\" (UID: \"97db085b-86c6-4ef9-b6e1-ba915bec57a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7" Jun 13 01:11:07.895994 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895325 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c3364a81-6e76-4d46-ac19-63a163ecb01a-konnectivity-ca\") pod \"konnectivity-agent-cw7n2\" (UID: \"c3364a81-6e76-4d46-ac19-63a163ecb01a\") " pod="kube-system/konnectivity-agent-cw7n2" Jun 13 01:11:07.895994 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895360 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-cnibin\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.895994 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895401 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-host-var-lib-cni-bin\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.895994 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895463 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-cnibin\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.895994 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895496 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-run-systemd\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.895994 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895526 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-host-run-ovn-kubernetes\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.895994 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895552 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-host-cni-netd\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.895994 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895612 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zddgl\" (UniqueName: \"kubernetes.io/projected/4b218b9d-0f16-40fc-9753-0892624afc14-kube-api-access-zddgl\") pod \"network-metrics-daemon-mthf7\" (UID: \"4b218b9d-0f16-40fc-9753-0892624afc14\") " pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:07.895994 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895631 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-host-var-lib-kubelet\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.896809 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895643 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/927341bf-fe3e-40c1-a95c-061b6571c321-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wf2vg\" (UID: \"927341bf-fe3e-40c1-a95c-061b6571c321\") " pod="openshift-multus/multus-additional-cni-plugins-wf2vg" Jun 13 01:11:07.896809 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895675 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-multus-daemon-config\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.896809 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895702 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-node-log\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.896809 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895730 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/97db085b-86c6-4ef9-b6e1-ba915bec57a3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-slfd7\" (UID: \"97db085b-86c6-4ef9-b6e1-ba915bec57a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7" Jun 13 01:11:07.896809 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895757 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/927341bf-fe3e-40c1-a95c-061b6571c321-cnibin\") pod \"multus-additional-cni-plugins-wf2vg\" (UID: \"927341bf-fe3e-40c1-a95c-061b6571c321\") " pod="openshift-multus/multus-additional-cni-plugins-wf2vg" Jun 13 01:11:07.896809 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895832 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-etc-kubernetes\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.896809 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895865 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-host-kubelet\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.896809 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895868 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c3364a81-6e76-4d46-ac19-63a163ecb01a-konnectivity-ca\") pod \"konnectivity-agent-cw7n2\" (UID: \"c3364a81-6e76-4d46-ac19-63a163ecb01a\") " pod="kube-system/konnectivity-agent-cw7n2" Jun 13 01:11:07.896809 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895890 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-etc-sysctl-conf\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.896809 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895912 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-sys\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.896809 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895939 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a2385b8-b719-4fbb-a0ec-75b6dadeee56-tmp-dir\") pod \"node-resolver-t6xgs\" (UID: \"2a2385b8-b719-4fbb-a0ec-75b6dadeee56\") " pod="openshift-dns/node-resolver-t6xgs" Jun 13 01:11:07.896809 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.895979 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd448\" (UniqueName: \"kubernetes.io/projected/2a2385b8-b719-4fbb-a0ec-75b6dadeee56-kube-api-access-xd448\") pod \"node-resolver-t6xgs\" (UID: \"2a2385b8-b719-4fbb-a0ec-75b6dadeee56\") " pod="openshift-dns/node-resolver-t6xgs" Jun 13 01:11:07.896809 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896006 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4d914e0b-d762-4948-80f6-79317ccb0a92-iptables-alerter-script\") pod \"iptables-alerter-vl6c6\" (UID: \"4d914e0b-d762-4948-80f6-79317ccb0a92\") " pod="openshift-network-operator/iptables-alerter-vl6c6" Jun 13 01:11:07.896809 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896037 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-host-run-k8s-cni-cncf-io\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.896809 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896063 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-hostroot\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.896809 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896075 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e98f7500-070e-4c57-a4b0-a711e20b8c26-ovnkube-config\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.896809 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896177 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-host-slash\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.897700 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896205 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-etc-sysctl-d\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.897700 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896228 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/97db085b-86c6-4ef9-b6e1-ba915bec57a3-registration-dir\") pod \"aws-ebs-csi-driver-node-slfd7\" (UID: \"97db085b-86c6-4ef9-b6e1-ba915bec57a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7" Jun 13 01:11:07.897700 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896252 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/927341bf-fe3e-40c1-a95c-061b6571c321-system-cni-dir\") pod \"multus-additional-cni-plugins-wf2vg\" (UID: \"927341bf-fe3e-40c1-a95c-061b6571c321\") " pod="openshift-multus/multus-additional-cni-plugins-wf2vg" Jun 13 01:11:07.897700 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896277 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-multus-cni-dir\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.897700 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896299 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-multus-socket-dir-parent\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.897700 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896321 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-systemd-units\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.897700 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896345 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/97db085b-86c6-4ef9-b6e1-ba915bec57a3-sys-fs\") pod \"aws-ebs-csi-driver-node-slfd7\" (UID: \"97db085b-86c6-4ef9-b6e1-ba915bec57a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7" Jun 13 01:11:07.897700 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896362 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-multus-daemon-config\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.897700 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896369 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b95fc5d7-d3d7-4d28-94d6-ec2ae9ac65b4-serviceca\") pod \"node-ca-29fpw\" (UID: \"b95fc5d7-d3d7-4d28-94d6-ec2ae9ac65b4\") " pod="openshift-image-registry/node-ca-29fpw" Jun 13 01:11:07.897700 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896392 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-system-cni-dir\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.897700 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896408 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/927341bf-fe3e-40c1-a95c-061b6571c321-cnibin\") pod \"multus-additional-cni-plugins-wf2vg\" (UID: \"927341bf-fe3e-40c1-a95c-061b6571c321\") " pod="openshift-multus/multus-additional-cni-plugins-wf2vg" Jun 13 01:11:07.897700 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896415 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-host-run-multus-certs\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.897700 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896439 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-run-openvswitch\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.897700 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896441 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-host-cni-netd\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.897700 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896464 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-log-socket\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.897700 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896474 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-run-systemd\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.897700 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896488 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e98f7500-070e-4c57-a4b0-a711e20b8c26-env-overrides\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.898540 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896504 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-host-run-ovn-kubernetes\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.898540 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896562 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/927341bf-fe3e-40c1-a95c-061b6571c321-system-cni-dir\") pod \"multus-additional-cni-plugins-wf2vg\" (UID: \"927341bf-fe3e-40c1-a95c-061b6571c321\") " pod="openshift-multus/multus-additional-cni-plugins-wf2vg" Jun 13 01:11:07.898540 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896622 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-multus-cni-dir\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.898540 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896667 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-multus-socket-dir-parent\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.898540 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896723 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-systemd-units\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.898540 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896897 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-host-run-multus-certs\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.898540 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896944 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/927341bf-fe3e-40c1-a95c-061b6571c321-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wf2vg\" (UID: \"927341bf-fe3e-40c1-a95c-061b6571c321\") " pod="openshift-multus/multus-additional-cni-plugins-wf2vg" Jun 13 01:11:07.898540 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896973 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-system-cni-dir\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.898540 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.896990 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-lib-modules\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.898540 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.897014 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-host\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.898540 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.897017 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-run-openvswitch\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.898540 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.897039 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-multus-conf-dir\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.898540 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.897061 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-log-socket\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.898540 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.897104 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw6dn\" (UniqueName: \"kubernetes.io/projected/b95fc5d7-d3d7-4d28-94d6-ec2ae9ac65b4-kube-api-access-sw6dn\") pod \"node-ca-29fpw\" (UID: \"b95fc5d7-d3d7-4d28-94d6-ec2ae9ac65b4\") " pod="openshift-image-registry/node-ca-29fpw" Jun 13 01:11:07.898540 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.897155 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/84d32cae-48d5-4aba-af49-e6ad82ff2e47-kubelet-config\") pod \"global-pull-secret-syncer-56c2g\" (UID: \"84d32cae-48d5-4aba-af49-e6ad82ff2e47\") " pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:07.898540 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.897168 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-multus-conf-dir\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.898540 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.897170 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b95fc5d7-d3d7-4d28-94d6-ec2ae9ac65b4-serviceca\") pod \"node-ca-29fpw\" (UID: \"b95fc5d7-d3d7-4d28-94d6-ec2ae9ac65b4\") " pod="openshift-image-registry/node-ca-29fpw" Jun 13 01:11:07.898540 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.897182 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-os-release\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.899398 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.897211 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-etc-sysconfig\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.899398 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.897204 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-host-slash\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.899398 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.897250 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72977bd4-f568-4f1c-b130-51af03613060-tmp\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.899398 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.897461 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a2385b8-b719-4fbb-a0ec-75b6dadeee56-tmp-dir\") pod \"node-resolver-t6xgs\" (UID: \"2a2385b8-b719-4fbb-a0ec-75b6dadeee56\") " pod="openshift-dns/node-resolver-t6xgs" Jun 13 01:11:07.899398 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.897534 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e98f7500-070e-4c57-a4b0-a711e20b8c26-env-overrides\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.899398 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.897539 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/84d32cae-48d5-4aba-af49-e6ad82ff2e47-kubelet-config\") pod \"global-pull-secret-syncer-56c2g\" (UID: \"84d32cae-48d5-4aba-af49-e6ad82ff2e47\") " pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:07.899398 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.897664 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-hostroot\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.899398 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.897692 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-node-log\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.899398 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.897716 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-host-run-k8s-cni-cncf-io\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.899398 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.897729 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e98f7500-070e-4c57-a4b0-a711e20b8c26-host-kubelet\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.899398 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.897773 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-os-release\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.899398 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.897981 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-etc-kubernetes\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.899398 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.898119 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e98f7500-070e-4c57-a4b0-a711e20b8c26-ovn-node-metrics-cert\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.899398 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.898151 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4d914e0b-d762-4948-80f6-79317ccb0a92-iptables-alerter-script\") pod \"iptables-alerter-vl6c6\" (UID: \"4d914e0b-d762-4948-80f6-79317ccb0a92\") " pod="openshift-network-operator/iptables-alerter-vl6c6" Jun 13 01:11:07.899398 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.898175 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c3364a81-6e76-4d46-ac19-63a163ecb01a-agent-certs\") pod \"konnectivity-agent-cw7n2\" (UID: \"c3364a81-6e76-4d46-ac19-63a163ecb01a\") " pod="kube-system/konnectivity-agent-cw7n2" Jun 13 01:11:07.912497 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.912470 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd448\" (UniqueName: \"kubernetes.io/projected/2a2385b8-b719-4fbb-a0ec-75b6dadeee56-kube-api-access-xd448\") pod \"node-resolver-t6xgs\" (UID: \"2a2385b8-b719-4fbb-a0ec-75b6dadeee56\") " pod="openshift-dns/node-resolver-t6xgs" Jun 13 01:11:07.912623 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.912604 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcck6\" (UniqueName: \"kubernetes.io/projected/927341bf-fe3e-40c1-a95c-061b6571c321-kube-api-access-wcck6\") pod \"multus-additional-cni-plugins-wf2vg\" (UID: \"927341bf-fe3e-40c1-a95c-061b6571c321\") " pod="openshift-multus/multus-additional-cni-plugins-wf2vg" Jun 13 01:11:07.915467 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:07.915444 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 01:11:07.915583 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:07.915474 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 01:11:07.915583 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:07.915489 2563 projected.go:196] Error preparing data for projected volume kube-api-access-bww54 for pod openshift-network-diagnostics/network-check-target-qjntx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:07.915583 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:07.915556 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e49a00c-03c7-4083-9e34-e59e0d37cc3d-kube-api-access-bww54 podName:9e49a00c-03c7-4083-9e34-e59e0d37cc3d nodeName:}" failed. No retries permitted until 2026-06-13 01:11:08.415538828 +0000 UTC m=+3.031554600 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bww54" (UniqueName: "kubernetes.io/projected/9e49a00c-03c7-4083-9e34-e59e0d37cc3d-kube-api-access-bww54") pod "network-check-target-qjntx" (UID: "9e49a00c-03c7-4083-9e34-e59e0d37cc3d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:07.917485 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.917460 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4ngw\" (UniqueName: \"kubernetes.io/projected/e98f7500-070e-4c57-a4b0-a711e20b8c26-kube-api-access-t4ngw\") pod \"ovnkube-node-ppvdn\" (UID: \"e98f7500-070e-4c57-a4b0-a711e20b8c26\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:07.917869 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.917843 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfnhx\" (UniqueName: \"kubernetes.io/projected/4d914e0b-d762-4948-80f6-79317ccb0a92-kube-api-access-hfnhx\") pod \"iptables-alerter-vl6c6\" (UID: \"4d914e0b-d762-4948-80f6-79317ccb0a92\") " pod="openshift-network-operator/iptables-alerter-vl6c6" Jun 13 01:11:07.918222 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.918202 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8pvw\" (UniqueName: \"kubernetes.io/projected/8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9-kube-api-access-s8pvw\") pod \"multus-ht6wg\" (UID: \"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9\") " pod="openshift-multus/multus-ht6wg" Jun 13 01:11:07.918624 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.918605 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw6dn\" (UniqueName: \"kubernetes.io/projected/b95fc5d7-d3d7-4d28-94d6-ec2ae9ac65b4-kube-api-access-sw6dn\") pod \"node-ca-29fpw\" (UID: \"b95fc5d7-d3d7-4d28-94d6-ec2ae9ac65b4\") " pod="openshift-image-registry/node-ca-29fpw" Jun 13 01:11:07.927942 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.927920 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 01:11:07.997607 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.997572 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72977bd4-f568-4f1c-b130-51af03613060-etc-tuned\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.997790 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.997616 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs\") pod \"network-metrics-daemon-mthf7\" (UID: \"4b218b9d-0f16-40fc-9753-0892624afc14\") " pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:07.997790 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.997645 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/97db085b-86c6-4ef9-b6e1-ba915bec57a3-socket-dir\") pod \"aws-ebs-csi-driver-node-slfd7\" (UID: \"97db085b-86c6-4ef9-b6e1-ba915bec57a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7" Jun 13 01:11:07.997790 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.997686 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-etc-kubernetes\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.997790 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.997763 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-etc-systemd\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.997993 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.997801 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/97db085b-86c6-4ef9-b6e1-ba915bec57a3-etc-selinux\") pod \"aws-ebs-csi-driver-node-slfd7\" (UID: \"97db085b-86c6-4ef9-b6e1-ba915bec57a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7" Jun 13 01:11:07.997993 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:07.997806 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:07.997993 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.997822 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-etc-kubernetes\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.997993 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.997835 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zddgl\" (UniqueName: \"kubernetes.io/projected/4b218b9d-0f16-40fc-9753-0892624afc14-kube-api-access-zddgl\") pod \"network-metrics-daemon-mthf7\" (UID: \"4b218b9d-0f16-40fc-9753-0892624afc14\") " pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:07.997993 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.997835 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/97db085b-86c6-4ef9-b6e1-ba915bec57a3-socket-dir\") pod \"aws-ebs-csi-driver-node-slfd7\" (UID: \"97db085b-86c6-4ef9-b6e1-ba915bec57a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7" Jun 13 01:11:07.997993 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.997890 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-etc-systemd\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.997993 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.997953 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/97db085b-86c6-4ef9-b6e1-ba915bec57a3-etc-selinux\") pod \"aws-ebs-csi-driver-node-slfd7\" (UID: \"97db085b-86c6-4ef9-b6e1-ba915bec57a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7" Jun 13 01:11:07.998334 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:07.998319 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs podName:4b218b9d-0f16-40fc-9753-0892624afc14 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:08.497850403 +0000 UTC m=+3.113866168 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs") pod "network-metrics-daemon-mthf7" (UID: "4b218b9d-0f16-40fc-9753-0892624afc14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:07.998401 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.998350 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/97db085b-86c6-4ef9-b6e1-ba915bec57a3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-slfd7\" (UID: \"97db085b-86c6-4ef9-b6e1-ba915bec57a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7" Jun 13 01:11:07.998401 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.998383 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-etc-sysctl-conf\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.998511 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.998407 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-sys\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.998511 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.998435 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-etc-sysctl-d\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.998511 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.998458 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/97db085b-86c6-4ef9-b6e1-ba915bec57a3-registration-dir\") pod \"aws-ebs-csi-driver-node-slfd7\" (UID: \"97db085b-86c6-4ef9-b6e1-ba915bec57a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7" Jun 13 01:11:07.998511 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.998469 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/97db085b-86c6-4ef9-b6e1-ba915bec57a3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-slfd7\" (UID: \"97db085b-86c6-4ef9-b6e1-ba915bec57a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7" Jun 13 01:11:07.998511 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.998485 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/97db085b-86c6-4ef9-b6e1-ba915bec57a3-sys-fs\") pod \"aws-ebs-csi-driver-node-slfd7\" (UID: \"97db085b-86c6-4ef9-b6e1-ba915bec57a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7" Jun 13 01:11:07.998511 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.998491 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-sys\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.998812 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.998515 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-lib-modules\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.998812 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.998534 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-host\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.998812 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.998533 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/97db085b-86c6-4ef9-b6e1-ba915bec57a3-registration-dir\") pod \"aws-ebs-csi-driver-node-slfd7\" (UID: \"97db085b-86c6-4ef9-b6e1-ba915bec57a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7" Jun 13 01:11:07.998812 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.998555 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-etc-sysconfig\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.998812 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.998573 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72977bd4-f568-4f1c-b130-51af03613060-tmp\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.998812 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.998601 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-etc-sysctl-d\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.998812 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.998606 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-run\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.998812 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.998620 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-etc-sysctl-conf\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.998812 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.998627 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-lib-modules\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.998812 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.998644 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-var-lib-kubelet\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.998812 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.998673 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjvtd\" (UniqueName: \"kubernetes.io/projected/72977bd4-f568-4f1c-b130-51af03613060-kube-api-access-hjvtd\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.998812 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.998669 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-host\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.998812 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.998648 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-run\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.998812 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.998703 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/97db085b-86c6-4ef9-b6e1-ba915bec57a3-device-dir\") pod \"aws-ebs-csi-driver-node-slfd7\" (UID: \"97db085b-86c6-4ef9-b6e1-ba915bec57a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7" Jun 13 01:11:07.998812 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.998692 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/97db085b-86c6-4ef9-b6e1-ba915bec57a3-sys-fs\") pod \"aws-ebs-csi-driver-node-slfd7\" (UID: \"97db085b-86c6-4ef9-b6e1-ba915bec57a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7" Jun 13 01:11:07.998812 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.998674 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-etc-sysconfig\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.998812 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.998710 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-var-lib-kubelet\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.998812 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.998740 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/97db085b-86c6-4ef9-b6e1-ba915bec57a3-device-dir\") pod \"aws-ebs-csi-driver-node-slfd7\" (UID: \"97db085b-86c6-4ef9-b6e1-ba915bec57a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7" Jun 13 01:11:07.999650 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.998746 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfmdw\" (UniqueName: \"kubernetes.io/projected/97db085b-86c6-4ef9-b6e1-ba915bec57a3-kube-api-access-nfmdw\") pod \"aws-ebs-csi-driver-node-slfd7\" (UID: \"97db085b-86c6-4ef9-b6e1-ba915bec57a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7" Jun 13 01:11:07.999650 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.998911 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-etc-modprobe-d\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:07.999650 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:07.999009 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72977bd4-f568-4f1c-b130-51af03613060-etc-modprobe-d\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:08.000201 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.000179 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72977bd4-f568-4f1c-b130-51af03613060-etc-tuned\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:08.000744 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.000723 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72977bd4-f568-4f1c-b130-51af03613060-tmp\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:08.019210 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.019152 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zddgl\" (UniqueName: \"kubernetes.io/projected/4b218b9d-0f16-40fc-9753-0892624afc14-kube-api-access-zddgl\") pod \"network-metrics-daemon-mthf7\" (UID: \"4b218b9d-0f16-40fc-9753-0892624afc14\") " pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:08.019315 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.019272 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfmdw\" (UniqueName: \"kubernetes.io/projected/97db085b-86c6-4ef9-b6e1-ba915bec57a3-kube-api-access-nfmdw\") pod \"aws-ebs-csi-driver-node-slfd7\" (UID: \"97db085b-86c6-4ef9-b6e1-ba915bec57a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7" Jun 13 01:11:08.019375 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.019358 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjvtd\" (UniqueName: \"kubernetes.io/projected/72977bd4-f568-4f1c-b130-51af03613060-kube-api-access-hjvtd\") pod \"tuned-g299k\" (UID: \"72977bd4-f568-4f1c-b130-51af03613060\") " pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:08.081354 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.081321 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t6xgs" Jun 13 01:11:08.089731 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.089706 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wf2vg" Jun 13 01:11:08.097051 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.097031 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cw7n2" Jun 13 01:11:08.103779 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.103744 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vl6c6" Jun 13 01:11:08.112006 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.111990 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-29fpw" Jun 13 01:11:08.119119 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.119101 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ht6wg" Jun 13 01:11:08.126775 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.126756 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:08.134259 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.134240 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7" Jun 13 01:11:08.141003 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.140982 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g299k" Jun 13 01:11:08.401330 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.401287 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84d32cae-48d5-4aba-af49-e6ad82ff2e47-original-pull-secret\") pod \"global-pull-secret-syncer-56c2g\" (UID: \"84d32cae-48d5-4aba-af49-e6ad82ff2e47\") " pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:08.401513 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:08.401460 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:08.401581 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:08.401543 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84d32cae-48d5-4aba-af49-e6ad82ff2e47-original-pull-secret podName:84d32cae-48d5-4aba-af49-e6ad82ff2e47 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:09.401521699 +0000 UTC m=+4.017537451 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84d32cae-48d5-4aba-af49-e6ad82ff2e47-original-pull-secret") pod "global-pull-secret-syncer-56c2g" (UID: "84d32cae-48d5-4aba-af49-e6ad82ff2e47") : object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:08.501692 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.501644 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs\") pod \"network-metrics-daemon-mthf7\" (UID: \"4b218b9d-0f16-40fc-9753-0892624afc14\") " pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:08.501857 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.501697 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bww54\" (UniqueName: \"kubernetes.io/projected/9e49a00c-03c7-4083-9e34-e59e0d37cc3d-kube-api-access-bww54\") pod \"network-check-target-qjntx\" (UID: \"9e49a00c-03c7-4083-9e34-e59e0d37cc3d\") " pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:11:08.501918 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:08.501882 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 01:11:08.501918 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:08.501904 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 01:11:08.501918 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:08.501918 2563 projected.go:196] Error preparing data for projected volume kube-api-access-bww54 for pod openshift-network-diagnostics/network-check-target-qjntx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:08.502073 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:08.501982 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e49a00c-03c7-4083-9e34-e59e0d37cc3d-kube-api-access-bww54 podName:9e49a00c-03c7-4083-9e34-e59e0d37cc3d nodeName:}" failed. No retries permitted until 2026-06-13 01:11:09.501962604 +0000 UTC m=+4.117978379 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bww54" (UniqueName: "kubernetes.io/projected/9e49a00c-03c7-4083-9e34-e59e0d37cc3d-kube-api-access-bww54") pod "network-check-target-qjntx" (UID: "9e49a00c-03c7-4083-9e34-e59e0d37cc3d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:08.502271 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:08.502246 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:08.502392 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:08.502313 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs podName:4b218b9d-0f16-40fc-9753-0892624afc14 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:09.502295615 +0000 UTC m=+4.118311381 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs") pod "network-metrics-daemon-mthf7" (UID: "4b218b9d-0f16-40fc-9753-0892624afc14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:08.668809 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:08.668783 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a2385b8_b719_4fbb_a0ec_75b6dadeee56.slice/crio-4c092ff8f442ccd627efea27e02db6ba94d28617e4ac661a9a66e70be0753ee3 WatchSource:0}: Error finding container 4c092ff8f442ccd627efea27e02db6ba94d28617e4ac661a9a66e70be0753ee3: Status 404 returned error can't find the container with id 4c092ff8f442ccd627efea27e02db6ba94d28617e4ac661a9a66e70be0753ee3 Jun 13 01:11:08.670403 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:08.670367 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d914e0b_d762_4948_80f6_79317ccb0a92.slice/crio-e1f3a9aa0e5e17ad3474e15e5c9ed88190d9d4f685557bd33dd471beebb62b25 WatchSource:0}: Error finding container e1f3a9aa0e5e17ad3474e15e5c9ed88190d9d4f685557bd33dd471beebb62b25: Status 404 returned error can't find the container with id e1f3a9aa0e5e17ad3474e15e5c9ed88190d9d4f685557bd33dd471beebb62b25 Jun 13 01:11:08.673507 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:08.673481 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod927341bf_fe3e_40c1_a95c_061b6571c321.slice/crio-5ef1cb580f189c559c22ec320893d042fc484d030934e2ad6b21a7df46dad2c6 WatchSource:0}: Error finding container 5ef1cb580f189c559c22ec320893d042fc484d030934e2ad6b21a7df46dad2c6: Status 404 returned error can't find the container with id 5ef1cb580f189c559c22ec320893d042fc484d030934e2ad6b21a7df46dad2c6 Jun 13 01:11:08.674354 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:08.674331 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aa2e977_c7ef_4eb9_ac8c_1da1d3c6c3b9.slice/crio-213038298c68b5b8df832f41dad78dec740003c403ad3ddbbc340a5a8a8e3202 WatchSource:0}: Error finding container 213038298c68b5b8df832f41dad78dec740003c403ad3ddbbc340a5a8a8e3202: Status 404 returned error can't find the container with id 213038298c68b5b8df832f41dad78dec740003c403ad3ddbbc340a5a8a8e3202 Jun 13 01:11:08.675730 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:08.675600 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb95fc5d7_d3d7_4d28_94d6_ec2ae9ac65b4.slice/crio-e2fe5b8d0a37461ef94c1988be0a5f0ed5923325c2d5d5bb6e3c08421439b265 WatchSource:0}: Error finding container e2fe5b8d0a37461ef94c1988be0a5f0ed5923325c2d5d5bb6e3c08421439b265: Status 404 returned error can't find the container with id e2fe5b8d0a37461ef94c1988be0a5f0ed5923325c2d5d5bb6e3c08421439b265 Jun 13 01:11:08.676908 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:08.676440 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode98f7500_070e_4c57_a4b0_a711e20b8c26.slice/crio-3a1040a4c43e77807152b55acc29cfd5cdb089db2ea12282163ed0f53b06eff7 WatchSource:0}: Error finding container 3a1040a4c43e77807152b55acc29cfd5cdb089db2ea12282163ed0f53b06eff7: Status 404 returned error can't find the container with id 3a1040a4c43e77807152b55acc29cfd5cdb089db2ea12282163ed0f53b06eff7 Jun 13 01:11:08.678578 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:08.677477 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97db085b_86c6_4ef9_b6e1_ba915bec57a3.slice/crio-4363e4656fe6bd5ec362981c5d5666ad1c83ff122a630c91e8fe25c7c261f9a2 WatchSource:0}: Error finding container 4363e4656fe6bd5ec362981c5d5666ad1c83ff122a630c91e8fe25c7c261f9a2: Status 404 returned error can't find the container with id 4363e4656fe6bd5ec362981c5d5666ad1c83ff122a630c91e8fe25c7c261f9a2 Jun 13 01:11:08.854522 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.854335 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cw7n2" event={"ID":"c3364a81-6e76-4d46-ac19-63a163ecb01a","Type":"ContainerStarted","Data":"284c0e600082cf9f2dab189bceb0871a8a7625cae2bfecf2336c7280cca361e4"} Jun 13 01:11:08.855597 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.855566 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7" event={"ID":"97db085b-86c6-4ef9-b6e1-ba915bec57a3","Type":"ContainerStarted","Data":"4363e4656fe6bd5ec362981c5d5666ad1c83ff122a630c91e8fe25c7c261f9a2"} Jun 13 01:11:08.856773 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.856748 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" event={"ID":"e98f7500-070e-4c57-a4b0-a711e20b8c26","Type":"ContainerStarted","Data":"3a1040a4c43e77807152b55acc29cfd5cdb089db2ea12282163ed0f53b06eff7"} Jun 13 01:11:08.857821 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.857794 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-29fpw" event={"ID":"b95fc5d7-d3d7-4d28-94d6-ec2ae9ac65b4","Type":"ContainerStarted","Data":"e2fe5b8d0a37461ef94c1988be0a5f0ed5923325c2d5d5bb6e3c08421439b265"} Jun 13 01:11:08.858919 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.858897 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ht6wg" event={"ID":"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9","Type":"ContainerStarted","Data":"213038298c68b5b8df832f41dad78dec740003c403ad3ddbbc340a5a8a8e3202"} Jun 13 01:11:08.859930 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.859910 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vl6c6" event={"ID":"4d914e0b-d762-4948-80f6-79317ccb0a92","Type":"ContainerStarted","Data":"e1f3a9aa0e5e17ad3474e15e5c9ed88190d9d4f685557bd33dd471beebb62b25"} Jun 13 01:11:08.861867 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.861830 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-115.ec2.internal" event={"ID":"7401f1fc17763ddc1d839785e91b064c","Type":"ContainerStarted","Data":"cacb375bcb7ce4e6fb1ea36393195081ffb287c08022fe06202129357ca3d280"} Jun 13 01:11:08.863354 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.863328 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g299k" event={"ID":"72977bd4-f568-4f1c-b130-51af03613060","Type":"ContainerStarted","Data":"00bbb4a287dba743b5937a83514d715edb9c289ecb322aee3db931bc839a1a69"} Jun 13 01:11:08.864391 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.864370 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wf2vg" event={"ID":"927341bf-fe3e-40c1-a95c-061b6571c321","Type":"ContainerStarted","Data":"5ef1cb580f189c559c22ec320893d042fc484d030934e2ad6b21a7df46dad2c6"} Jun 13 01:11:08.865458 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.865432 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t6xgs" event={"ID":"2a2385b8-b719-4fbb-a0ec-75b6dadeee56","Type":"ContainerStarted","Data":"4c092ff8f442ccd627efea27e02db6ba94d28617e4ac661a9a66e70be0753ee3"} Jun 13 01:11:08.876414 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.876372 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-115.ec2.internal" podStartSLOduration=1.876355891 podStartE2EDuration="1.876355891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:11:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:08.875974748 +0000 UTC m=+3.491990524" watchObservedRunningTime="2026-06-13 01:11:08.876355891 +0000 UTC m=+3.492371667" Jun 13 01:11:08.880076 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.880054 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-12 01:06:07 +0000 UTC" deadline="2028-02-22 03:06:21.271859662 +0000 UTC" Jun 13 01:11:08.880076 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:08.880076 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14857h55m12.391786921s" Jun 13 01:11:09.408364 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:09.408319 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84d32cae-48d5-4aba-af49-e6ad82ff2e47-original-pull-secret\") pod \"global-pull-secret-syncer-56c2g\" (UID: \"84d32cae-48d5-4aba-af49-e6ad82ff2e47\") " pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:09.408564 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:09.408520 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:09.408667 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:09.408588 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84d32cae-48d5-4aba-af49-e6ad82ff2e47-original-pull-secret podName:84d32cae-48d5-4aba-af49-e6ad82ff2e47 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:11.408568345 +0000 UTC m=+6.024584104 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84d32cae-48d5-4aba-af49-e6ad82ff2e47-original-pull-secret") pod "global-pull-secret-syncer-56c2g" (UID: "84d32cae-48d5-4aba-af49-e6ad82ff2e47") : object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:09.510488 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:09.509620 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs\") pod \"network-metrics-daemon-mthf7\" (UID: \"4b218b9d-0f16-40fc-9753-0892624afc14\") " pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:09.510488 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:09.509679 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bww54\" (UniqueName: \"kubernetes.io/projected/9e49a00c-03c7-4083-9e34-e59e0d37cc3d-kube-api-access-bww54\") pod \"network-check-target-qjntx\" (UID: \"9e49a00c-03c7-4083-9e34-e59e0d37cc3d\") " pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:11:09.510488 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:09.509849 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 01:11:09.510488 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:09.509874 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 01:11:09.510488 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:09.509889 2563 projected.go:196] Error preparing data for projected volume kube-api-access-bww54 for pod openshift-network-diagnostics/network-check-target-qjntx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:09.510488 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:09.509955 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e49a00c-03c7-4083-9e34-e59e0d37cc3d-kube-api-access-bww54 podName:9e49a00c-03c7-4083-9e34-e59e0d37cc3d nodeName:}" failed. No retries permitted until 2026-06-13 01:11:11.509935781 +0000 UTC m=+6.125951536 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bww54" (UniqueName: "kubernetes.io/projected/9e49a00c-03c7-4083-9e34-e59e0d37cc3d-kube-api-access-bww54") pod "network-check-target-qjntx" (UID: "9e49a00c-03c7-4083-9e34-e59e0d37cc3d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:09.510488 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:09.510396 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:09.510488 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:09.510451 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs podName:4b218b9d-0f16-40fc-9753-0892624afc14 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:11.510434568 +0000 UTC m=+6.126450326 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs") pod "network-metrics-daemon-mthf7" (UID: "4b218b9d-0f16-40fc-9753-0892624afc14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:09.765090 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:09.765053 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 01:11:09.849158 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:09.849105 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:09.849326 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:09.849268 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthf7" podUID="4b218b9d-0f16-40fc-9753-0892624afc14" Jun 13 01:11:09.849697 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:09.849677 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:11:09.849805 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:09.849774 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjntx" podUID="9e49a00c-03c7-4083-9e34-e59e0d37cc3d" Jun 13 01:11:09.849863 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:09.849839 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:09.849931 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:09.849910 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56c2g" podUID="84d32cae-48d5-4aba-af49-e6ad82ff2e47" Jun 13 01:11:09.875547 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:09.875501 2563 generic.go:356] "Generic (PLEG): container finished" podID="b9f82f31f8f0a5ba85ef22128acf9d31" containerID="4b939c17cc7e403480fdfec10663c2696396f1c5a27bc458eadfbbda81873b24" exitCode=0 Jun 13 01:11:09.875984 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:09.875649 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-115.ec2.internal" event={"ID":"b9f82f31f8f0a5ba85ef22128acf9d31","Type":"ContainerDied","Data":"4b939c17cc7e403480fdfec10663c2696396f1c5a27bc458eadfbbda81873b24"} Jun 13 01:11:09.880570 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:09.880525 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-12 01:06:07 +0000 UTC" deadline="2028-02-05 23:20:24.040161048 +0000 UTC" Jun 13 01:11:09.880570 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:09.880571 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14470h9m14.159594145s" Jun 13 01:11:10.898738 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:10.898211 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-115.ec2.internal" event={"ID":"b9f82f31f8f0a5ba85ef22128acf9d31","Type":"ContainerStarted","Data":"1236df38a6942a48c83d9b7f9e4876adba7eb6b38d207403dfad732a27ed9343"} Jun 13 01:11:10.917804 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:10.916894 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-115.ec2.internal" podStartSLOduration=3.916873624 podStartE2EDuration="3.916873624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:11:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:10.916477562 +0000 UTC m=+5.532493338" watchObservedRunningTime="2026-06-13 01:11:10.916873624 +0000 UTC m=+5.532889400" Jun 13 01:11:11.426082 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:11.426040 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84d32cae-48d5-4aba-af49-e6ad82ff2e47-original-pull-secret\") pod \"global-pull-secret-syncer-56c2g\" (UID: \"84d32cae-48d5-4aba-af49-e6ad82ff2e47\") " pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:11.426316 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:11.426295 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:11.426402 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:11.426373 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84d32cae-48d5-4aba-af49-e6ad82ff2e47-original-pull-secret podName:84d32cae-48d5-4aba-af49-e6ad82ff2e47 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:15.426354263 +0000 UTC m=+10.042370020 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84d32cae-48d5-4aba-af49-e6ad82ff2e47-original-pull-secret") pod "global-pull-secret-syncer-56c2g" (UID: "84d32cae-48d5-4aba-af49-e6ad82ff2e47") : object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:11.527428 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:11.527383 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs\") pod \"network-metrics-daemon-mthf7\" (UID: \"4b218b9d-0f16-40fc-9753-0892624afc14\") " pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:11.527612 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:11.527438 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bww54\" (UniqueName: \"kubernetes.io/projected/9e49a00c-03c7-4083-9e34-e59e0d37cc3d-kube-api-access-bww54\") pod \"network-check-target-qjntx\" (UID: \"9e49a00c-03c7-4083-9e34-e59e0d37cc3d\") " pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:11:11.527612 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:11.527586 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 01:11:11.527612 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:11.527608 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 01:11:11.527788 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:11.527622 2563 projected.go:196] Error preparing data for projected volume kube-api-access-bww54 for pod openshift-network-diagnostics/network-check-target-qjntx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:11.527788 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:11.527684 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e49a00c-03c7-4083-9e34-e59e0d37cc3d-kube-api-access-bww54 podName:9e49a00c-03c7-4083-9e34-e59e0d37cc3d nodeName:}" failed. No retries permitted until 2026-06-13 01:11:15.527665031 +0000 UTC m=+10.143680809 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bww54" (UniqueName: "kubernetes.io/projected/9e49a00c-03c7-4083-9e34-e59e0d37cc3d-kube-api-access-bww54") pod "network-check-target-qjntx" (UID: "9e49a00c-03c7-4083-9e34-e59e0d37cc3d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:11.528110 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:11.528089 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:11.528224 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:11.528159 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs podName:4b218b9d-0f16-40fc-9753-0892624afc14 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:15.52814398 +0000 UTC m=+10.144159748 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs") pod "network-metrics-daemon-mthf7" (UID: "4b218b9d-0f16-40fc-9753-0892624afc14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:11.847035 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:11.847000 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:11:11.847247 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:11.847046 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:11.847247 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:11.847000 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:11.847247 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:11.847171 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjntx" podUID="9e49a00c-03c7-4083-9e34-e59e0d37cc3d" Jun 13 01:11:11.847417 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:11.847243 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56c2g" podUID="84d32cae-48d5-4aba-af49-e6ad82ff2e47" Jun 13 01:11:11.847417 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:11.847333 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthf7" podUID="4b218b9d-0f16-40fc-9753-0892624afc14" Jun 13 01:11:13.847363 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:13.847328 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:13.847812 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:13.847470 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthf7" podUID="4b218b9d-0f16-40fc-9753-0892624afc14" Jun 13 01:11:13.847925 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:13.847906 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:11:13.848066 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:13.848006 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjntx" podUID="9e49a00c-03c7-4083-9e34-e59e0d37cc3d" Jun 13 01:11:13.848382 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:13.848239 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:13.848382 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:13.848347 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56c2g" podUID="84d32cae-48d5-4aba-af49-e6ad82ff2e47" Jun 13 01:11:15.461739 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:15.461206 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84d32cae-48d5-4aba-af49-e6ad82ff2e47-original-pull-secret\") pod \"global-pull-secret-syncer-56c2g\" (UID: \"84d32cae-48d5-4aba-af49-e6ad82ff2e47\") " pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:15.461739 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:15.461355 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:15.461739 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:15.461416 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84d32cae-48d5-4aba-af49-e6ad82ff2e47-original-pull-secret podName:84d32cae-48d5-4aba-af49-e6ad82ff2e47 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:23.461399248 +0000 UTC m=+18.077415015 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84d32cae-48d5-4aba-af49-e6ad82ff2e47-original-pull-secret") pod "global-pull-secret-syncer-56c2g" (UID: "84d32cae-48d5-4aba-af49-e6ad82ff2e47") : object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:15.561605 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:15.561566 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bww54\" (UniqueName: \"kubernetes.io/projected/9e49a00c-03c7-4083-9e34-e59e0d37cc3d-kube-api-access-bww54\") pod \"network-check-target-qjntx\" (UID: \"9e49a00c-03c7-4083-9e34-e59e0d37cc3d\") " pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:11:15.561797 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:15.561662 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs\") pod \"network-metrics-daemon-mthf7\" (UID: \"4b218b9d-0f16-40fc-9753-0892624afc14\") " pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:15.561797 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:15.561779 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:15.561901 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:15.561841 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs podName:4b218b9d-0f16-40fc-9753-0892624afc14 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:23.561822069 +0000 UTC m=+18.177837828 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs") pod "network-metrics-daemon-mthf7" (UID: "4b218b9d-0f16-40fc-9753-0892624afc14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:15.562205 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:15.562066 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 01:11:15.562205 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:15.562088 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 01:11:15.562205 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:15.562100 2563 projected.go:196] Error preparing data for projected volume kube-api-access-bww54 for pod openshift-network-diagnostics/network-check-target-qjntx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:15.562205 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:15.562167 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e49a00c-03c7-4083-9e34-e59e0d37cc3d-kube-api-access-bww54 podName:9e49a00c-03c7-4083-9e34-e59e0d37cc3d nodeName:}" failed. No retries permitted until 2026-06-13 01:11:23.562152119 +0000 UTC m=+18.178167889 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bww54" (UniqueName: "kubernetes.io/projected/9e49a00c-03c7-4083-9e34-e59e0d37cc3d-kube-api-access-bww54") pod "network-check-target-qjntx" (UID: "9e49a00c-03c7-4083-9e34-e59e0d37cc3d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:15.847769 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:15.847737 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:11:15.847944 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:15.847858 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjntx" podUID="9e49a00c-03c7-4083-9e34-e59e0d37cc3d" Jun 13 01:11:15.848317 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:15.848194 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:15.848317 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:15.848299 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56c2g" podUID="84d32cae-48d5-4aba-af49-e6ad82ff2e47" Jun 13 01:11:15.848490 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:15.848352 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:15.848490 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:15.848438 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthf7" podUID="4b218b9d-0f16-40fc-9753-0892624afc14" Jun 13 01:11:17.847427 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:17.847394 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:11:17.847872 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:17.847404 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:17.847872 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:17.847561 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjntx" podUID="9e49a00c-03c7-4083-9e34-e59e0d37cc3d" Jun 13 01:11:17.847872 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:17.847598 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:17.848452 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:17.848236 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56c2g" podUID="84d32cae-48d5-4aba-af49-e6ad82ff2e47" Jun 13 01:11:17.848452 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:17.848410 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthf7" podUID="4b218b9d-0f16-40fc-9753-0892624afc14" Jun 13 01:11:19.850040 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:19.850008 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:19.850487 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:19.850024 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:11:19.850487 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:19.850163 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthf7" podUID="4b218b9d-0f16-40fc-9753-0892624afc14" Jun 13 01:11:19.850487 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:19.850024 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:19.850487 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:19.850197 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjntx" podUID="9e49a00c-03c7-4083-9e34-e59e0d37cc3d" Jun 13 01:11:19.850487 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:19.850300 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56c2g" podUID="84d32cae-48d5-4aba-af49-e6ad82ff2e47" Jun 13 01:11:21.846965 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:21.846928 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:11:21.846965 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:21.846964 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:21.847548 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:21.847075 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjntx" podUID="9e49a00c-03c7-4083-9e34-e59e0d37cc3d" Jun 13 01:11:21.847548 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:21.847141 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56c2g" podUID="84d32cae-48d5-4aba-af49-e6ad82ff2e47" Jun 13 01:11:21.847548 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:21.847163 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:21.847548 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:21.847259 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthf7" podUID="4b218b9d-0f16-40fc-9753-0892624afc14" Jun 13 01:11:23.515813 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:23.515722 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84d32cae-48d5-4aba-af49-e6ad82ff2e47-original-pull-secret\") pod \"global-pull-secret-syncer-56c2g\" (UID: \"84d32cae-48d5-4aba-af49-e6ad82ff2e47\") " pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:23.516283 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:23.515881 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:23.516283 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:23.515933 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84d32cae-48d5-4aba-af49-e6ad82ff2e47-original-pull-secret podName:84d32cae-48d5-4aba-af49-e6ad82ff2e47 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:39.515921001 +0000 UTC m=+34.131936754 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84d32cae-48d5-4aba-af49-e6ad82ff2e47-original-pull-secret") pod "global-pull-secret-syncer-56c2g" (UID: "84d32cae-48d5-4aba-af49-e6ad82ff2e47") : object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:23.616978 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:23.616937 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs\") pod \"network-metrics-daemon-mthf7\" (UID: \"4b218b9d-0f16-40fc-9753-0892624afc14\") " pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:23.617208 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:23.617000 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bww54\" (UniqueName: \"kubernetes.io/projected/9e49a00c-03c7-4083-9e34-e59e0d37cc3d-kube-api-access-bww54\") pod \"network-check-target-qjntx\" (UID: \"9e49a00c-03c7-4083-9e34-e59e0d37cc3d\") " pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:11:23.617208 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:23.617100 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:23.617208 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:23.617197 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs podName:4b218b9d-0f16-40fc-9753-0892624afc14 nodeName:}" failed. No retries permitted until 2026-06-13 01:11:39.617175709 +0000 UTC m=+34.233191466 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs") pod "network-metrics-daemon-mthf7" (UID: "4b218b9d-0f16-40fc-9753-0892624afc14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:23.617387 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:23.617222 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 01:11:23.617387 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:23.617244 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 01:11:23.617387 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:23.617258 2563 projected.go:196] Error preparing data for projected volume kube-api-access-bww54 for pod openshift-network-diagnostics/network-check-target-qjntx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:23.617387 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:23.617312 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e49a00c-03c7-4083-9e34-e59e0d37cc3d-kube-api-access-bww54 podName:9e49a00c-03c7-4083-9e34-e59e0d37cc3d nodeName:}" failed. No retries permitted until 2026-06-13 01:11:39.61729659 +0000 UTC m=+34.233312357 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bww54" (UniqueName: "kubernetes.io/projected/9e49a00c-03c7-4083-9e34-e59e0d37cc3d-kube-api-access-bww54") pod "network-check-target-qjntx" (UID: "9e49a00c-03c7-4083-9e34-e59e0d37cc3d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:23.849864 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:23.849831 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:11:23.850031 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:23.849937 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:23.850031 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:23.849963 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:23.850031 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:23.849955 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjntx" podUID="9e49a00c-03c7-4083-9e34-e59e0d37cc3d" Jun 13 01:11:23.850185 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:23.850052 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56c2g" podUID="84d32cae-48d5-4aba-af49-e6ad82ff2e47" Jun 13 01:11:23.850185 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:23.850150 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthf7" podUID="4b218b9d-0f16-40fc-9753-0892624afc14" Jun 13 01:11:25.846948 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:25.846920 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:11:25.847495 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:25.847012 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjntx" podUID="9e49a00c-03c7-4083-9e34-e59e0d37cc3d" Jun 13 01:11:25.847495 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:25.847117 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:25.847495 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:25.847258 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56c2g" podUID="84d32cae-48d5-4aba-af49-e6ad82ff2e47" Jun 13 01:11:25.847495 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:25.847294 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:25.847495 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:25.847420 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthf7" podUID="4b218b9d-0f16-40fc-9753-0892624afc14" Jun 13 01:11:27.846913 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:27.846736 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:27.847637 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:27.846753 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:11:27.847637 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:27.847012 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthf7" podUID="4b218b9d-0f16-40fc-9753-0892624afc14" Jun 13 01:11:27.847637 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:27.846800 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:27.847637 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:27.847079 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjntx" podUID="9e49a00c-03c7-4083-9e34-e59e0d37cc3d" Jun 13 01:11:27.847637 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:27.847215 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56c2g" podUID="84d32cae-48d5-4aba-af49-e6ad82ff2e47" Jun 13 01:11:27.935257 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:27.934919 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g299k" event={"ID":"72977bd4-f568-4f1c-b130-51af03613060","Type":"ContainerStarted","Data":"6afeddff0916ff18974cebc3b7177c344779b6085419c727f03c3171c8e6435d"} Jun 13 01:11:27.936913 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:27.936882 2563 generic.go:356] "Generic (PLEG): container finished" podID="927341bf-fe3e-40c1-a95c-061b6571c321" containerID="23b7e214477de48680cbbff77986ebd1663525ec47465dcd968d6293d81b6145" exitCode=0 Jun 13 01:11:27.937013 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:27.936984 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wf2vg" event={"ID":"927341bf-fe3e-40c1-a95c-061b6571c321","Type":"ContainerDied","Data":"23b7e214477de48680cbbff77986ebd1663525ec47465dcd968d6293d81b6145"} Jun 13 01:11:27.939540 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:27.939503 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t6xgs" event={"ID":"2a2385b8-b719-4fbb-a0ec-75b6dadeee56","Type":"ContainerStarted","Data":"76df45a4c2598f497b8a2be578f82c48792ec45d1e267784be5f05620628dc93"} Jun 13 01:11:27.941110 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:27.941078 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cw7n2" event={"ID":"c3364a81-6e76-4d46-ac19-63a163ecb01a","Type":"ContainerStarted","Data":"4c7ba71f705de97157baf906f50e85b852b1fc4b8ab3438b377327130c7a5132"} Jun 13 01:11:27.942610 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:27.942581 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7" event={"ID":"97db085b-86c6-4ef9-b6e1-ba915bec57a3","Type":"ContainerStarted","Data":"6dde3127f95c4a8e11fad9ea2d2afc3460e236913545f9cafb667d279c9891bc"} Jun 13 01:11:27.944908 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:27.944891 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ppvdn_e98f7500-070e-4c57-a4b0-a711e20b8c26/ovn-acl-logging/0.log" Jun 13 01:11:27.945452 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:27.945431 2563 generic.go:356] "Generic (PLEG): container finished" podID="e98f7500-070e-4c57-a4b0-a711e20b8c26" containerID="0f010de8018f0a375c59cca55433e155c9194610c0670866645d391d11d42948" exitCode=1 Jun 13 01:11:27.945513 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:27.945493 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" event={"ID":"e98f7500-070e-4c57-a4b0-a711e20b8c26","Type":"ContainerStarted","Data":"ef5d606fe70a5ec53346117ac0ec1df9675e616b9f463ced34f3669837b1d5da"} Jun 13 01:11:27.945579 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:27.945564 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" event={"ID":"e98f7500-070e-4c57-a4b0-a711e20b8c26","Type":"ContainerDied","Data":"0f010de8018f0a375c59cca55433e155c9194610c0670866645d391d11d42948"} Jun 13 01:11:27.945646 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:27.945623 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" event={"ID":"e98f7500-070e-4c57-a4b0-a711e20b8c26","Type":"ContainerStarted","Data":"44c0ac02e1d138eca8c5358b6b07ec426eb9f822649f8520f7cbdb94e37693df"} Jun 13 01:11:27.947022 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:27.947002 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-29fpw" event={"ID":"b95fc5d7-d3d7-4d28-94d6-ec2ae9ac65b4","Type":"ContainerStarted","Data":"9250be60050747669b20bf3e371a0a855264a5b72105b5935c3314a5bb1b627f"} Jun 13 01:11:27.948842 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:27.948751 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ht6wg" event={"ID":"8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9","Type":"ContainerStarted","Data":"baf9fb9aa0985997a2d10f445b163f4fce8f42adc4272c86be0493459334d112"} Jun 13 01:11:27.994591 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:27.994541 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-g299k" podStartSLOduration=3.2850419730000002 podStartE2EDuration="21.994526715s" totalImagesPullingTime="18.709484742s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:11:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:27.957810251 +0000 UTC m=+22.573826045" watchObservedRunningTime="2026-06-13 01:11:27.994526715 +0000 UTC m=+22.610542505" Jun 13 01:11:28.040788 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:28.040737 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cw7n2" podStartSLOduration=7.531192998 podStartE2EDuration="22.040716966s" totalImagesPullingTime="14.509523968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:11:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:28.014902467 +0000 UTC m=+22.630918267" watchObservedRunningTime="2026-06-13 01:11:28.040716966 +0000 UTC m=+22.656732742" Jun 13 01:11:28.041060 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:28.041032 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ht6wg" podStartSLOduration=3.280178754 podStartE2EDuration="22.041024739s" totalImagesPullingTime="18.760845985s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:11:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:28.040552193 +0000 UTC m=+22.656567970" watchObservedRunningTime="2026-06-13 01:11:28.041024739 +0000 UTC m=+22.657040513" Jun 13 01:11:28.080573 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:28.080501 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-t6xgs" podStartSLOduration=4.360596055 podStartE2EDuration="23.080483947s" totalImagesPullingTime="18.719887892s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:28.061533462 +0000 UTC m=+22.677549235" watchObservedRunningTime="2026-06-13 01:11:28.080483947 +0000 UTC m=+22.696499721" Jun 13 01:11:28.080698 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:28.080630 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-29fpw" podStartSLOduration=3.382693373 podStartE2EDuration="22.080617982s" totalImagesPullingTime="18.697924609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:11:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:28.08020292 +0000 UTC m=+22.696218698" watchObservedRunningTime="2026-06-13 01:11:28.080617982 +0000 UTC m=+22.696633757" Jun 13 01:11:28.177832 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:28.177793 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:28.255868 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:28.255770 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:28.312368 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:28.312335 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:28.899398 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:28.899371 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 13 01:11:28.955225 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:28.955195 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ppvdn_e98f7500-070e-4c57-a4b0-a711e20b8c26/ovn-acl-logging/0.log" Jun 13 01:11:28.955910 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:28.955877 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" event={"ID":"e98f7500-070e-4c57-a4b0-a711e20b8c26","Type":"ContainerStarted","Data":"8b33c286642bdf61037ea0cd68b72dacc582de4c89be1899899c23e1b300e0df"} Jun 13 01:11:28.956043 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:28.956021 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" event={"ID":"e98f7500-070e-4c57-a4b0-a711e20b8c26","Type":"ContainerStarted","Data":"a7e64898d8a217bc6eb0903caa8611610d4be93159be50046c3e2a208ab6ae93"} Jun 13 01:11:28.956097 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:28.956089 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" event={"ID":"e98f7500-070e-4c57-a4b0-a711e20b8c26","Type":"ContainerStarted","Data":"358737d4d78734949dd78cd7a76f299bafb010157710bbad27ee1aa47e295cee"} Jun 13 01:11:28.958182 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:28.958158 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vl6c6" event={"ID":"4d914e0b-d762-4948-80f6-79317ccb0a92","Type":"ContainerStarted","Data":"69a4a57d984b1d464b0fe2960020d7cc3b70141ba81bdad3a0ad780dd66f1ab5"} Jun 13 01:11:28.960099 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:28.960077 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7" event={"ID":"97db085b-86c6-4ef9-b6e1-ba915bec57a3","Type":"ContainerStarted","Data":"8c16629ddeb44147b09057dff2a083d20047f4af7aec279aa4d84ec512a2106f"} Jun 13 01:11:29.066811 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:29.066780 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:29.417814 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:29.417780 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:29.515943 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:29.515908 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:29.850782 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:29.850755 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:29.850918 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:29.850895 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthf7" podUID="4b218b9d-0f16-40fc-9753-0892624afc14" Jun 13 01:11:29.851306 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:29.851283 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:29.851414 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:29.851283 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:11:29.851414 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:29.851389 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56c2g" podUID="84d32cae-48d5-4aba-af49-e6ad82ff2e47" Jun 13 01:11:29.851498 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:29.851451 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjntx" podUID="9e49a00c-03c7-4083-9e34-e59e0d37cc3d" Jun 13 01:11:29.852599 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:29.852507 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-13T01:11:28.899391888Z","UUID":"90620903-03b8-4b56-aaa2-db3f207f2355","Handler":null,"Name":"","Endpoint":""} Jun 13 01:11:29.854144 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:29.854111 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 13 01:11:29.854230 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:29.854168 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 13 01:11:29.965198 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:29.965158 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7" event={"ID":"97db085b-86c6-4ef9-b6e1-ba915bec57a3","Type":"ContainerStarted","Data":"def771a579abde17dbe80aabe12a2e1bdb76c3968cc80296c7a3a18571cdeab1"} Jun 13 01:11:29.983008 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:29.982960 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-slfd7" podStartSLOduration=3.2395520700000002 podStartE2EDuration="23.982944096s" totalImagesPullingTime="20.743392026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:11:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:29.982480256 +0000 UTC m=+24.598496032" watchObservedRunningTime="2026-06-13 01:11:29.982944096 +0000 UTC m=+24.598959871" Jun 13 01:11:29.983246 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:29.983221 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vl6c6" podStartSLOduration=5.26489588 podStartE2EDuration="23.9832145s" totalImagesPullingTime="18.71831862s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:11:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:28.978205235 +0000 UTC m=+23.594221010" watchObservedRunningTime="2026-06-13 01:11:29.9832145 +0000 UTC m=+24.599230275" Jun 13 01:11:30.223958 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:30.223881 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:30.620177 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:30.619908 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:30.720584 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:30.720556 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:30.971548 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:30.971478 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ppvdn_e98f7500-070e-4c57-a4b0-a711e20b8c26/ovn-acl-logging/0.log" Jun 13 01:11:30.971983 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:30.971921 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" event={"ID":"e98f7500-070e-4c57-a4b0-a711e20b8c26","Type":"ContainerStarted","Data":"c4baecb16ec382e945301e7faac5b9adf312d0852d91d2c810529e881ed49d29"} Jun 13 01:11:31.789222 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:31.789186 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cw7n2" Jun 13 01:11:31.789816 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:31.789793 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cw7n2" Jun 13 01:11:31.847000 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:31.846963 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:11:31.847218 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:31.847024 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:31.847218 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:31.847034 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:31.847338 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:31.847211 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56c2g" podUID="84d32cae-48d5-4aba-af49-e6ad82ff2e47" Jun 13 01:11:31.847395 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:31.847365 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjntx" podUID="9e49a00c-03c7-4083-9e34-e59e0d37cc3d" Jun 13 01:11:31.847562 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:31.847526 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthf7" podUID="4b218b9d-0f16-40fc-9753-0892624afc14" Jun 13 01:11:32.979729 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:32.979478 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ppvdn_e98f7500-070e-4c57-a4b0-a711e20b8c26/ovn-acl-logging/0.log" Jun 13 01:11:32.980450 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:32.980060 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" event={"ID":"e98f7500-070e-4c57-a4b0-a711e20b8c26","Type":"ContainerStarted","Data":"70aec0779ee21a69c503aa407fef173b659e3d893af2cf2505009028eb0c2e61"} Jun 13 01:11:32.980450 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:32.980362 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:32.980555 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:32.980494 2563 scope.go:117] "RemoveContainer" containerID="0f010de8018f0a375c59cca55433e155c9194610c0670866645d391d11d42948" Jun 13 01:11:32.981909 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:32.981888 2563 generic.go:356] "Generic (PLEG): container finished" podID="927341bf-fe3e-40c1-a95c-061b6571c321" containerID="caea7c5147f8079b7e8020bcbd90c5bc04c034cc1e83f776c7febee34b12dd38" exitCode=0 Jun 13 01:11:32.982002 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:32.981918 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wf2vg" event={"ID":"927341bf-fe3e-40c1-a95c-061b6571c321","Type":"ContainerDied","Data":"caea7c5147f8079b7e8020bcbd90c5bc04c034cc1e83f776c7febee34b12dd38"} Jun 13 01:11:32.998326 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:32.998306 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:33.846865 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:33.846831 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:33.847075 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:33.846831 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:11:33.847075 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:33.846977 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56c2g" podUID="84d32cae-48d5-4aba-af49-e6ad82ff2e47" Jun 13 01:11:33.847075 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:33.846831 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:33.847075 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:33.847022 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjntx" podUID="9e49a00c-03c7-4083-9e34-e59e0d37cc3d" Jun 13 01:11:33.847294 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:33.847093 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthf7" podUID="4b218b9d-0f16-40fc-9753-0892624afc14" Jun 13 01:11:33.987622 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:33.987594 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ppvdn_e98f7500-070e-4c57-a4b0-a711e20b8c26/ovn-acl-logging/0.log" Jun 13 01:11:33.988122 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:33.987961 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" event={"ID":"e98f7500-070e-4c57-a4b0-a711e20b8c26","Type":"ContainerStarted","Data":"5094901e74d848932b3dffda3dd21901d0c893481ac3b61db0bf89154eafdc50"} Jun 13 01:11:33.988213 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:33.988156 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:33.988213 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:33.988208 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:34.003311 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:34.003289 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:11:34.017549 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:34.017505 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" podStartSLOduration=9.262974333 podStartE2EDuration="28.017490381s" totalImagesPullingTime="18.754516048s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:11:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:34.017033077 +0000 UTC m=+28.633048852" watchObservedRunningTime="2026-06-13 01:11:34.017490381 +0000 UTC m=+28.633506215" Jun 13 01:11:34.594113 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:34.593865 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mthf7"] Jun 13 01:11:34.594291 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:34.594236 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:34.594378 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:34.594356 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthf7" podUID="4b218b9d-0f16-40fc-9753-0892624afc14" Jun 13 01:11:34.594567 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:34.594548 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-56c2g"] Jun 13 01:11:34.594679 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:34.594659 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:34.594791 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:34.594772 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56c2g" podUID="84d32cae-48d5-4aba-af49-e6ad82ff2e47" Jun 13 01:11:34.596077 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:34.596055 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qjntx"] Jun 13 01:11:34.596197 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:34.596123 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:11:34.596249 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:34.596205 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjntx" podUID="9e49a00c-03c7-4083-9e34-e59e0d37cc3d" Jun 13 01:11:34.991957 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:34.991917 2563 generic.go:356] "Generic (PLEG): container finished" podID="927341bf-fe3e-40c1-a95c-061b6571c321" containerID="12567e5dbf57bdf6b1640c0cd2a7e6588d750af4de8e3bdb5083af2647d0c67b" exitCode=0 Jun 13 01:11:34.992344 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:34.992002 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wf2vg" event={"ID":"927341bf-fe3e-40c1-a95c-061b6571c321","Type":"ContainerDied","Data":"12567e5dbf57bdf6b1640c0cd2a7e6588d750af4de8e3bdb5083af2647d0c67b"} Jun 13 01:11:35.849330 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:35.849305 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:11:35.849330 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:35.849319 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:35.849587 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:35.849402 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjntx" podUID="9e49a00c-03c7-4083-9e34-e59e0d37cc3d" Jun 13 01:11:35.849587 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:35.849467 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthf7" podUID="4b218b9d-0f16-40fc-9753-0892624afc14" Jun 13 01:11:36.072143 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:36.072103 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cw7n2" Jun 13 01:11:36.072492 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:36.072267 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 13 01:11:36.072702 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:36.072682 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cw7n2" Jun 13 01:11:36.137788 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:36.137714 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:36.846604 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:36.846574 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:36.846727 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:36.846687 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56c2g" podUID="84d32cae-48d5-4aba-af49-e6ad82ff2e47" Jun 13 01:11:36.910557 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:36.910514 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:36.998859 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:36.998823 2563 generic.go:356] "Generic (PLEG): container finished" podID="927341bf-fe3e-40c1-a95c-061b6571c321" containerID="8d6be16dd914a0dafdc4694520fdd056a23a086be8b69eb521f34b7ce68b5c4c" exitCode=0 Jun 13 01:11:36.999014 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:36.998900 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wf2vg" event={"ID":"927341bf-fe3e-40c1-a95c-061b6571c321","Type":"ContainerDied","Data":"8d6be16dd914a0dafdc4694520fdd056a23a086be8b69eb521f34b7ce68b5c4c"} Jun 13 01:11:37.849763 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:37.849730 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:37.849763 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:37.849764 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:11:37.850650 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:37.849873 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthf7" podUID="4b218b9d-0f16-40fc-9753-0892624afc14" Jun 13 01:11:37.850650 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:37.849992 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjntx" podUID="9e49a00c-03c7-4083-9e34-e59e0d37cc3d" Jun 13 01:11:38.846921 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:38.846802 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:38.847140 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:38.846934 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-56c2g" podUID="84d32cae-48d5-4aba-af49-e6ad82ff2e47" Jun 13 01:11:39.528431 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:39.528389 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84d32cae-48d5-4aba-af49-e6ad82ff2e47-original-pull-secret\") pod \"global-pull-secret-syncer-56c2g\" (UID: \"84d32cae-48d5-4aba-af49-e6ad82ff2e47\") " pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:39.529015 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:39.528556 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:39.529015 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:39.528623 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84d32cae-48d5-4aba-af49-e6ad82ff2e47-original-pull-secret podName:84d32cae-48d5-4aba-af49-e6ad82ff2e47 nodeName:}" failed. No retries permitted until 2026-06-13 01:12:11.528605752 +0000 UTC m=+66.144621505 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84d32cae-48d5-4aba-af49-e6ad82ff2e47-original-pull-secret") pod "global-pull-secret-syncer-56c2g" (UID: "84d32cae-48d5-4aba-af49-e6ad82ff2e47") : object "kube-system"/"original-pull-secret" not registered Jun 13 01:11:39.629821 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:39.629785 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs\") pod \"network-metrics-daemon-mthf7\" (UID: \"4b218b9d-0f16-40fc-9753-0892624afc14\") " pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:39.629997 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:39.629836 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bww54\" (UniqueName: \"kubernetes.io/projected/9e49a00c-03c7-4083-9e34-e59e0d37cc3d-kube-api-access-bww54\") pod \"network-check-target-qjntx\" (UID: \"9e49a00c-03c7-4083-9e34-e59e0d37cc3d\") " pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:11:39.629997 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:39.629967 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:39.629997 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:39.629978 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 01:11:39.630120 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:39.630001 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 01:11:39.630120 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:39.630014 2563 projected.go:196] Error preparing data for projected volume kube-api-access-bww54 for pod openshift-network-diagnostics/network-check-target-qjntx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:39.630120 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:39.630051 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs podName:4b218b9d-0f16-40fc-9753-0892624afc14 nodeName:}" failed. No retries permitted until 2026-06-13 01:12:11.630028186 +0000 UTC m=+66.246043959 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs") pod "network-metrics-daemon-mthf7" (UID: "4b218b9d-0f16-40fc-9753-0892624afc14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 01:11:39.630120 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:39.630074 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e49a00c-03c7-4083-9e34-e59e0d37cc3d-kube-api-access-bww54 podName:9e49a00c-03c7-4083-9e34-e59e0d37cc3d nodeName:}" failed. No retries permitted until 2026-06-13 01:12:11.63006414 +0000 UTC m=+66.246079896 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bww54" (UniqueName: "kubernetes.io/projected/9e49a00c-03c7-4083-9e34-e59e0d37cc3d-kube-api-access-bww54") pod "network-check-target-qjntx" (UID: "9e49a00c-03c7-4083-9e34-e59e0d37cc3d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 01:11:39.849546 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:39.849514 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:39.849717 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:39.849555 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:11:39.849717 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:39.849656 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthf7" podUID="4b218b9d-0f16-40fc-9753-0892624afc14" Jun 13 01:11:39.849818 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:39.849744 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjntx" podUID="9e49a00c-03c7-4083-9e34-e59e0d37cc3d" Jun 13 01:11:40.333045 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:40.332780 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:40.385602 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:40.385531 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:40.697004 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:40.696934 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-115.ec2.internal" event="NodeReady" Jun 13 01:11:40.697444 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:40.697095 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 13 01:11:40.751240 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:40.751207 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-99zs8"] Jun 13 01:11:40.782755 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:40.782728 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-v57zn"] Jun 13 01:11:40.782920 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:40.782857 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-99zs8" Jun 13 01:11:40.786094 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:40.785793 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 13 01:11:40.786094 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:40.785792 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 13 01:11:40.786319 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:40.786166 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 13 01:11:40.786405 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:40.786394 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qsm9c\"" Jun 13 01:11:40.794956 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:40.794936 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-99zs8"] Jun 13 01:11:40.795090 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:40.794966 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v57zn"] Jun 13 01:11:40.795090 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:40.795066 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v57zn" Jun 13 01:11:40.797506 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:40.797347 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 13 01:11:40.797506 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:40.797380 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hswsv\"" Jun 13 01:11:40.797506 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:40.797406 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 13 01:11:40.846317 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:40.846288 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:11:40.849477 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:40.849454 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 13 01:11:40.897318 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:40.897285 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:40.939084 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:40.939061 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11693fcd-f558-4148-a311-9552a7c78e4f-tmp-dir\") pod \"dns-default-v57zn\" (UID: \"11693fcd-f558-4148-a311-9552a7c78e4f\") " pod="openshift-dns/dns-default-v57zn" Jun 13 01:11:40.939186 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:40.939117 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv5j7\" (UniqueName: \"kubernetes.io/projected/11693fcd-f558-4148-a311-9552a7c78e4f-kube-api-access-bv5j7\") pod \"dns-default-v57zn\" (UID: \"11693fcd-f558-4148-a311-9552a7c78e4f\") " pod="openshift-dns/dns-default-v57zn" Jun 13 01:11:40.939271 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:40.939249 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3047eef-fbf3-467d-b062-31e46ec5b236-cert\") pod \"ingress-canary-99zs8\" (UID: \"a3047eef-fbf3-467d-b062-31e46ec5b236\") " pod="openshift-ingress-canary/ingress-canary-99zs8" Jun 13 01:11:40.939325 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:40.939292 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls\") pod \"dns-default-v57zn\" (UID: \"11693fcd-f558-4148-a311-9552a7c78e4f\") " pod="openshift-dns/dns-default-v57zn" Jun 13 01:11:40.939378 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:40.939351 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11693fcd-f558-4148-a311-9552a7c78e4f-config-volume\") pod \"dns-default-v57zn\" (UID: \"11693fcd-f558-4148-a311-9552a7c78e4f\") " pod="openshift-dns/dns-default-v57zn" Jun 13 01:11:40.939423 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:40.939407 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb5pv\" (UniqueName: \"kubernetes.io/projected/a3047eef-fbf3-467d-b062-31e46ec5b236-kube-api-access-qb5pv\") pod \"ingress-canary-99zs8\" (UID: \"a3047eef-fbf3-467d-b062-31e46ec5b236\") " pod="openshift-ingress-canary/ingress-canary-99zs8" Jun 13 01:11:40.955552 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:40.955465 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:41.011187 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:41.011160 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wf2vg" event={"ID":"927341bf-fe3e-40c1-a95c-061b6571c321","Type":"ContainerStarted","Data":"be0eddcc458dc8282040e2afc234956781dcd753ae25b61a93ae382e14998f48"} Jun 13 01:11:41.040441 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:41.040413 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb5pv\" (UniqueName: \"kubernetes.io/projected/a3047eef-fbf3-467d-b062-31e46ec5b236-kube-api-access-qb5pv\") pod \"ingress-canary-99zs8\" (UID: \"a3047eef-fbf3-467d-b062-31e46ec5b236\") " pod="openshift-ingress-canary/ingress-canary-99zs8" Jun 13 01:11:41.040533 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:41.040466 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11693fcd-f558-4148-a311-9552a7c78e4f-tmp-dir\") pod \"dns-default-v57zn\" (UID: \"11693fcd-f558-4148-a311-9552a7c78e4f\") " pod="openshift-dns/dns-default-v57zn" Jun 13 01:11:41.040619 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:41.040600 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv5j7\" (UniqueName: \"kubernetes.io/projected/11693fcd-f558-4148-a311-9552a7c78e4f-kube-api-access-bv5j7\") pod \"dns-default-v57zn\" (UID: \"11693fcd-f558-4148-a311-9552a7c78e4f\") " pod="openshift-dns/dns-default-v57zn" Jun 13 01:11:41.040678 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:41.040662 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3047eef-fbf3-467d-b062-31e46ec5b236-cert\") pod \"ingress-canary-99zs8\" (UID: \"a3047eef-fbf3-467d-b062-31e46ec5b236\") " pod="openshift-ingress-canary/ingress-canary-99zs8" Jun 13 01:11:41.040729 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:41.040699 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls\") pod \"dns-default-v57zn\" (UID: \"11693fcd-f558-4148-a311-9552a7c78e4f\") " pod="openshift-dns/dns-default-v57zn" Jun 13 01:11:41.040801 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:41.040786 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 01:11:41.040857 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:41.040785 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11693fcd-f558-4148-a311-9552a7c78e4f-tmp-dir\") pod \"dns-default-v57zn\" (UID: \"11693fcd-f558-4148-a311-9552a7c78e4f\") " pod="openshift-dns/dns-default-v57zn" Jun 13 01:11:41.040857 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:41.040848 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls podName:11693fcd-f558-4148-a311-9552a7c78e4f nodeName:}" failed. No retries permitted until 2026-06-13 01:11:41.540825469 +0000 UTC m=+36.156841223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls") pod "dns-default-v57zn" (UID: "11693fcd-f558-4148-a311-9552a7c78e4f") : secret "dns-default-metrics-tls" not found Jun 13 01:11:41.040964 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:41.040866 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11693fcd-f558-4148-a311-9552a7c78e4f-config-volume\") pod \"dns-default-v57zn\" (UID: \"11693fcd-f558-4148-a311-9552a7c78e4f\") " pod="openshift-dns/dns-default-v57zn" Jun 13 01:11:41.041345 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:41.041325 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11693fcd-f558-4148-a311-9552a7c78e4f-config-volume\") pod \"dns-default-v57zn\" (UID: \"11693fcd-f558-4148-a311-9552a7c78e4f\") " pod="openshift-dns/dns-default-v57zn" Jun 13 01:11:41.045077 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:41.045042 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3047eef-fbf3-467d-b062-31e46ec5b236-cert\") pod \"ingress-canary-99zs8\" (UID: \"a3047eef-fbf3-467d-b062-31e46ec5b236\") " pod="openshift-ingress-canary/ingress-canary-99zs8" Jun 13 01:11:41.048581 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:41.048555 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb5pv\" (UniqueName: \"kubernetes.io/projected/a3047eef-fbf3-467d-b062-31e46ec5b236-kube-api-access-qb5pv\") pod \"ingress-canary-99zs8\" (UID: \"a3047eef-fbf3-467d-b062-31e46ec5b236\") " pod="openshift-ingress-canary/ingress-canary-99zs8" Jun 13 01:11:41.048738 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:41.048717 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv5j7\" (UniqueName: \"kubernetes.io/projected/11693fcd-f558-4148-a311-9552a7c78e4f-kube-api-access-bv5j7\") pod \"dns-default-v57zn\" (UID: \"11693fcd-f558-4148-a311-9552a7c78e4f\") " pod="openshift-dns/dns-default-v57zn" Jun 13 01:11:41.095771 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:41.095748 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-99zs8" Jun 13 01:11:41.256577 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:41.256546 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-99zs8"] Jun 13 01:11:41.260256 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:41.260229 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3047eef_fbf3_467d_b062_31e46ec5b236.slice/crio-71151d8d8f86e3c2f0232657f86312d03a5aceca91f0199bd972b4246dcfcacc WatchSource:0}: Error finding container 71151d8d8f86e3c2f0232657f86312d03a5aceca91f0199bd972b4246dcfcacc: Status 404 returned error can't find the container with id 71151d8d8f86e3c2f0232657f86312d03a5aceca91f0199bd972b4246dcfcacc Jun 13 01:11:41.544814 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:41.544784 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls\") pod \"dns-default-v57zn\" (UID: \"11693fcd-f558-4148-a311-9552a7c78e4f\") " pod="openshift-dns/dns-default-v57zn" Jun 13 01:11:41.544989 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:41.544895 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 01:11:41.544989 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:41.544946 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls podName:11693fcd-f558-4148-a311-9552a7c78e4f nodeName:}" failed. No retries permitted until 2026-06-13 01:11:42.54493192 +0000 UTC m=+37.160947672 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls") pod "dns-default-v57zn" (UID: "11693fcd-f558-4148-a311-9552a7c78e4f") : secret "dns-default-metrics-tls" not found Jun 13 01:11:41.850424 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:41.850351 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:11:41.850841 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:41.850526 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:11:41.853523 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:41.853497 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 13 01:11:41.853523 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:41.853506 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-86b5g\"" Jun 13 01:11:41.853723 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:41.853558 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-78kc5\"" Jun 13 01:11:41.853723 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:41.853506 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 13 01:11:41.853723 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:41.853506 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 13 01:11:42.016604 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:42.016574 2563 generic.go:356] "Generic (PLEG): container finished" podID="927341bf-fe3e-40c1-a95c-061b6571c321" containerID="be0eddcc458dc8282040e2afc234956781dcd753ae25b61a93ae382e14998f48" exitCode=0 Jun 13 01:11:42.016796 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:42.016658 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wf2vg" event={"ID":"927341bf-fe3e-40c1-a95c-061b6571c321","Type":"ContainerDied","Data":"be0eddcc458dc8282040e2afc234956781dcd753ae25b61a93ae382e14998f48"} Jun 13 01:11:42.017764 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:42.017742 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-99zs8" event={"ID":"a3047eef-fbf3-467d-b062-31e46ec5b236","Type":"ContainerStarted","Data":"71151d8d8f86e3c2f0232657f86312d03a5aceca91f0199bd972b4246dcfcacc"} Jun 13 01:11:42.044686 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:42.044450 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:42.102875 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:42.102802 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:42.166073 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:42.166042 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:42.552198 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:42.552163 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls\") pod \"dns-default-v57zn\" (UID: \"11693fcd-f558-4148-a311-9552a7c78e4f\") " pod="openshift-dns/dns-default-v57zn" Jun 13 01:11:42.552418 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:42.552326 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 01:11:42.552418 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:42.552400 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls podName:11693fcd-f558-4148-a311-9552a7c78e4f nodeName:}" failed. No retries permitted until 2026-06-13 01:11:44.55237907 +0000 UTC m=+39.168394844 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls") pod "dns-default-v57zn" (UID: "11693fcd-f558-4148-a311-9552a7c78e4f") : secret "dns-default-metrics-tls" not found Jun 13 01:11:43.023376 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:43.023347 2563 generic.go:356] "Generic (PLEG): container finished" podID="927341bf-fe3e-40c1-a95c-061b6571c321" containerID="fdbfd18b3c6a33672d80feb64f396113ca39edb67280268aa423d88dd62ad6be" exitCode=0 Jun 13 01:11:43.024030 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:43.023427 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wf2vg" event={"ID":"927341bf-fe3e-40c1-a95c-061b6571c321","Type":"ContainerDied","Data":"fdbfd18b3c6a33672d80feb64f396113ca39edb67280268aa423d88dd62ad6be"} Jun 13 01:11:43.025114 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:43.024980 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-99zs8" event={"ID":"a3047eef-fbf3-467d-b062-31e46ec5b236","Type":"ContainerStarted","Data":"d71571f16571d22a8dc9542ad70a61e0e9a7638bb73be52551f7559f1e6a3a24"} Jun 13 01:11:43.061688 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:43.061486 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-99zs8" podStartSLOduration=1.522125942 podStartE2EDuration="3.061466653s" totalImagesPullingTime="1.539340711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:11:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:43.060847583 +0000 UTC m=+37.676863419" watchObservedRunningTime="2026-06-13 01:11:43.061466653 +0000 UTC m=+37.677482429" Jun 13 01:11:44.030617 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:44.030575 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wf2vg" event={"ID":"927341bf-fe3e-40c1-a95c-061b6571c321","Type":"ContainerStarted","Data":"b87d606d24899f1b906f52a5d3932b1b6d20477e94020063192fc37dba5d04b5"} Jun 13 01:11:44.056883 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:44.056832 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wf2vg" podStartSLOduration=8.554915612 podStartE2EDuration="38.056815436s" totalImagesPullingTime="29.501899824s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:11:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:11:44.054324599 +0000 UTC m=+38.670340374" watchObservedRunningTime="2026-06-13 01:11:44.056815436 +0000 UTC m=+38.672831211" Jun 13 01:11:44.178510 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:44.178483 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:44.279687 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:44.279654 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:44.567142 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:44.567103 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls\") pod \"dns-default-v57zn\" (UID: \"11693fcd-f558-4148-a311-9552a7c78e4f\") " pod="openshift-dns/dns-default-v57zn" Jun 13 01:11:44.567309 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:44.567244 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 01:11:44.567309 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:44.567301 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls podName:11693fcd-f558-4148-a311-9552a7c78e4f nodeName:}" failed. No retries permitted until 2026-06-13 01:11:48.567285779 +0000 UTC m=+43.183301535 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls") pod "dns-default-v57zn" (UID: "11693fcd-f558-4148-a311-9552a7c78e4f") : secret "dns-default-metrics-tls" not found Jun 13 01:11:45.006702 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:45.006626 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:45.107739 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:45.107701 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:45.453716 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:45.453684 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:45.509190 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:45.509148 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:48.595269 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:48.595219 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls\") pod \"dns-default-v57zn\" (UID: \"11693fcd-f558-4148-a311-9552a7c78e4f\") " pod="openshift-dns/dns-default-v57zn" Jun 13 01:11:48.595657 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:48.595410 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 01:11:48.595657 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:48.595473 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls podName:11693fcd-f558-4148-a311-9552a7c78e4f nodeName:}" failed. No retries permitted until 2026-06-13 01:11:56.595458144 +0000 UTC m=+51.211473900 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls") pod "dns-default-v57zn" (UID: "11693fcd-f558-4148-a311-9552a7c78e4f") : secret "dns-default-metrics-tls" not found Jun 13 01:11:48.850369 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:48.850285 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:48.932056 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:48.932022 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:54.379292 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.379255 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x"] Jun 13 01:11:54.393496 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.393469 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" Jun 13 01:11:54.395589 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.395558 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x"] Jun 13 01:11:54.395850 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.395826 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 13 01:11:54.395934 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.395874 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 13 01:11:54.396423 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.396400 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 13 01:11:54.396536 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.396442 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 13 01:11:54.396536 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.396405 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 13 01:11:54.396536 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.396490 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 13 01:11:54.396536 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.396443 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 13 01:11:54.536565 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.536522 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-974dd\" (UniqueName: \"kubernetes.io/projected/e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c-kube-api-access-974dd\") pod \"cluster-proxy-proxy-agent-bd558879d-h8z8x\" (UID: \"e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" Jun 13 01:11:54.536752 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.536632 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c-ca\") pod \"cluster-proxy-proxy-agent-bd558879d-h8z8x\" (UID: \"e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" Jun 13 01:11:54.536752 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.536658 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-bd558879d-h8z8x\" (UID: \"e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" Jun 13 01:11:54.536752 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.536723 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-bd558879d-h8z8x\" (UID: \"e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" Jun 13 01:11:54.536925 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.536768 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c-hub\") pod \"cluster-proxy-proxy-agent-bd558879d-h8z8x\" (UID: \"e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" Jun 13 01:11:54.536925 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.536802 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-bd558879d-h8z8x\" (UID: \"e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" Jun 13 01:11:54.637522 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.637431 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c-hub\") pod \"cluster-proxy-proxy-agent-bd558879d-h8z8x\" (UID: \"e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" Jun 13 01:11:54.637522 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.637482 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-bd558879d-h8z8x\" (UID: \"e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" Jun 13 01:11:54.637522 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.637521 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-974dd\" (UniqueName: \"kubernetes.io/projected/e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c-kube-api-access-974dd\") pod \"cluster-proxy-proxy-agent-bd558879d-h8z8x\" (UID: \"e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" Jun 13 01:11:54.637779 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.637572 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c-ca\") pod \"cluster-proxy-proxy-agent-bd558879d-h8z8x\" (UID: \"e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" Jun 13 01:11:54.637779 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.637594 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-bd558879d-h8z8x\" (UID: \"e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" Jun 13 01:11:54.637779 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.637629 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-bd558879d-h8z8x\" (UID: \"e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" Jun 13 01:11:54.638351 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.638326 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-bd558879d-h8z8x\" (UID: \"e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" Jun 13 01:11:54.641214 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.641177 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c-ca\") pod \"cluster-proxy-proxy-agent-bd558879d-h8z8x\" (UID: \"e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" Jun 13 01:11:54.641287 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.641205 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-bd558879d-h8z8x\" (UID: \"e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" Jun 13 01:11:54.641287 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.641258 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-bd558879d-h8z8x\" (UID: \"e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" Jun 13 01:11:54.641347 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.641296 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c-hub\") pod \"cluster-proxy-proxy-agent-bd558879d-h8z8x\" (UID: \"e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" Jun 13 01:11:54.648646 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.648626 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-974dd\" (UniqueName: \"kubernetes.io/projected/e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c-kube-api-access-974dd\") pod \"cluster-proxy-proxy-agent-bd558879d-h8z8x\" (UID: \"e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" Jun 13 01:11:54.714804 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.714765 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" Jun 13 01:11:54.852483 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:54.852447 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x"] Jun 13 01:11:54.856310 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:11:54.856273 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7cc8f8f_b92a_44f1_a43a_3a40022bbf8c.slice/crio-94570f0264493c2fc3dddaa1ffd09b382381a2b3013941a235b57af38323742e WatchSource:0}: Error finding container 94570f0264493c2fc3dddaa1ffd09b382381a2b3013941a235b57af38323742e: Status 404 returned error can't find the container with id 94570f0264493c2fc3dddaa1ffd09b382381a2b3013941a235b57af38323742e Jun 13 01:11:55.057461 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:55.057423 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" event={"ID":"e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c","Type":"ContainerStarted","Data":"94570f0264493c2fc3dddaa1ffd09b382381a2b3013941a235b57af38323742e"} Jun 13 01:11:56.653333 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:11:56.653295 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls\") pod \"dns-default-v57zn\" (UID: \"11693fcd-f558-4148-a311-9552a7c78e4f\") " pod="openshift-dns/dns-default-v57zn" Jun 13 01:11:56.653974 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:56.653556 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 01:11:56.653974 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:11:56.653640 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls podName:11693fcd-f558-4148-a311-9552a7c78e4f nodeName:}" failed. No retries permitted until 2026-06-13 01:12:12.653616863 +0000 UTC m=+67.269632633 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls") pod "dns-default-v57zn" (UID: "11693fcd-f558-4148-a311-9552a7c78e4f") : secret "dns-default-metrics-tls" not found Jun 13 01:12:00.070803 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:00.070766 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" event={"ID":"e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c","Type":"ContainerStarted","Data":"9a6d72b8d2b14c061724b52fdd87a5f7fe3965c23ba1e9f4b1eec073f785e5a3"} Jun 13 01:12:00.070803 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:00.070812 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" event={"ID":"e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c","Type":"ContainerStarted","Data":"a5014142719a8ce1f407373af04dd4ae857a82c88f2f4aff3520128319f7c9ec"} Jun 13 01:12:00.071244 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:00.070824 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" event={"ID":"e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c","Type":"ContainerStarted","Data":"b731b7a33c55df4ed75f30ed41bf69ec0419df191fb58ae5ce57641b6da4268c"} Jun 13 01:12:00.091518 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:00.091472 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" podStartSLOduration=1.8527903650000002 podStartE2EDuration="6.091459086s" totalImagesPullingTime="4.238668721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:11:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:12:00.090437032 +0000 UTC m=+54.706452806" watchObservedRunningTime="2026-06-13 01:12:00.091459086 +0000 UTC m=+54.707474860" Jun 13 01:12:05.074537 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:05.074501 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:12:05.151195 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:05.151162 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:12:06.004676 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:06.004651 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ppvdn" Jun 13 01:12:06.151629 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:06.151568 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:12:06.238359 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:06.238328 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:12:11.558534 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:11.558486 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84d32cae-48d5-4aba-af49-e6ad82ff2e47-original-pull-secret\") pod \"global-pull-secret-syncer-56c2g\" (UID: \"84d32cae-48d5-4aba-af49-e6ad82ff2e47\") " pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:12:11.561425 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:11.561402 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 13 01:12:11.571555 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:11.571529 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84d32cae-48d5-4aba-af49-e6ad82ff2e47-original-pull-secret\") pod \"global-pull-secret-syncer-56c2g\" (UID: \"84d32cae-48d5-4aba-af49-e6ad82ff2e47\") " pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:12:11.659601 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:11.659542 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs\") pod \"network-metrics-daemon-mthf7\" (UID: \"4b218b9d-0f16-40fc-9753-0892624afc14\") " pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:12:11.659601 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:11.659606 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bww54\" (UniqueName: \"kubernetes.io/projected/9e49a00c-03c7-4083-9e34-e59e0d37cc3d-kube-api-access-bww54\") pod \"network-check-target-qjntx\" (UID: \"9e49a00c-03c7-4083-9e34-e59e0d37cc3d\") " pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:12:11.662433 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:11.662406 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 13 01:12:11.662515 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:11.662410 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 13 01:12:11.670193 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:12:11.670170 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 13 01:12:11.670276 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:12:11.670262 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs podName:4b218b9d-0f16-40fc-9753-0892624afc14 nodeName:}" failed. No retries permitted until 2026-06-13 01:13:15.670241485 +0000 UTC m=+130.286257253 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs") pod "network-metrics-daemon-mthf7" (UID: "4b218b9d-0f16-40fc-9753-0892624afc14") : secret "metrics-daemon-secret" not found Jun 13 01:12:11.672239 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:11.672220 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 13 01:12:11.683166 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:11.683123 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bww54\" (UniqueName: \"kubernetes.io/projected/9e49a00c-03c7-4083-9e34-e59e0d37cc3d-kube-api-access-bww54\") pod \"network-check-target-qjntx\" (UID: \"9e49a00c-03c7-4083-9e34-e59e0d37cc3d\") " pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:12:11.754830 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:11.754782 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-56c2g" Jun 13 01:12:11.871890 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:11.871864 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-78kc5\"" Jun 13 01:12:11.878768 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:11.878749 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:12:11.893142 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:11.893104 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-56c2g"] Jun 13 01:12:12.002177 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:12.002144 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qjntx"] Jun 13 01:12:12.005444 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:12:12.005419 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e49a00c_03c7_4083_9e34_e59e0d37cc3d.slice/crio-324edf608bc9dcf743c176d17bb303677fdbaa9e748a4c784f261fae834e3e8e WatchSource:0}: Error finding container 324edf608bc9dcf743c176d17bb303677fdbaa9e748a4c784f261fae834e3e8e: Status 404 returned error can't find the container with id 324edf608bc9dcf743c176d17bb303677fdbaa9e748a4c784f261fae834e3e8e Jun 13 01:12:12.102105 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:12.102013 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qjntx" event={"ID":"9e49a00c-03c7-4083-9e34-e59e0d37cc3d","Type":"ContainerStarted","Data":"324edf608bc9dcf743c176d17bb303677fdbaa9e748a4c784f261fae834e3e8e"} Jun 13 01:12:12.103039 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:12.103015 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-56c2g" event={"ID":"84d32cae-48d5-4aba-af49-e6ad82ff2e47","Type":"ContainerStarted","Data":"be582deae3654987601aa0194f3b88fa859232c6069eb224d7855e66643f5177"} Jun 13 01:12:12.668115 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:12.668073 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls\") pod \"dns-default-v57zn\" (UID: \"11693fcd-f558-4148-a311-9552a7c78e4f\") " pod="openshift-dns/dns-default-v57zn" Jun 13 01:12:12.668609 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:12:12.668263 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 01:12:12.668609 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:12:12.668335 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls podName:11693fcd-f558-4148-a311-9552a7c78e4f nodeName:}" failed. No retries permitted until 2026-06-13 01:12:44.668313984 +0000 UTC m=+99.284329760 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls") pod "dns-default-v57zn" (UID: "11693fcd-f558-4148-a311-9552a7c78e4f") : secret "dns-default-metrics-tls" not found Jun 13 01:12:17.118955 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:17.118916 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qjntx" event={"ID":"9e49a00c-03c7-4083-9e34-e59e0d37cc3d","Type":"ContainerStarted","Data":"c75e88b2c3a38dbb9bc0f9f6f8d1c072b8ca7f223a9769d46f7666c0413713a0"} Jun 13 01:12:17.119447 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:17.119005 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:12:17.120304 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:17.120285 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-56c2g" event={"ID":"84d32cae-48d5-4aba-af49-e6ad82ff2e47","Type":"ContainerStarted","Data":"d3df0d964c57f05af8a7a7308cee37b176d11b369a055398d83a59d5e4508c5a"} Jun 13 01:12:17.138082 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:17.138037 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qjntx" podStartSLOduration=66.753511238 podStartE2EDuration="1m11.138024955s" totalImagesPullingTime="4.384513717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:11:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:12:17.13770234 +0000 UTC m=+71.753718134" watchObservedRunningTime="2026-06-13 01:12:17.138024955 +0000 UTC m=+71.754040724" Jun 13 01:12:17.155650 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:17.155608 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-56c2g" podStartSLOduration=66.659491179 podStartE2EDuration="1m11.155591682s" totalImagesPullingTime="4.496100503s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:11:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:12:17.154641939 +0000 UTC m=+71.770657716" watchObservedRunningTime="2026-06-13 01:12:17.155591682 +0000 UTC m=+71.771607457" Jun 13 01:12:44.696475 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:44.696430 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls\") pod \"dns-default-v57zn\" (UID: \"11693fcd-f558-4148-a311-9552a7c78e4f\") " pod="openshift-dns/dns-default-v57zn" Jun 13 01:12:44.696918 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:12:44.696609 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 01:12:44.696918 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:12:44.696680 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls podName:11693fcd-f558-4148-a311-9552a7c78e4f nodeName:}" failed. No retries permitted until 2026-06-13 01:13:48.696662214 +0000 UTC m=+163.312677982 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls") pod "dns-default-v57zn" (UID: "11693fcd-f558-4148-a311-9552a7c78e4f") : secret "dns-default-metrics-tls" not found Jun 13 01:12:48.126233 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:12:48.126199 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qjntx" Jun 13 01:13:15.714444 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:13:15.714386 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs\") pod \"network-metrics-daemon-mthf7\" (UID: \"4b218b9d-0f16-40fc-9753-0892624afc14\") " pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:13:15.714943 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:13:15.714509 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 13 01:13:15.714943 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:13:15.714573 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs podName:4b218b9d-0f16-40fc-9753-0892624afc14 nodeName:}" failed. No retries permitted until 2026-06-13 01:15:17.71455983 +0000 UTC m=+252.330575583 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs") pod "network-metrics-daemon-mthf7" (UID: "4b218b9d-0f16-40fc-9753-0892624afc14") : secret "metrics-daemon-secret" not found Jun 13 01:13:43.806598 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:13:43.806542 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-v57zn" podUID="11693fcd-f558-4148-a311-9552a7c78e4f" Jun 13 01:13:44.861989 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:13:44.861949 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mthf7" podUID="4b218b9d-0f16-40fc-9753-0892624afc14" Jun 13 01:13:48.740603 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:13:48.740552 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls\") pod \"dns-default-v57zn\" (UID: \"11693fcd-f558-4148-a311-9552a7c78e4f\") " pod="openshift-dns/dns-default-v57zn" Jun 13 01:13:48.741113 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:13:48.740702 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 01:13:48.741113 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:13:48.740778 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls podName:11693fcd-f558-4148-a311-9552a7c78e4f nodeName:}" failed. No retries permitted until 2026-06-13 01:15:50.74076219 +0000 UTC m=+285.356777943 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls") pod "dns-default-v57zn" (UID: "11693fcd-f558-4148-a311-9552a7c78e4f") : secret "dns-default-metrics-tls" not found Jun 13 01:13:56.846098 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:13:56.846006 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v57zn" Jun 13 01:13:56.846098 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:13:56.846006 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:14:19.418442 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:19.418408 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-hjcl6"] Jun 13 01:14:19.420399 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:19.420379 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-hjcl6" Jun 13 01:14:19.423718 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:19.423699 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 13 01:14:19.423926 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:19.423902 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 13 01:14:19.424328 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:19.424314 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vwcft\"" Jun 13 01:14:19.439044 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:19.439018 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-hjcl6"] Jun 13 01:14:19.543225 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:19.543186 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/42938e76-2127-4067-9ffb-2a1d1a02c036-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-hjcl6\" (UID: \"42938e76-2127-4067-9ffb-2a1d1a02c036\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-hjcl6" Jun 13 01:14:19.543225 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:19.543226 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/42938e76-2127-4067-9ffb-2a1d1a02c036-nginx-conf\") pod \"networking-console-plugin-867b76cb74-hjcl6\" (UID: \"42938e76-2127-4067-9ffb-2a1d1a02c036\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-hjcl6" Jun 13 01:14:19.632595 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:19.632549 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:19.644208 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:19.644184 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/42938e76-2127-4067-9ffb-2a1d1a02c036-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-hjcl6\" (UID: \"42938e76-2127-4067-9ffb-2a1d1a02c036\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-hjcl6" Jun 13 01:14:19.644343 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:19.644225 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/42938e76-2127-4067-9ffb-2a1d1a02c036-nginx-conf\") pod \"networking-console-plugin-867b76cb74-hjcl6\" (UID: \"42938e76-2127-4067-9ffb-2a1d1a02c036\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-hjcl6" Jun 13 01:14:19.644343 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:19.644333 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 01:14:19.644414 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:19.644398 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42938e76-2127-4067-9ffb-2a1d1a02c036-networking-console-plugin-cert podName:42938e76-2127-4067-9ffb-2a1d1a02c036 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:20.144381617 +0000 UTC m=+194.760397369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/42938e76-2127-4067-9ffb-2a1d1a02c036-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-hjcl6" (UID: "42938e76-2127-4067-9ffb-2a1d1a02c036") : secret "networking-console-plugin-cert" not found Jun 13 01:14:19.644893 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:19.644876 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/42938e76-2127-4067-9ffb-2a1d1a02c036-nginx-conf\") pod \"networking-console-plugin-867b76cb74-hjcl6\" (UID: \"42938e76-2127-4067-9ffb-2a1d1a02c036\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-hjcl6" Jun 13 01:14:19.720470 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:19.720374 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:20.148721 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:20.148685 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/42938e76-2127-4067-9ffb-2a1d1a02c036-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-hjcl6\" (UID: \"42938e76-2127-4067-9ffb-2a1d1a02c036\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-hjcl6" Jun 13 01:14:20.148894 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:20.148829 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 01:14:20.148935 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:20.148904 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42938e76-2127-4067-9ffb-2a1d1a02c036-networking-console-plugin-cert podName:42938e76-2127-4067-9ffb-2a1d1a02c036 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:21.148889005 +0000 UTC m=+195.764904762 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/42938e76-2127-4067-9ffb-2a1d1a02c036-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-hjcl6" (UID: "42938e76-2127-4067-9ffb-2a1d1a02c036") : secret "networking-console-plugin-cert" not found Jun 13 01:14:21.158828 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:21.158776 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/42938e76-2127-4067-9ffb-2a1d1a02c036-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-hjcl6\" (UID: \"42938e76-2127-4067-9ffb-2a1d1a02c036\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-hjcl6" Jun 13 01:14:21.159448 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:21.158936 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 01:14:21.159448 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:21.159023 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42938e76-2127-4067-9ffb-2a1d1a02c036-networking-console-plugin-cert podName:42938e76-2127-4067-9ffb-2a1d1a02c036 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:23.159000078 +0000 UTC m=+197.775015830 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/42938e76-2127-4067-9ffb-2a1d1a02c036-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-hjcl6" (UID: "42938e76-2127-4067-9ffb-2a1d1a02c036") : secret "networking-console-plugin-cert" not found Jun 13 01:14:22.231327 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:22.231285 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:22.995445 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:22.995409 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ghk4p"] Jun 13 01:14:22.997579 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:22.997557 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ghk4p" Jun 13 01:14:22.999745 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:22.999719 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hgh9r\"" Jun 13 01:14:23.000002 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:22.999986 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 13 01:14:23.000419 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:23.000400 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 13 01:14:23.000510 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:23.000478 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 13 01:14:23.000569 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:23.000539 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 13 01:14:23.011501 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:23.011481 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ghk4p"] Jun 13 01:14:23.021157 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:23.021119 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:23.072270 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:23.072239 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57844996-bb33-4c31-893f-057667812fc0-crio-socket\") pod \"insights-runtime-extractor-ghk4p\" (UID: \"57844996-bb33-4c31-893f-057667812fc0\") " pod="openshift-insights/insights-runtime-extractor-ghk4p" Jun 13 01:14:23.072433 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:23.072294 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57844996-bb33-4c31-893f-057667812fc0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ghk4p\" (UID: \"57844996-bb33-4c31-893f-057667812fc0\") " pod="openshift-insights/insights-runtime-extractor-ghk4p" Jun 13 01:14:23.072433 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:23.072350 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57844996-bb33-4c31-893f-057667812fc0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ghk4p\" (UID: \"57844996-bb33-4c31-893f-057667812fc0\") " pod="openshift-insights/insights-runtime-extractor-ghk4p" Jun 13 01:14:23.072433 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:23.072379 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57844996-bb33-4c31-893f-057667812fc0-data-volume\") pod \"insights-runtime-extractor-ghk4p\" (UID: \"57844996-bb33-4c31-893f-057667812fc0\") " pod="openshift-insights/insights-runtime-extractor-ghk4p" Jun 13 01:14:23.072433 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:23.072403 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v695s\" (UniqueName: \"kubernetes.io/projected/57844996-bb33-4c31-893f-057667812fc0-kube-api-access-v695s\") pod \"insights-runtime-extractor-ghk4p\" (UID: \"57844996-bb33-4c31-893f-057667812fc0\") " pod="openshift-insights/insights-runtime-extractor-ghk4p" Jun 13 01:14:23.073188 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:23.073170 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:23.173296 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:23.173259 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57844996-bb33-4c31-893f-057667812fc0-data-volume\") pod \"insights-runtime-extractor-ghk4p\" (UID: \"57844996-bb33-4c31-893f-057667812fc0\") " pod="openshift-insights/insights-runtime-extractor-ghk4p" Jun 13 01:14:23.173296 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:23.173297 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v695s\" (UniqueName: \"kubernetes.io/projected/57844996-bb33-4c31-893f-057667812fc0-kube-api-access-v695s\") pod \"insights-runtime-extractor-ghk4p\" (UID: \"57844996-bb33-4c31-893f-057667812fc0\") " pod="openshift-insights/insights-runtime-extractor-ghk4p" Jun 13 01:14:23.173489 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:23.173333 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57844996-bb33-4c31-893f-057667812fc0-crio-socket\") pod \"insights-runtime-extractor-ghk4p\" (UID: \"57844996-bb33-4c31-893f-057667812fc0\") " pod="openshift-insights/insights-runtime-extractor-ghk4p" Jun 13 01:14:23.173489 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:23.173384 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/42938e76-2127-4067-9ffb-2a1d1a02c036-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-hjcl6\" (UID: \"42938e76-2127-4067-9ffb-2a1d1a02c036\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-hjcl6" Jun 13 01:14:23.173489 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:23.173414 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57844996-bb33-4c31-893f-057667812fc0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ghk4p\" (UID: \"57844996-bb33-4c31-893f-057667812fc0\") " pod="openshift-insights/insights-runtime-extractor-ghk4p" Jun 13 01:14:23.173489 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:23.173475 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57844996-bb33-4c31-893f-057667812fc0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ghk4p\" (UID: \"57844996-bb33-4c31-893f-057667812fc0\") " pod="openshift-insights/insights-runtime-extractor-ghk4p" Jun 13 01:14:23.173489 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:23.173486 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 01:14:23.173721 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:23.173478 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57844996-bb33-4c31-893f-057667812fc0-crio-socket\") pod \"insights-runtime-extractor-ghk4p\" (UID: \"57844996-bb33-4c31-893f-057667812fc0\") " pod="openshift-insights/insights-runtime-extractor-ghk4p" Jun 13 01:14:23.173721 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:23.173574 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57844996-bb33-4c31-893f-057667812fc0-kube-rbac-proxy-cm podName:57844996-bb33-4c31-893f-057667812fc0 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:23.673552489 +0000 UTC m=+198.289568247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/57844996-bb33-4c31-893f-057667812fc0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ghk4p" (UID: "57844996-bb33-4c31-893f-057667812fc0") : configmap "kube-rbac-proxy" not found Jun 13 01:14:23.173721 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:23.173610 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 01:14:23.173721 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:23.173628 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 01:14:23.173721 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:23.173662 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57844996-bb33-4c31-893f-057667812fc0-data-volume\") pod \"insights-runtime-extractor-ghk4p\" (UID: \"57844996-bb33-4c31-893f-057667812fc0\") " pod="openshift-insights/insights-runtime-extractor-ghk4p" Jun 13 01:14:23.173721 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:23.173698 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42938e76-2127-4067-9ffb-2a1d1a02c036-networking-console-plugin-cert podName:42938e76-2127-4067-9ffb-2a1d1a02c036 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:27.173666148 +0000 UTC m=+201.789681905 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/42938e76-2127-4067-9ffb-2a1d1a02c036-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-hjcl6" (UID: "42938e76-2127-4067-9ffb-2a1d1a02c036") : secret "networking-console-plugin-cert" not found Jun 13 01:14:23.173721 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:23.173719 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57844996-bb33-4c31-893f-057667812fc0-insights-runtime-extractor-tls podName:57844996-bb33-4c31-893f-057667812fc0 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:23.673709588 +0000 UTC m=+198.289725348 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57844996-bb33-4c31-893f-057667812fc0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ghk4p" (UID: "57844996-bb33-4c31-893f-057667812fc0") : secret "insights-runtime-extractor-tls" not found Jun 13 01:14:23.188521 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:23.188500 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v695s\" (UniqueName: \"kubernetes.io/projected/57844996-bb33-4c31-893f-057667812fc0-kube-api-access-v695s\") pod \"insights-runtime-extractor-ghk4p\" (UID: \"57844996-bb33-4c31-893f-057667812fc0\") " pod="openshift-insights/insights-runtime-extractor-ghk4p" Jun 13 01:14:23.678115 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:23.678070 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57844996-bb33-4c31-893f-057667812fc0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ghk4p\" (UID: \"57844996-bb33-4c31-893f-057667812fc0\") " pod="openshift-insights/insights-runtime-extractor-ghk4p" Jun 13 01:14:23.678533 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:23.678202 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57844996-bb33-4c31-893f-057667812fc0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ghk4p\" (UID: \"57844996-bb33-4c31-893f-057667812fc0\") " pod="openshift-insights/insights-runtime-extractor-ghk4p" Jun 13 01:14:23.678533 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:23.678247 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 01:14:23.678533 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:23.678296 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 01:14:23.678533 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:23.678315 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57844996-bb33-4c31-893f-057667812fc0-kube-rbac-proxy-cm podName:57844996-bb33-4c31-893f-057667812fc0 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:24.678296124 +0000 UTC m=+199.294311880 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/57844996-bb33-4c31-893f-057667812fc0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ghk4p" (UID: "57844996-bb33-4c31-893f-057667812fc0") : configmap "kube-rbac-proxy" not found Jun 13 01:14:23.678533 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:23.678346 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57844996-bb33-4c31-893f-057667812fc0-insights-runtime-extractor-tls podName:57844996-bb33-4c31-893f-057667812fc0 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:24.678332335 +0000 UTC m=+199.294348089 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57844996-bb33-4c31-893f-057667812fc0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ghk4p" (UID: "57844996-bb33-4c31-893f-057667812fc0") : secret "insights-runtime-extractor-tls" not found Jun 13 01:14:24.300097 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:24.300063 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:24.400052 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:24.400015 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:24.500201 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:24.500170 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:24.559085 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:24.559011 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:24.685918 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:24.685874 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57844996-bb33-4c31-893f-057667812fc0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ghk4p\" (UID: \"57844996-bb33-4c31-893f-057667812fc0\") " pod="openshift-insights/insights-runtime-extractor-ghk4p" Jun 13 01:14:24.686339 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:24.685928 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57844996-bb33-4c31-893f-057667812fc0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ghk4p\" (UID: \"57844996-bb33-4c31-893f-057667812fc0\") " pod="openshift-insights/insights-runtime-extractor-ghk4p" Jun 13 01:14:24.686339 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:24.686004 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 01:14:24.686339 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:24.686029 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 01:14:24.686339 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:24.686087 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57844996-bb33-4c31-893f-057667812fc0-insights-runtime-extractor-tls podName:57844996-bb33-4c31-893f-057667812fc0 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:26.686068077 +0000 UTC m=+201.302083841 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57844996-bb33-4c31-893f-057667812fc0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ghk4p" (UID: "57844996-bb33-4c31-893f-057667812fc0") : secret "insights-runtime-extractor-tls" not found Jun 13 01:14:24.686339 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:24.686105 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57844996-bb33-4c31-893f-057667812fc0-kube-rbac-proxy-cm podName:57844996-bb33-4c31-893f-057667812fc0 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:26.68609898 +0000 UTC m=+201.302114733 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/57844996-bb33-4c31-893f-057667812fc0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ghk4p" (UID: "57844996-bb33-4c31-893f-057667812fc0") : configmap "kube-rbac-proxy" not found Jun 13 01:14:25.165096 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:25.165068 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t6xgs_2a2385b8-b719-4fbb-a0ec-75b6dadeee56/dns-node-resolver/0.log" Jun 13 01:14:25.177843 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:25.177807 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:25.229227 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:25.229192 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:25.764273 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:25.764245 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-29fpw_b95fc5d7-d3d7-4d28-94d6-ec2ae9ac65b4/node-ca/0.log" Jun 13 01:14:26.505407 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:26.505366 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:26.563061 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:26.563032 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-99zs8_a3047eef-fbf3-467d-b062-31e46ec5b236/serve-healthcheck-canary/0.log" Jun 13 01:14:26.701719 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:26.701689 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57844996-bb33-4c31-893f-057667812fc0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ghk4p\" (UID: \"57844996-bb33-4c31-893f-057667812fc0\") " pod="openshift-insights/insights-runtime-extractor-ghk4p" Jun 13 01:14:26.701882 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:26.701867 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 01:14:26.701949 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:26.701910 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 01:14:26.701949 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:26.701863 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57844996-bb33-4c31-893f-057667812fc0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ghk4p\" (UID: \"57844996-bb33-4c31-893f-057667812fc0\") " pod="openshift-insights/insights-runtime-extractor-ghk4p" Jun 13 01:14:26.702040 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:26.701957 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57844996-bb33-4c31-893f-057667812fc0-insights-runtime-extractor-tls podName:57844996-bb33-4c31-893f-057667812fc0 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:30.701935086 +0000 UTC m=+205.317950856 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57844996-bb33-4c31-893f-057667812fc0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ghk4p" (UID: "57844996-bb33-4c31-893f-057667812fc0") : secret "insights-runtime-extractor-tls" not found Jun 13 01:14:26.702040 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:26.701990 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57844996-bb33-4c31-893f-057667812fc0-kube-rbac-proxy-cm podName:57844996-bb33-4c31-893f-057667812fc0 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:30.701976697 +0000 UTC m=+205.317992450 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/57844996-bb33-4c31-893f-057667812fc0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ghk4p" (UID: "57844996-bb33-4c31-893f-057667812fc0") : configmap "kube-rbac-proxy" not found Jun 13 01:14:26.815918 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:26.815891 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:27.206114 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:27.206031 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/42938e76-2127-4067-9ffb-2a1d1a02c036-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-hjcl6\" (UID: \"42938e76-2127-4067-9ffb-2a1d1a02c036\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-hjcl6" Jun 13 01:14:27.206277 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:27.206197 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 01:14:27.206317 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:27.206286 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42938e76-2127-4067-9ffb-2a1d1a02c036-networking-console-plugin-cert podName:42938e76-2127-4067-9ffb-2a1d1a02c036 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:35.206271252 +0000 UTC m=+209.822287005 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/42938e76-2127-4067-9ffb-2a1d1a02c036-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-hjcl6" (UID: "42938e76-2127-4067-9ffb-2a1d1a02c036") : secret "networking-console-plugin-cert" not found Jun 13 01:14:27.806165 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:27.806111 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:28.653411 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:28.653377 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:28.819817 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:28.819767 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:28.968455 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:28.968352 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:29.069887 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:29.069831 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:29.169395 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:29.169327 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:29.273467 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:29.273376 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:29.372783 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:29.372753 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:29.945141 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:29.945100 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:30.731361 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:30.731325 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57844996-bb33-4c31-893f-057667812fc0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ghk4p\" (UID: \"57844996-bb33-4c31-893f-057667812fc0\") " pod="openshift-insights/insights-runtime-extractor-ghk4p" Jun 13 01:14:30.731361 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:30.731367 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57844996-bb33-4c31-893f-057667812fc0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ghk4p\" (UID: \"57844996-bb33-4c31-893f-057667812fc0\") " pod="openshift-insights/insights-runtime-extractor-ghk4p" Jun 13 01:14:30.731583 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:30.731443 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 01:14:30.731583 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:30.731494 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 01:14:30.731583 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:30.731514 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57844996-bb33-4c31-893f-057667812fc0-kube-rbac-proxy-cm podName:57844996-bb33-4c31-893f-057667812fc0 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:38.731499113 +0000 UTC m=+213.347514867 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/57844996-bb33-4c31-893f-057667812fc0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ghk4p" (UID: "57844996-bb33-4c31-893f-057667812fc0") : configmap "kube-rbac-proxy" not found Jun 13 01:14:30.731583 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:30.731531 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57844996-bb33-4c31-893f-057667812fc0-insights-runtime-extractor-tls podName:57844996-bb33-4c31-893f-057667812fc0 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:38.731520742 +0000 UTC m=+213.347536495 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57844996-bb33-4c31-893f-057667812fc0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ghk4p" (UID: "57844996-bb33-4c31-893f-057667812fc0") : secret "insights-runtime-extractor-tls" not found Jun 13 01:14:30.735848 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:30.735799 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:30.950763 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:30.950733 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:31.343331 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:31.343300 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:31.435723 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:31.435689 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:31.547623 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:31.547590 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:31.951317 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:31.951282 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:32.543807 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:32.543778 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:32.854423 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:32.854304 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:32.953838 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:32.953810 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:33.140381 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:33.140298 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:33.739435 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:33.739396 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:33.937911 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:33.937874 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:34.537863 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:34.537831 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:34.992028 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:34.991945 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:35.136095 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:35.136047 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:35.267267 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:35.267173 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/42938e76-2127-4067-9ffb-2a1d1a02c036-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-hjcl6\" (UID: \"42938e76-2127-4067-9ffb-2a1d1a02c036\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-hjcl6" Jun 13 01:14:35.267418 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:35.267322 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 01:14:35.267418 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:35.267389 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42938e76-2127-4067-9ffb-2a1d1a02c036-networking-console-plugin-cert podName:42938e76-2127-4067-9ffb-2a1d1a02c036 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:51.267373287 +0000 UTC m=+225.883389039 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/42938e76-2127-4067-9ffb-2a1d1a02c036-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-hjcl6" (UID: "42938e76-2127-4067-9ffb-2a1d1a02c036") : secret "networking-console-plugin-cert" not found Jun 13 01:14:35.337238 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:35.337200 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:35.537430 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:35.537399 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:35.939663 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:35.939573 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:36.065900 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:36.065866 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:36.536356 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:36.536324 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:36.952523 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:36.952439 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:37.150492 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:37.150459 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:37.741991 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:37.741959 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:37.944379 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:37.944344 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:38.338019 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:38.337985 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:38.794513 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:38.794486 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57844996-bb33-4c31-893f-057667812fc0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ghk4p\" (UID: \"57844996-bb33-4c31-893f-057667812fc0\") " pod="openshift-insights/insights-runtime-extractor-ghk4p" Jun 13 01:14:38.794684 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:38.794579 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57844996-bb33-4c31-893f-057667812fc0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ghk4p\" (UID: \"57844996-bb33-4c31-893f-057667812fc0\") " pod="openshift-insights/insights-runtime-extractor-ghk4p" Jun 13 01:14:38.795069 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:38.795042 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57844996-bb33-4c31-893f-057667812fc0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ghk4p\" (UID: \"57844996-bb33-4c31-893f-057667812fc0\") " pod="openshift-insights/insights-runtime-extractor-ghk4p" Jun 13 01:14:38.796771 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:38.796751 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57844996-bb33-4c31-893f-057667812fc0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ghk4p\" (UID: \"57844996-bb33-4c31-893f-057667812fc0\") " pod="openshift-insights/insights-runtime-extractor-ghk4p" Jun 13 01:14:38.839893 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:38.839862 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:38.906431 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:38.906401 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ghk4p" Jun 13 01:14:38.948421 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:38.948392 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:39.027023 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:39.026986 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ghk4p"] Jun 13 01:14:39.032340 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:14:39.032317 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57844996_bb33_4c31_893f_057667812fc0.slice/crio-7c82e4dba2ac16a6441c3190fc61c7fe6b9dd8a363bc3ece33e18df143ece315 WatchSource:0}: Error finding container 7c82e4dba2ac16a6441c3190fc61c7fe6b9dd8a363bc3ece33e18df143ece315: Status 404 returned error can't find the container with id 7c82e4dba2ac16a6441c3190fc61c7fe6b9dd8a363bc3ece33e18df143ece315 Jun 13 01:14:39.141582 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:39.141501 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:39.345932 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:39.345899 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:39.513306 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:39.513194 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ghk4p" event={"ID":"57844996-bb33-4c31-893f-057667812fc0","Type":"ContainerStarted","Data":"7c82e4dba2ac16a6441c3190fc61c7fe6b9dd8a363bc3ece33e18df143ece315"} Jun 13 01:14:39.551975 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:39.551937 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:39.605411 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:39.605283 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:42.523551 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:42.523518 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ghk4p" event={"ID":"57844996-bb33-4c31-893f-057667812fc0","Type":"ContainerStarted","Data":"fe04499dcdd568d23a897820b4e350978c0646df51d6ecf602888010acc5d0dc"} Jun 13 01:14:43.102196 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:43.102165 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:43.201818 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:43.201740 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:43.260965 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:43.260923 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:43.529260 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:43.529169 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ghk4p" event={"ID":"57844996-bb33-4c31-893f-057667812fc0","Type":"ContainerStarted","Data":"f43528b68396caa616ffd9687089d90d2ff406c337919117ccab93e371b52b24"} Jun 13 01:14:43.604647 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:43.604612 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:43.785724 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:43.785673 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:43.833107 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:43.833071 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:43.987106 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:43.987071 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:44.181499 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:44.181454 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:44.383832 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:44.383795 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:44.536019 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:44.535989 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ghk4p" event={"ID":"57844996-bb33-4c31-893f-057667812fc0","Type":"ContainerStarted","Data":"357322dbbad92fed8abf4fe86b6662a48cda7bed8c958277d06f0608866a86e6"} Jun 13 01:14:44.558113 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:44.558067 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ghk4p" podStartSLOduration=17.214424074 podStartE2EDuration="22.558050956s" totalImagesPullingTime="5.343626882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:14:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:14:44.557038601 +0000 UTC m=+219.173054375" watchObservedRunningTime="2026-06-13 01:14:44.558050956 +0000 UTC m=+219.174066757" Jun 13 01:14:44.599800 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:44.599768 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:44.716656 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:44.716615 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" podUID="e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 13 01:14:44.743040 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:44.742969 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:44.843902 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:44.843864 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:45.807972 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:45.807940 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:45.908381 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:45.908344 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:47.468333 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.468296 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-dc84f6c56-n5sz9"] Jun 13 01:14:47.470638 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.470614 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:14:47.472996 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.472972 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 13 01:14:47.473178 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.473065 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 13 01:14:47.473621 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.473601 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mqb2w\"" Jun 13 01:14:47.473906 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.473892 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 13 01:14:47.477765 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.477747 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 13 01:14:47.484812 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.484790 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-dc84f6c56-n5sz9"] Jun 13 01:14:47.567453 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.567421 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0919664c-ade5-406f-90e1-284794a42370-installation-pull-secrets\") pod \"image-registry-dc84f6c56-n5sz9\" (UID: \"0919664c-ade5-406f-90e1-284794a42370\") " pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:14:47.567453 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.567455 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0919664c-ade5-406f-90e1-284794a42370-ca-trust-extracted\") pod \"image-registry-dc84f6c56-n5sz9\" (UID: \"0919664c-ade5-406f-90e1-284794a42370\") " pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:14:47.567769 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.567530 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0919664c-ade5-406f-90e1-284794a42370-registry-tls\") pod \"image-registry-dc84f6c56-n5sz9\" (UID: \"0919664c-ade5-406f-90e1-284794a42370\") " pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:14:47.567769 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.567564 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0919664c-ade5-406f-90e1-284794a42370-registry-certificates\") pod \"image-registry-dc84f6c56-n5sz9\" (UID: \"0919664c-ade5-406f-90e1-284794a42370\") " pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:14:47.567769 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.567580 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0919664c-ade5-406f-90e1-284794a42370-trusted-ca\") pod \"image-registry-dc84f6c56-n5sz9\" (UID: \"0919664c-ade5-406f-90e1-284794a42370\") " pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:14:47.567769 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.567598 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfwts\" (UniqueName: \"kubernetes.io/projected/0919664c-ade5-406f-90e1-284794a42370-kube-api-access-wfwts\") pod \"image-registry-dc84f6c56-n5sz9\" (UID: \"0919664c-ade5-406f-90e1-284794a42370\") " pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:14:47.567769 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.567625 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0919664c-ade5-406f-90e1-284794a42370-image-registry-private-configuration\") pod \"image-registry-dc84f6c56-n5sz9\" (UID: \"0919664c-ade5-406f-90e1-284794a42370\") " pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:14:47.567769 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.567734 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0919664c-ade5-406f-90e1-284794a42370-bound-sa-token\") pod \"image-registry-dc84f6c56-n5sz9\" (UID: \"0919664c-ade5-406f-90e1-284794a42370\") " pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:14:47.604289 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.604251 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:47.668273 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.668237 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0919664c-ade5-406f-90e1-284794a42370-registry-tls\") pod \"image-registry-dc84f6c56-n5sz9\" (UID: \"0919664c-ade5-406f-90e1-284794a42370\") " pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:14:47.668463 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.668286 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0919664c-ade5-406f-90e1-284794a42370-registry-certificates\") pod \"image-registry-dc84f6c56-n5sz9\" (UID: \"0919664c-ade5-406f-90e1-284794a42370\") " pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:14:47.668463 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.668316 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0919664c-ade5-406f-90e1-284794a42370-trusted-ca\") pod \"image-registry-dc84f6c56-n5sz9\" (UID: \"0919664c-ade5-406f-90e1-284794a42370\") " pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:14:47.668463 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.668344 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfwts\" (UniqueName: \"kubernetes.io/projected/0919664c-ade5-406f-90e1-284794a42370-kube-api-access-wfwts\") pod \"image-registry-dc84f6c56-n5sz9\" (UID: \"0919664c-ade5-406f-90e1-284794a42370\") " pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:14:47.668463 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.668373 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0919664c-ade5-406f-90e1-284794a42370-image-registry-private-configuration\") pod \"image-registry-dc84f6c56-n5sz9\" (UID: \"0919664c-ade5-406f-90e1-284794a42370\") " pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:14:47.668463 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.668416 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0919664c-ade5-406f-90e1-284794a42370-bound-sa-token\") pod \"image-registry-dc84f6c56-n5sz9\" (UID: \"0919664c-ade5-406f-90e1-284794a42370\") " pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:14:47.668715 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.668491 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0919664c-ade5-406f-90e1-284794a42370-installation-pull-secrets\") pod \"image-registry-dc84f6c56-n5sz9\" (UID: \"0919664c-ade5-406f-90e1-284794a42370\") " pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:14:47.668715 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.668526 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0919664c-ade5-406f-90e1-284794a42370-ca-trust-extracted\") pod \"image-registry-dc84f6c56-n5sz9\" (UID: \"0919664c-ade5-406f-90e1-284794a42370\") " pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:14:47.668967 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.668934 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0919664c-ade5-406f-90e1-284794a42370-ca-trust-extracted\") pod \"image-registry-dc84f6c56-n5sz9\" (UID: \"0919664c-ade5-406f-90e1-284794a42370\") " pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:14:47.669358 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.669324 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0919664c-ade5-406f-90e1-284794a42370-registry-certificates\") pod \"image-registry-dc84f6c56-n5sz9\" (UID: \"0919664c-ade5-406f-90e1-284794a42370\") " pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:14:47.669506 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.669416 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0919664c-ade5-406f-90e1-284794a42370-trusted-ca\") pod \"image-registry-dc84f6c56-n5sz9\" (UID: \"0919664c-ade5-406f-90e1-284794a42370\") " pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:14:47.670857 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.670836 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0919664c-ade5-406f-90e1-284794a42370-registry-tls\") pod \"image-registry-dc84f6c56-n5sz9\" (UID: \"0919664c-ade5-406f-90e1-284794a42370\") " pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:14:47.670959 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.670879 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0919664c-ade5-406f-90e1-284794a42370-image-registry-private-configuration\") pod \"image-registry-dc84f6c56-n5sz9\" (UID: \"0919664c-ade5-406f-90e1-284794a42370\") " pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:14:47.670959 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.670902 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0919664c-ade5-406f-90e1-284794a42370-installation-pull-secrets\") pod \"image-registry-dc84f6c56-n5sz9\" (UID: \"0919664c-ade5-406f-90e1-284794a42370\") " pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:14:47.676896 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.676872 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfwts\" (UniqueName: \"kubernetes.io/projected/0919664c-ade5-406f-90e1-284794a42370-kube-api-access-wfwts\") pod \"image-registry-dc84f6c56-n5sz9\" (UID: \"0919664c-ade5-406f-90e1-284794a42370\") " pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:14:47.677337 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.677316 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0919664c-ade5-406f-90e1-284794a42370-bound-sa-token\") pod \"image-registry-dc84f6c56-n5sz9\" (UID: \"0919664c-ade5-406f-90e1-284794a42370\") " pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:14:47.706168 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.706122 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:47.780095 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.780020 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:14:47.902974 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:47.902937 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-dc84f6c56-n5sz9"] Jun 13 01:14:47.905882 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:14:47.905861 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0919664c_ade5_406f_90e1_284794a42370.slice/crio-7b9beb38ce067b867e3298169fbc4ae88fdf1be4da2bcdd8b37795d8ecdca483 WatchSource:0}: Error finding container 7b9beb38ce067b867e3298169fbc4ae88fdf1be4da2bcdd8b37795d8ecdca483: Status 404 returned error can't find the container with id 7b9beb38ce067b867e3298169fbc4ae88fdf1be4da2bcdd8b37795d8ecdca483 Jun 13 01:14:48.549880 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:48.549842 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" event={"ID":"0919664c-ade5-406f-90e1-284794a42370","Type":"ContainerStarted","Data":"2f77ca2d7f438bd9b3eed9521b45c14252403749d57cdd2bd65dae0a2ead8c8d"} Jun 13 01:14:48.550306 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:48.549890 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" event={"ID":"0919664c-ade5-406f-90e1-284794a42370","Type":"ContainerStarted","Data":"7b9beb38ce067b867e3298169fbc4ae88fdf1be4da2bcdd8b37795d8ecdca483"} Jun 13 01:14:48.550306 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:48.549990 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:14:48.568075 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:48.568029 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" podStartSLOduration=1.5680138609999998 podStartE2EDuration="1.568013861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:14:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:14:48.567241864 +0000 UTC m=+223.183257640" watchObservedRunningTime="2026-06-13 01:14:48.568013861 +0000 UTC m=+223.184029638" Jun 13 01:14:51.297106 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:51.297071 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/42938e76-2127-4067-9ffb-2a1d1a02c036-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-hjcl6\" (UID: \"42938e76-2127-4067-9ffb-2a1d1a02c036\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-hjcl6" Jun 13 01:14:51.299498 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:51.299475 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/42938e76-2127-4067-9ffb-2a1d1a02c036-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-hjcl6\" (UID: \"42938e76-2127-4067-9ffb-2a1d1a02c036\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-hjcl6" Jun 13 01:14:51.529417 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:51.529382 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-hjcl6" Jun 13 01:14:51.660112 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:51.660083 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-hjcl6"] Jun 13 01:14:51.663077 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:14:51.663048 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42938e76_2127_4067_9ffb_2a1d1a02c036.slice/crio-7772921fba44b44c23f6738ecbaba576ea6227e8af0b5ad3c63c48625100451b WatchSource:0}: Error finding container 7772921fba44b44c23f6738ecbaba576ea6227e8af0b5ad3c63c48625100451b: Status 404 returned error can't find the container with id 7772921fba44b44c23f6738ecbaba576ea6227e8af0b5ad3c63c48625100451b Jun 13 01:14:51.714209 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:51.714170 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:51.763555 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:51.763505 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:52.567561 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:52.567524 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-hjcl6" event={"ID":"42938e76-2127-4067-9ffb-2a1d1a02c036","Type":"ContainerStarted","Data":"7772921fba44b44c23f6738ecbaba576ea6227e8af0b5ad3c63c48625100451b"} Jun 13 01:14:53.572224 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:53.572183 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-hjcl6" event={"ID":"42938e76-2127-4067-9ffb-2a1d1a02c036","Type":"ContainerStarted","Data":"a3cc6a77440270daf39c841f1f4816b76b6de0fabd6b727bf395b897bd548b2d"} Jun 13 01:14:53.587836 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:53.587789 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-hjcl6" podStartSLOduration=32.991355463 podStartE2EDuration="34.587768847s" totalImagesPullingTime="1.596413384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:14:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:14:53.587475232 +0000 UTC m=+228.203491007" watchObservedRunningTime="2026-06-13 01:14:53.587768847 +0000 UTC m=+228.203784619" Jun 13 01:14:53.682642 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:53.682610 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:53.740122 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:53.740089 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:54.081641 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:54.081609 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:54.181557 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:54.181521 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:54.266761 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:54.266727 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:54.716736 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:54.716679 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" podUID="e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 13 01:14:54.730563 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:54.730535 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:57.291272 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:57.291238 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:57.325268 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:57.325230 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-mfx5w"] Jun 13 01:14:57.328385 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:57.328369 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-mfx5w" Jun 13 01:14:57.330699 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:57.330679 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 13 01:14:57.331388 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:57.331373 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-qh9vt\"" Jun 13 01:14:57.331388 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:57.331381 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 13 01:14:57.331532 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:57.331390 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 13 01:14:57.331532 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:57.331469 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 13 01:14:57.331657 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:57.331643 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 13 01:14:57.338197 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:57.338177 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-mfx5w"] Jun 13 01:14:57.352901 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:57.352874 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:57.442691 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:57.442653 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43df1aa5-92e1-4c71-a4f5-4068158995e7-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-mfx5w\" (UID: \"43df1aa5-92e1-4c71-a4f5-4068158995e7\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-mfx5w" Jun 13 01:14:57.442844 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:57.442716 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43df1aa5-92e1-4c71-a4f5-4068158995e7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-mfx5w\" (UID: \"43df1aa5-92e1-4c71-a4f5-4068158995e7\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-mfx5w" Jun 13 01:14:57.442844 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:57.442778 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcz6b\" (UniqueName: \"kubernetes.io/projected/43df1aa5-92e1-4c71-a4f5-4068158995e7-kube-api-access-xcz6b\") pod \"prometheus-operator-864fcfc6f9-mfx5w\" (UID: \"43df1aa5-92e1-4c71-a4f5-4068158995e7\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-mfx5w" Jun 13 01:14:57.442940 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:57.442866 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/43df1aa5-92e1-4c71-a4f5-4068158995e7-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-mfx5w\" (UID: \"43df1aa5-92e1-4c71-a4f5-4068158995e7\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-mfx5w" Jun 13 01:14:57.543728 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:57.543633 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43df1aa5-92e1-4c71-a4f5-4068158995e7-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-mfx5w\" (UID: \"43df1aa5-92e1-4c71-a4f5-4068158995e7\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-mfx5w" Jun 13 01:14:57.543728 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:57.543695 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43df1aa5-92e1-4c71-a4f5-4068158995e7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-mfx5w\" (UID: \"43df1aa5-92e1-4c71-a4f5-4068158995e7\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-mfx5w" Jun 13 01:14:57.543728 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:57.543723 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcz6b\" (UniqueName: \"kubernetes.io/projected/43df1aa5-92e1-4c71-a4f5-4068158995e7-kube-api-access-xcz6b\") pod \"prometheus-operator-864fcfc6f9-mfx5w\" (UID: \"43df1aa5-92e1-4c71-a4f5-4068158995e7\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-mfx5w" Jun 13 01:14:57.543938 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:57.543747 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/43df1aa5-92e1-4c71-a4f5-4068158995e7-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-mfx5w\" (UID: \"43df1aa5-92e1-4c71-a4f5-4068158995e7\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-mfx5w" Jun 13 01:14:57.543938 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:57.543867 2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 13 01:14:57.543938 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:14:57.543928 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43df1aa5-92e1-4c71-a4f5-4068158995e7-prometheus-operator-tls podName:43df1aa5-92e1-4c71-a4f5-4068158995e7 nodeName:}" failed. No retries permitted until 2026-06-13 01:14:58.04391059 +0000 UTC m=+232.659926343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/43df1aa5-92e1-4c71-a4f5-4068158995e7-prometheus-operator-tls") pod "prometheus-operator-864fcfc6f9-mfx5w" (UID: "43df1aa5-92e1-4c71-a4f5-4068158995e7") : secret "prometheus-operator-tls" not found Jun 13 01:14:57.544428 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:57.544409 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43df1aa5-92e1-4c71-a4f5-4068158995e7-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-mfx5w\" (UID: \"43df1aa5-92e1-4c71-a4f5-4068158995e7\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-mfx5w" Jun 13 01:14:57.546171 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:57.546149 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43df1aa5-92e1-4c71-a4f5-4068158995e7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-mfx5w\" (UID: \"43df1aa5-92e1-4c71-a4f5-4068158995e7\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-mfx5w" Jun 13 01:14:57.564941 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:57.564915 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcz6b\" (UniqueName: \"kubernetes.io/projected/43df1aa5-92e1-4c71-a4f5-4068158995e7-kube-api-access-xcz6b\") pod \"prometheus-operator-864fcfc6f9-mfx5w\" (UID: \"43df1aa5-92e1-4c71-a4f5-4068158995e7\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-mfx5w" Jun 13 01:14:57.702853 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:57.702823 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:58.047409 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:58.047354 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/43df1aa5-92e1-4c71-a4f5-4068158995e7-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-mfx5w\" (UID: \"43df1aa5-92e1-4c71-a4f5-4068158995e7\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-mfx5w" Jun 13 01:14:58.049728 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:58.049709 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/43df1aa5-92e1-4c71-a4f5-4068158995e7-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-mfx5w\" (UID: \"43df1aa5-92e1-4c71-a4f5-4068158995e7\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-mfx5w" Jun 13 01:14:58.224542 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:58.224509 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:58.237451 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:58.237422 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-mfx5w" Jun 13 01:14:58.329327 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:58.329292 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:58.366531 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:58.366499 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-mfx5w"] Jun 13 01:14:58.369900 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:14:58.369871 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43df1aa5_92e1_4c71_a4f5_4068158995e7.slice/crio-4ec8236236867fd0458014446e3131985523e625b989ba64d4a6c84616848ebd WatchSource:0}: Error finding container 4ec8236236867fd0458014446e3131985523e625b989ba64d4a6c84616848ebd: Status 404 returned error can't find the container with id 4ec8236236867fd0458014446e3131985523e625b989ba64d4a6c84616848ebd Jun 13 01:14:58.587097 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:58.587007 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-mfx5w" event={"ID":"43df1aa5-92e1-4c71-a4f5-4068158995e7","Type":"ContainerStarted","Data":"4ec8236236867fd0458014446e3131985523e625b989ba64d4a6c84616848ebd"} Jun 13 01:14:59.790061 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:14:59.789979 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:00.405633 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.405596 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75b5b466bc-vhj2k"] Jun 13 01:15:00.408600 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.408577 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:15:00.411046 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.411025 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 13 01:15:00.411676 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.411647 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 13 01:15:00.411779 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.411753 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 13 01:15:00.411878 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.411854 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 13 01:15:00.411999 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.411854 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 13 01:15:00.411999 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.411905 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 13 01:15:00.411999 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.411946 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 13 01:15:00.412594 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.412575 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qmjhv\"" Jun 13 01:15:00.416350 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.416293 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 13 01:15:00.421144 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.421103 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75b5b466bc-vhj2k"] Jun 13 01:15:00.567545 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.567511 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fee5a139-6db7-4056-917a-d494ef083c74-oauth-serving-cert\") pod \"console-75b5b466bc-vhj2k\" (UID: \"fee5a139-6db7-4056-917a-d494ef083c74\") " pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:15:00.567737 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.567556 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fee5a139-6db7-4056-917a-d494ef083c74-service-ca\") pod \"console-75b5b466bc-vhj2k\" (UID: \"fee5a139-6db7-4056-917a-d494ef083c74\") " pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:15:00.567737 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.567602 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fee5a139-6db7-4056-917a-d494ef083c74-console-oauth-config\") pod \"console-75b5b466bc-vhj2k\" (UID: \"fee5a139-6db7-4056-917a-d494ef083c74\") " pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:15:00.567737 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.567621 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqm9j\" (UniqueName: \"kubernetes.io/projected/fee5a139-6db7-4056-917a-d494ef083c74-kube-api-access-fqm9j\") pod \"console-75b5b466bc-vhj2k\" (UID: \"fee5a139-6db7-4056-917a-d494ef083c74\") " pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:15:00.567737 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.567645 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fee5a139-6db7-4056-917a-d494ef083c74-console-serving-cert\") pod \"console-75b5b466bc-vhj2k\" (UID: \"fee5a139-6db7-4056-917a-d494ef083c74\") " pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:15:00.567737 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.567708 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee5a139-6db7-4056-917a-d494ef083c74-trusted-ca-bundle\") pod \"console-75b5b466bc-vhj2k\" (UID: \"fee5a139-6db7-4056-917a-d494ef083c74\") " pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:15:00.567981 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.567762 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fee5a139-6db7-4056-917a-d494ef083c74-console-config\") pod \"console-75b5b466bc-vhj2k\" (UID: \"fee5a139-6db7-4056-917a-d494ef083c74\") " pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:15:00.597065 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.597024 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-mfx5w" event={"ID":"43df1aa5-92e1-4c71-a4f5-4068158995e7","Type":"ContainerStarted","Data":"0739452fe7b5b449905f94000a6eeeefd47162dc572fb3a45e7bdc93f5631dbd"} Jun 13 01:15:00.597225 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.597096 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-mfx5w" event={"ID":"43df1aa5-92e1-4c71-a4f5-4068158995e7","Type":"ContainerStarted","Data":"1641752928e98c2c656343aef249595142cfd76f4716e68f2c4baed8c617299a"} Jun 13 01:15:00.613284 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.613238 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-mfx5w" podStartSLOduration=2.446859254 podStartE2EDuration="3.613223723s" totalImagesPullingTime="1.166364469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:14:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:15:00.612235799 +0000 UTC m=+235.228251576" watchObservedRunningTime="2026-06-13 01:15:00.613223723 +0000 UTC m=+235.229239497" Jun 13 01:15:00.668592 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.668522 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fee5a139-6db7-4056-917a-d494ef083c74-console-serving-cert\") pod \"console-75b5b466bc-vhj2k\" (UID: \"fee5a139-6db7-4056-917a-d494ef083c74\") " pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:15:00.668592 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.668570 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee5a139-6db7-4056-917a-d494ef083c74-trusted-ca-bundle\") pod \"console-75b5b466bc-vhj2k\" (UID: \"fee5a139-6db7-4056-917a-d494ef083c74\") " pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:15:00.668741 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.668602 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fee5a139-6db7-4056-917a-d494ef083c74-console-config\") pod \"console-75b5b466bc-vhj2k\" (UID: \"fee5a139-6db7-4056-917a-d494ef083c74\") " pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:15:00.668741 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.668623 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fee5a139-6db7-4056-917a-d494ef083c74-oauth-serving-cert\") pod \"console-75b5b466bc-vhj2k\" (UID: \"fee5a139-6db7-4056-917a-d494ef083c74\") " pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:15:00.668741 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.668651 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fee5a139-6db7-4056-917a-d494ef083c74-service-ca\") pod \"console-75b5b466bc-vhj2k\" (UID: \"fee5a139-6db7-4056-917a-d494ef083c74\") " pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:15:00.668741 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.668687 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fee5a139-6db7-4056-917a-d494ef083c74-console-oauth-config\") pod \"console-75b5b466bc-vhj2k\" (UID: \"fee5a139-6db7-4056-917a-d494ef083c74\") " pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:15:00.669290 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.668851 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqm9j\" (UniqueName: \"kubernetes.io/projected/fee5a139-6db7-4056-917a-d494ef083c74-kube-api-access-fqm9j\") pod \"console-75b5b466bc-vhj2k\" (UID: \"fee5a139-6db7-4056-917a-d494ef083c74\") " pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:15:00.669493 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.669472 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fee5a139-6db7-4056-917a-d494ef083c74-service-ca\") pod \"console-75b5b466bc-vhj2k\" (UID: \"fee5a139-6db7-4056-917a-d494ef083c74\") " pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:15:00.669554 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.669540 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fee5a139-6db7-4056-917a-d494ef083c74-console-config\") pod \"console-75b5b466bc-vhj2k\" (UID: \"fee5a139-6db7-4056-917a-d494ef083c74\") " pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:15:00.669592 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.669560 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fee5a139-6db7-4056-917a-d494ef083c74-oauth-serving-cert\") pod \"console-75b5b466bc-vhj2k\" (UID: \"fee5a139-6db7-4056-917a-d494ef083c74\") " pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:15:00.669736 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.669718 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee5a139-6db7-4056-917a-d494ef083c74-trusted-ca-bundle\") pod \"console-75b5b466bc-vhj2k\" (UID: \"fee5a139-6db7-4056-917a-d494ef083c74\") " pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:15:00.671114 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.671091 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fee5a139-6db7-4056-917a-d494ef083c74-console-oauth-config\") pod \"console-75b5b466bc-vhj2k\" (UID: \"fee5a139-6db7-4056-917a-d494ef083c74\") " pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:15:00.671349 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.671325 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fee5a139-6db7-4056-917a-d494ef083c74-console-serving-cert\") pod \"console-75b5b466bc-vhj2k\" (UID: \"fee5a139-6db7-4056-917a-d494ef083c74\") " pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:15:00.676870 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.676851 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqm9j\" (UniqueName: \"kubernetes.io/projected/fee5a139-6db7-4056-917a-d494ef083c74-kube-api-access-fqm9j\") pod \"console-75b5b466bc-vhj2k\" (UID: \"fee5a139-6db7-4056-917a-d494ef083c74\") " pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:15:00.722122 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.722094 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:15:00.848823 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:00.848788 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75b5b466bc-vhj2k"] Jun 13 01:15:00.852431 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:15:00.852403 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfee5a139_6db7_4056_917a_d494ef083c74.slice/crio-479f6c4f70ea9f0b20563ff9a045b6aad3b06ac333e8a5856c1618768c9b1b86 WatchSource:0}: Error finding container 479f6c4f70ea9f0b20563ff9a045b6aad3b06ac333e8a5856c1618768c9b1b86: Status 404 returned error can't find the container with id 479f6c4f70ea9f0b20563ff9a045b6aad3b06ac333e8a5856c1618768c9b1b86 Jun 13 01:15:01.601864 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:01.601822 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75b5b466bc-vhj2k" event={"ID":"fee5a139-6db7-4056-917a-d494ef083c74","Type":"ContainerStarted","Data":"479f6c4f70ea9f0b20563ff9a045b6aad3b06ac333e8a5856c1618768c9b1b86"} Jun 13 01:15:01.812649 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:01.812603 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:02.534620 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:02.534560 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:02.707253 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:02.707209 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:02.808192 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:02.808093 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:02.825658 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:02.825624 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hd7c9"] Jun 13 01:15:02.829408 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:02.829389 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:02.833025 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:15:02.832992 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-tls\" is forbidden: User \"system:node:ip-10-0-136-115.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-136-115.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret" Jun 13 01:15:02.833157 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:15:02.832996 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-dockercfg-wl8wg\" is forbidden: User \"system:node:ip-10-0-136-115.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-136-115.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wl8wg\"" type="*v1.Secret" Jun 13 01:15:02.833157 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:15:02.833021 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-kube-rbac-proxy-config\" is forbidden: User \"system:node:ip-10-0-136-115.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-136-115.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret" Jun 13 01:15:02.833157 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:15:02.833096 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"node-exporter-accelerators-collector-config\" is forbidden: User \"system:node:ip-10-0-136-115.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-136-115.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap" Jun 13 01:15:02.833433 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:15:02.833407 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"node-exporter-hd7c9\" is forbidden: User \"system:node:ip-10-0-136-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-136-115.ec2.internal' and this object" podUID="9885eff7-e777-4585-9f22-de270a173a23" pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:02.970697 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:02.970669 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:02.989655 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:02.989617 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9885eff7-e777-4585-9f22-de270a173a23-node-exporter-wtmp\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:02.989826 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:02.989667 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9885eff7-e777-4585-9f22-de270a173a23-metrics-client-ca\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:02.989826 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:02.989697 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr9tn\" (UniqueName: \"kubernetes.io/projected/9885eff7-e777-4585-9f22-de270a173a23-kube-api-access-lr9tn\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:02.989826 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:02.989776 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9885eff7-e777-4585-9f22-de270a173a23-sys\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:02.989826 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:02.989817 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9885eff7-e777-4585-9f22-de270a173a23-node-exporter-textfile\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:02.990091 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:02.989847 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9885eff7-e777-4585-9f22-de270a173a23-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:02.990091 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:02.989948 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9885eff7-e777-4585-9f22-de270a173a23-root\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:02.990091 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:02.989984 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9885eff7-e777-4585-9f22-de270a173a23-node-exporter-tls\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:02.990091 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:02.990025 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9885eff7-e777-4585-9f22-de270a173a23-node-exporter-accelerators-collector-config\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:03.057012 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:03.056976 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:03.091114 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:03.091020 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9885eff7-e777-4585-9f22-de270a173a23-root\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:03.091114 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:03.091074 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9885eff7-e777-4585-9f22-de270a173a23-node-exporter-tls\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:03.091365 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:03.091143 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9885eff7-e777-4585-9f22-de270a173a23-node-exporter-accelerators-collector-config\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:03.091365 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:03.091150 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9885eff7-e777-4585-9f22-de270a173a23-root\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:03.091365 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:03.091183 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9885eff7-e777-4585-9f22-de270a173a23-node-exporter-wtmp\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:03.091365 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:03.091209 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9885eff7-e777-4585-9f22-de270a173a23-metrics-client-ca\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:03.091365 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:03.091237 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr9tn\" (UniqueName: \"kubernetes.io/projected/9885eff7-e777-4585-9f22-de270a173a23-kube-api-access-lr9tn\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:03.091365 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:03.091314 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9885eff7-e777-4585-9f22-de270a173a23-sys\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:03.091365 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:03.091352 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9885eff7-e777-4585-9f22-de270a173a23-node-exporter-textfile\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:03.091365 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:03.091354 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9885eff7-e777-4585-9f22-de270a173a23-node-exporter-wtmp\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:03.091721 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:03.091384 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9885eff7-e777-4585-9f22-de270a173a23-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:03.091721 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:03.091408 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9885eff7-e777-4585-9f22-de270a173a23-sys\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:03.091786 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:03.091740 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9885eff7-e777-4585-9f22-de270a173a23-node-exporter-textfile\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:03.091824 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:03.091788 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9885eff7-e777-4585-9f22-de270a173a23-metrics-client-ca\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:03.105720 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:03.105693 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr9tn\" (UniqueName: \"kubernetes.io/projected/9885eff7-e777-4585-9f22-de270a173a23-kube-api-access-lr9tn\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:03.157914 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:03.157873 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:03.255884 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:03.255853 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:03.608795 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:03.608772 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:03.715161 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:03.715114 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:03.807508 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:03.807473 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:03.826102 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:03.826028 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wl8wg\"" Jun 13 01:15:04.034182 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:04.034072 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:04.092248 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:15:04.092164 2563 configmap.go:193] Couldn't get configMap openshift-monitoring/node-exporter-accelerators-collector-config: failed to sync configmap cache: timed out waiting for the condition Jun 13 01:15:04.092248 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:15:04.092248 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9885eff7-e777-4585-9f22-de270a173a23-node-exporter-accelerators-collector-config podName:9885eff7-e777-4585-9f22-de270a173a23 nodeName:}" failed. No retries permitted until 2026-06-13 01:15:04.592230985 +0000 UTC m=+239.208246738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-accelerators-collector-config" (UniqueName: "kubernetes.io/configmap/9885eff7-e777-4585-9f22-de270a173a23-node-exporter-accelerators-collector-config") pod "node-exporter-hd7c9" (UID: "9885eff7-e777-4585-9f22-de270a173a23") : failed to sync configmap cache: timed out waiting for the condition Jun 13 01:15:04.092436 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:15:04.092174 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-kube-rbac-proxy-config: failed to sync secret cache: timed out waiting for the condition Jun 13 01:15:04.092436 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:15:04.092340 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9885eff7-e777-4585-9f22-de270a173a23-node-exporter-kube-rbac-proxy-config podName:9885eff7-e777-4585-9f22-de270a173a23 nodeName:}" failed. No retries permitted until 2026-06-13 01:15:04.592323401 +0000 UTC m=+239.208339154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-kube-rbac-proxy-config" (UniqueName: "kubernetes.io/secret/9885eff7-e777-4585-9f22-de270a173a23-node-exporter-kube-rbac-proxy-config") pod "node-exporter-hd7c9" (UID: "9885eff7-e777-4585-9f22-de270a173a23") : failed to sync secret cache: timed out waiting for the condition Jun 13 01:15:04.092436 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:15:04.092180 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: failed to sync secret cache: timed out waiting for the condition Jun 13 01:15:04.092436 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:15:04.092398 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9885eff7-e777-4585-9f22-de270a173a23-node-exporter-tls podName:9885eff7-e777-4585-9f22-de270a173a23 nodeName:}" failed. No retries permitted until 2026-06-13 01:15:04.592383721 +0000 UTC m=+239.208399478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9885eff7-e777-4585-9f22-de270a173a23-node-exporter-tls") pod "node-exporter-hd7c9" (UID: "9885eff7-e777-4585-9f22-de270a173a23") : failed to sync secret cache: timed out waiting for the condition Jun 13 01:15:04.175823 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:04.175787 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 13 01:15:04.228200 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:04.228169 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 13 01:15:04.252706 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:04.252675 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 13 01:15:04.605203 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:04.605172 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9885eff7-e777-4585-9f22-de270a173a23-node-exporter-accelerators-collector-config\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:04.605418 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:04.605286 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9885eff7-e777-4585-9f22-de270a173a23-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:04.605418 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:04.605332 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9885eff7-e777-4585-9f22-de270a173a23-node-exporter-tls\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:04.605879 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:04.605849 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9885eff7-e777-4585-9f22-de270a173a23-node-exporter-accelerators-collector-config\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:04.607721 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:04.607701 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9885eff7-e777-4585-9f22-de270a173a23-node-exporter-tls\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:04.607805 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:04.607716 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9885eff7-e777-4585-9f22-de270a173a23-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hd7c9\" (UID: \"9885eff7-e777-4585-9f22-de270a173a23\") " pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:04.612878 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:04.612851 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75b5b466bc-vhj2k" event={"ID":"fee5a139-6db7-4056-917a-d494ef083c74","Type":"ContainerStarted","Data":"fb61dc4caa610114ad2af1ead3e44d4ae50008ea775291b9945bdfbebb1e0a1e"} Jun 13 01:15:04.640277 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:04.640249 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hd7c9" Jun 13 01:15:04.653357 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:04.649609 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75b5b466bc-vhj2k" podStartSLOduration=1.931677509 podStartE2EDuration="4.649590811s" totalImagesPullingTime="2.717913302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:15:04.647991267 +0000 UTC m=+239.264007083" watchObservedRunningTime="2026-06-13 01:15:04.649590811 +0000 UTC m=+239.265606588" Jun 13 01:15:04.655628 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:15:04.655601 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9885eff7_e777_4585_9f22_de270a173a23.slice/crio-45364795703b893eb99489a856a5adb33869930f7dff34835504c1c6b4989b48 WatchSource:0}: Error finding container 45364795703b893eb99489a856a5adb33869930f7dff34835504c1c6b4989b48: Status 404 returned error can't find the container with id 45364795703b893eb99489a856a5adb33869930f7dff34835504c1c6b4989b48 Jun 13 01:15:04.716079 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:04.716041 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" podUID="e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 13 01:15:04.716248 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:04.716119 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" Jun 13 01:15:04.716596 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:04.716564 2563 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"9a6d72b8d2b14c061724b52fdd87a5f7fe3965c23ba1e9f4b1eec073f785e5a3"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 13 01:15:04.716640 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:04.716617 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" podUID="e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c" containerName="service-proxy" containerID="cri-o://9a6d72b8d2b14c061724b52fdd87a5f7fe3965c23ba1e9f4b1eec073f785e5a3" gracePeriod=30 Jun 13 01:15:05.618634 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:05.618602 2563 generic.go:356] "Generic (PLEG): container finished" podID="e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c" containerID="9a6d72b8d2b14c061724b52fdd87a5f7fe3965c23ba1e9f4b1eec073f785e5a3" exitCode=2 Jun 13 01:15:05.619034 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:05.618670 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" event={"ID":"e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c","Type":"ContainerDied","Data":"9a6d72b8d2b14c061724b52fdd87a5f7fe3965c23ba1e9f4b1eec073f785e5a3"} Jun 13 01:15:05.619034 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:05.618713 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bd558879d-h8z8x" event={"ID":"e7cc8f8f-b92a-44f1-a43a-3a40022bbf8c","Type":"ContainerStarted","Data":"b8a78d0ec418e37c51b33ccad03390c0f625232f3f76d893a3799a047f87b571"} Jun 13 01:15:05.620279 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:05.620257 2563 generic.go:356] "Generic (PLEG): container finished" podID="9885eff7-e777-4585-9f22-de270a173a23" containerID="3edc16c790851a0e29a1dbd9a3fbced1ae78be96616585d195af2228cd258581" exitCode=0 Jun 13 01:15:05.620388 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:05.620326 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hd7c9" event={"ID":"9885eff7-e777-4585-9f22-de270a173a23","Type":"ContainerDied","Data":"3edc16c790851a0e29a1dbd9a3fbced1ae78be96616585d195af2228cd258581"} Jun 13 01:15:05.620388 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:05.620374 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hd7c9" event={"ID":"9885eff7-e777-4585-9f22-de270a173a23","Type":"ContainerStarted","Data":"45364795703b893eb99489a856a5adb33869930f7dff34835504c1c6b4989b48"} Jun 13 01:15:05.704049 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:05.704023 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:05.799046 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:05.799012 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:05.883286 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:05.883252 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:05.998508 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:05.998396 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:06.616880 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:06.616841 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:06.626029 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:06.625994 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hd7c9" event={"ID":"9885eff7-e777-4585-9f22-de270a173a23","Type":"ContainerStarted","Data":"d44f6e4b8631ebfb430c3280c48793e450a17252cde645643428d748ae22d4c0"} Jun 13 01:15:06.626392 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:06.626095 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hd7c9" event={"ID":"9885eff7-e777-4585-9f22-de270a173a23","Type":"ContainerStarted","Data":"139afe3831fadc4ecaa373f8c3e599963ac67cb1d6847aff92ad4be9e064f15d"} Jun 13 01:15:06.649953 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:06.649903 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hd7c9" podStartSLOduration=3.7744949930000002 podStartE2EDuration="4.649885486s" totalImagesPullingTime="811.659433ms" totalInitContainerRuntime="63.73106ms" isStatefulPod=true podCreationTimestamp="2026-06-13 01:15:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:15:06.647727625 +0000 UTC m=+241.263743426" watchObservedRunningTime="2026-06-13 01:15:06.649885486 +0000 UTC m=+241.265901261" Jun 13 01:15:06.718640 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:06.718609 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:07.124149 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:07.124091 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:07.186469 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:07.186439 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:07.518819 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:07.518736 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:07.600858 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:07.600826 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:07.761887 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:07.761851 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:07.784206 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:07.784170 2563 patch_prober.go:28] interesting pod/image-registry-dc84f6c56-n5sz9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 01:15:07.784349 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:07.784225 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" podUID="0919664c-ade5-406f-90e1-284794a42370" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 01:15:08.982338 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:08.982297 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:08.983266 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:08.983243 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 13 01:15:08.987881 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:08.987856 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:08.990056 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:08.990033 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-d8d5x\"" Jun 13 01:15:08.990888 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:08.990467 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 13 01:15:08.990888 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:08.990524 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 13 01:15:08.990888 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:08.990597 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 13 01:15:08.990888 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:08.990467 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 13 01:15:08.990888 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:08.990738 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 13 01:15:08.990888 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:08.990807 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 13 01:15:08.991960 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:08.991599 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2ijqsv0bh27s4\"" Jun 13 01:15:08.991960 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:08.991688 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 13 01:15:08.991960 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:08.991698 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 13 01:15:08.991960 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:08.991820 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 13 01:15:08.991960 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:08.991866 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 13 01:15:08.992426 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:08.992409 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 13 01:15:08.992894 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:08.992871 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 13 01:15:08.992974 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:08.992946 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 13 01:15:08.993090 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:08.993074 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 13 01:15:08.994692 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:08.994673 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 13 01:15:09.006390 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.006362 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 13 01:15:09.039197 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.039165 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-web-config\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.039197 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.039200 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.039448 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.039219 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.039448 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.039251 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.039448 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.039278 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.039448 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.039351 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-config-out\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.039448 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.039407 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8lj4\" (UniqueName: \"kubernetes.io/projected/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-kube-api-access-z8lj4\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.039448 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.039433 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.039448 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.039453 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.039801 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.039476 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-config\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.039801 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.039551 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.039801 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.039596 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.039801 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.039632 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.039801 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.039660 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.039801 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.039686 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.039801 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.039712 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.039801 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.039742 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.039801 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.039770 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.040295 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.039827 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.040295 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.039890 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.140619 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.140582 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.140619 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.140622 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.141007 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.140643 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-config\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.141007 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.140665 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.141007 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.140803 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.141007 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.140850 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.141007 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.140879 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.141615 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.141477 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.141670 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.141620 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.141721 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.141667 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.141721 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.141709 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.141840 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.141738 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.141840 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.141769 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.141840 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.141834 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.142033 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.141865 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-web-config\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.142033 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.141896 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.142033 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.141924 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.142033 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.141969 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.142033 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.141996 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.142290 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.142043 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-config-out\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.142290 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.142106 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8lj4\" (UniqueName: \"kubernetes.io/projected/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-kube-api-access-z8lj4\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.143863 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.143834 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-config\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.144408 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.144211 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.144408 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.144285 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.144808 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.144781 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.144891 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.144781 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.144943 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.144882 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.145248 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.145193 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.147562 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.145528 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.147562 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.147151 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.147562 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.147226 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.147562 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.147545 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.147810 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.147756 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.148832 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.148606 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.148832 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.148680 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.149002 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.148955 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-config-out\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.149418 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.149396 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.149938 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.149902 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.150595 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.150567 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-web-config\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.151159 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.151117 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8lj4\" (UniqueName: \"kubernetes.io/projected/fa4523b5-985d-4c7c-b0d7-6bf981c2abf2-kube-api-access-z8lj4\") pod \"prometheus-k8s-0\" (UID: \"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.299387 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.299351 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:09.465076 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.465025 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 13 01:15:09.467194 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:15:09.467168 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa4523b5_985d_4c7c_b0d7_6bf981c2abf2.slice/crio-b434d1e90a318f0f0a226d9c9446ec0863f8fe4f53e77a669565d032c92b1d43 WatchSource:0}: Error finding container b434d1e90a318f0f0a226d9c9446ec0863f8fe4f53e77a669565d032c92b1d43: Status 404 returned error can't find the container with id b434d1e90a318f0f0a226d9c9446ec0863f8fe4f53e77a669565d032c92b1d43 Jun 13 01:15:09.557687 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.557600 2563 patch_prober.go:28] interesting pod/image-registry-dc84f6c56-n5sz9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 01:15:09.557687 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.557648 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" podUID="0919664c-ade5-406f-90e1-284794a42370" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 01:15:09.637476 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:09.637445 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2","Type":"ContainerStarted","Data":"b434d1e90a318f0f0a226d9c9446ec0863f8fe4f53e77a669565d032c92b1d43"} Jun 13 01:15:10.642901 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:10.642804 2563 generic.go:356] "Generic (PLEG): container finished" podID="fa4523b5-985d-4c7c-b0d7-6bf981c2abf2" containerID="597e8e854efb8ab903524dc34d284e2ac93bd501446d4b454fa55cd366775b9d" exitCode=0 Jun 13 01:15:10.642901 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:10.642864 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2","Type":"ContainerDied","Data":"597e8e854efb8ab903524dc34d284e2ac93bd501446d4b454fa55cd366775b9d"} Jun 13 01:15:10.723248 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:10.723208 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:15:10.723418 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:10.723309 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:15:10.724514 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:10.724488 2563 patch_prober.go:28] interesting pod/console-75b5b466bc-vhj2k container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.13:8443/health\": dial tcp 10.134.0.13:8443: connect: connection refused" start-of-body= Jun 13 01:15:10.724617 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:10.724549 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-75b5b466bc-vhj2k" podUID="fee5a139-6db7-4056-917a-d494ef083c74" containerName="console" probeResult="failure" output="Get \"https://10.134.0.13:8443/health\": dial tcp 10.134.0.13:8443: connect: connection refused" Jun 13 01:15:11.624776 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:11.624736 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:12.560882 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:12.560845 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:12.661031 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:12.660997 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:13.657201 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:13.657161 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2","Type":"ContainerStarted","Data":"b2ed890c6f1765679cf371c7c726beb83297ca3b98e3826fca793bba5fb42cc9"} Jun 13 01:15:13.657619 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:13.657258 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2","Type":"ContainerStarted","Data":"6d645d4159a06926d28d91512d768e7ed104c4f50d2716318a33c57a7b32155d"} Jun 13 01:15:15.665928 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:15.665890 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2","Type":"ContainerStarted","Data":"da7580870033a6ed4f6af017f42f324f9d34182d2cdc16739e08e96d5a7f819a"} Jun 13 01:15:16.672909 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:16.672874 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2","Type":"ContainerStarted","Data":"22edc735fe05dafa4f5cd04383c4a3c33e169db6c6aab6f93a97506a6a4c49b8"} Jun 13 01:15:16.673322 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:16.672934 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2","Type":"ContainerStarted","Data":"e764081ecd9822b3a50e5dab5f9b2bd02553abec0c722be7989f416fbca543da"} Jun 13 01:15:16.673322 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:16.672960 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa4523b5-985d-4c7c-b0d7-6bf981c2abf2","Type":"ContainerStarted","Data":"94ac1e64d10d310fe2f9254e7ef47ac67a0abc71d7c6f6a5e32f3379ac304ca0"} Jun 13 01:15:16.701910 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:16.701863 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.98720825 podStartE2EDuration="8.701846007s" totalImagesPullingTime="5.695311659s" totalInitContainerRuntime="19.326098ms" isStatefulPod=false podCreationTimestamp="2026-06-13 01:15:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:15:16.700324965 +0000 UTC m=+251.316340758" watchObservedRunningTime="2026-06-13 01:15:16.701846007 +0000 UTC m=+251.317861804" Jun 13 01:15:17.721713 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:17.721656 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs\") pod \"network-metrics-daemon-mthf7\" (UID: \"4b218b9d-0f16-40fc-9753-0892624afc14\") " pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:15:17.724403 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:17.724366 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b218b9d-0f16-40fc-9753-0892624afc14-metrics-certs\") pod \"network-metrics-daemon-mthf7\" (UID: \"4b218b9d-0f16-40fc-9753-0892624afc14\") " pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:15:17.784686 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:17.784654 2563 patch_prober.go:28] interesting pod/image-registry-dc84f6c56-n5sz9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 01:15:17.784828 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:17.784708 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" podUID="0919664c-ade5-406f-90e1-284794a42370" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 01:15:17.849206 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:17.849173 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-86b5g\"" Jun 13 01:15:17.856997 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:17.856973 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthf7" Jun 13 01:15:17.986962 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:17.986892 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mthf7"] Jun 13 01:15:17.990219 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:15:17.990194 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b218b9d_0f16_40fc_9753_0892624afc14.slice/crio-c801c8c3c3674411bdb383311d68685d06281f98f68bee1768fa07d5239643c3 WatchSource:0}: Error finding container c801c8c3c3674411bdb383311d68685d06281f98f68bee1768fa07d5239643c3: Status 404 returned error can't find the container with id c801c8c3c3674411bdb383311d68685d06281f98f68bee1768fa07d5239643c3 Jun 13 01:15:18.682061 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:18.682018 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mthf7" event={"ID":"4b218b9d-0f16-40fc-9753-0892624afc14","Type":"ContainerStarted","Data":"c801c8c3c3674411bdb383311d68685d06281f98f68bee1768fa07d5239643c3"} Jun 13 01:15:19.299820 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:19.299777 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:15:19.558937 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:19.558844 2563 patch_prober.go:28] interesting pod/image-registry-dc84f6c56-n5sz9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 01:15:19.558937 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:19.558898 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" podUID="0919664c-ade5-406f-90e1-284794a42370" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 01:15:19.689629 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:19.689595 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mthf7" event={"ID":"4b218b9d-0f16-40fc-9753-0892624afc14","Type":"ContainerStarted","Data":"87db401b4d371c8acb16bf7865251103cc3066ba491523605d30a97c7e816c85"} Jun 13 01:15:19.689797 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:19.689649 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mthf7" event={"ID":"4b218b9d-0f16-40fc-9753-0892624afc14","Type":"ContainerStarted","Data":"1a428d8c4cdb8f47106341b428365493e7a87ea077ea4a94527548014741e1d5"} Jun 13 01:15:19.714173 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:19.714106 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mthf7" podStartSLOduration=252.966286882 podStartE2EDuration="4m13.714090617s" totalImagesPullingTime="747.803735ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:11:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:15:19.71309248 +0000 UTC m=+254.329108255" watchObservedRunningTime="2026-06-13 01:15:19.714090617 +0000 UTC m=+254.330106391" Jun 13 01:15:19.772493 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:19.772457 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:19.827613 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:19.827532 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:19.882953 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:19.882914 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:19.933678 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:19.933650 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:20.117583 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:20.117493 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:20.172560 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:20.172525 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:20.722715 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:20.722676 2563 patch_prober.go:28] interesting pod/console-75b5b466bc-vhj2k container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.13:8443/health\": dial tcp 10.134.0.13:8443: connect: connection refused" start-of-body= Jun 13 01:15:20.723105 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:20.722725 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-75b5b466bc-vhj2k" podUID="fee5a139-6db7-4056-917a-d494ef083c74" containerName="console" probeResult="failure" output="Get \"https://10.134.0.13:8443/health\": dial tcp 10.134.0.13:8443: connect: connection refused" Jun 13 01:15:21.016735 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:21.016651 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:21.116496 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:21.116458 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:24.543555 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:24.543484 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:24.601173 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:24.601142 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:27.784331 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:27.784298 2563 patch_prober.go:28] interesting pod/image-registry-dc84f6c56-n5sz9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 01:15:27.784710 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:27.784356 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" podUID="0919664c-ade5-406f-90e1-284794a42370" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 01:15:27.784710 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:27.784393 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:15:27.784894 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:27.784876 2563 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"2f77ca2d7f438bd9b3eed9521b45c14252403749d57cdd2bd65dae0a2ead8c8d"} pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" containerMessage="Container registry failed liveness probe, will be restarted" Jun 13 01:15:27.788487 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:27.788457 2563 patch_prober.go:28] interesting pod/image-registry-dc84f6c56-n5sz9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 01:15:27.788608 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:27.788517 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" podUID="0919664c-ade5-406f-90e1-284794a42370" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 01:15:30.601925 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:30.601878 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:30.701662 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:30.701624 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:30.722506 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:30.722469 2563 patch_prober.go:28] interesting pod/console-75b5b466bc-vhj2k container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.13:8443/health\": dial tcp 10.134.0.13:8443: connect: connection refused" start-of-body= Jun 13 01:15:30.722663 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:30.722521 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-75b5b466bc-vhj2k" podUID="fee5a139-6db7-4056-917a-d494ef083c74" containerName="console" probeResult="failure" output="Get \"https://10.134.0.13:8443/health\": dial tcp 10.134.0.13:8443: connect: connection refused" Jun 13 01:15:37.789369 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:37.789333 2563 patch_prober.go:28] interesting pod/image-registry-dc84f6c56-n5sz9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 01:15:37.789756 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:37.789388 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" podUID="0919664c-ade5-406f-90e1-284794a42370" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 01:15:39.729216 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:39.729186 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hd7c9_9885eff7-e777-4585-9f22-de270a173a23/init-textfile/0.log" Jun 13 01:15:39.929828 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:39.929795 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hd7c9_9885eff7-e777-4585-9f22-de270a173a23/node-exporter/0.log" Jun 13 01:15:40.128802 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:40.128772 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hd7c9_9885eff7-e777-4585-9f22-de270a173a23/kube-rbac-proxy/0.log" Jun 13 01:15:40.135361 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:40.135326 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:40.188595 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:40.188569 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:40.722745 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:40.722706 2563 patch_prober.go:28] interesting pod/console-75b5b466bc-vhj2k container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.13:8443/health\": dial tcp 10.134.0.13:8443: connect: connection refused" start-of-body= Jun 13 01:15:40.722928 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:40.722760 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-75b5b466bc-vhj2k" podUID="fee5a139-6db7-4056-917a-d494ef083c74" containerName="console" probeResult="failure" output="Get \"https://10.134.0.13:8443/health\": dial tcp 10.134.0.13:8443: connect: connection refused" Jun 13 01:15:40.929538 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:40.929510 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa4523b5-985d-4c7c-b0d7-6bf981c2abf2/init-config-reloader/0.log" Jun 13 01:15:41.130384 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:41.130354 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa4523b5-985d-4c7c-b0d7-6bf981c2abf2/prometheus/0.log" Jun 13 01:15:41.329708 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:41.329667 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa4523b5-985d-4c7c-b0d7-6bf981c2abf2/config-reloader/0.log" Jun 13 01:15:41.530374 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:41.530284 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa4523b5-985d-4c7c-b0d7-6bf981c2abf2/thanos-sidecar/0.log" Jun 13 01:15:41.729372 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:41.729344 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa4523b5-985d-4c7c-b0d7-6bf981c2abf2/kube-rbac-proxy-web/0.log" Jun 13 01:15:41.928530 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:41.928504 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa4523b5-985d-4c7c-b0d7-6bf981c2abf2/kube-rbac-proxy/0.log" Jun 13 01:15:42.129016 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:42.128983 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa4523b5-985d-4c7c-b0d7-6bf981c2abf2/kube-rbac-proxy-thanos/0.log" Jun 13 01:15:42.330930 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:42.330889 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-mfx5w_43df1aa5-92e1-4c71-a4f5-4068158995e7/prometheus-operator/0.log" Jun 13 01:15:42.529689 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:42.529663 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-mfx5w_43df1aa5-92e1-4c71-a4f5-4068158995e7/kube-rbac-proxy/0.log" Jun 13 01:15:44.129658 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:44.129628 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-hjcl6_42938e76-2127-4067-9ffb-2a1d1a02c036/networking-console-plugin/0.log" Jun 13 01:15:44.932094 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:44.932062 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75b5b466bc-vhj2k_fee5a139-6db7-4056-917a-d494ef083c74/console/0.log" Jun 13 01:15:47.130972 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:47.130944 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t6xgs_2a2385b8-b719-4fbb-a0ec-75b6dadeee56/dns-node-resolver/0.log" Jun 13 01:15:47.529793 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:47.529714 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-dc84f6c56-n5sz9_0919664c-ade5-406f-90e1-284794a42370/registry/0.log" Jun 13 01:15:47.729589 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:47.729558 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-29fpw_b95fc5d7-d3d7-4d28-94d6-ec2ae9ac65b4/node-ca/0.log" Jun 13 01:15:47.790051 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:47.790021 2563 patch_prober.go:28] interesting pod/image-registry-dc84f6c56-n5sz9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 01:15:47.790240 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:47.790066 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" podUID="0919664c-ade5-406f-90e1-284794a42370" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 01:15:48.529022 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:48.528996 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-99zs8_a3047eef-fbf3-467d-b062-31e46ec5b236/serve-healthcheck-canary/0.log" Jun 13 01:15:49.671205 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:49.671166 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:49.725254 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:49.725223 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:50.728586 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:50.728558 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:15:50.733796 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:50.733774 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:15:50.809103 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:50.808579 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls\") pod \"dns-default-v57zn\" (UID: \"11693fcd-f558-4148-a311-9552a7c78e4f\") " pod="openshift-dns/dns-default-v57zn" Jun 13 01:15:50.814060 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:50.813836 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11693fcd-f558-4148-a311-9552a7c78e4f-metrics-tls\") pod \"dns-default-v57zn\" (UID: \"11693fcd-f558-4148-a311-9552a7c78e4f\") " pod="openshift-dns/dns-default-v57zn" Jun 13 01:15:50.850716 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:50.850473 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hswsv\"" Jun 13 01:15:50.857630 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:50.857362 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v57zn" Jun 13 01:15:50.889443 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:50.889384 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:51.023953 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:51.023857 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v57zn"] Jun 13 01:15:51.027760 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:15:51.027731 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11693fcd_f558_4148_a311_9552a7c78e4f.slice/crio-5c4fff9bf23ec77fa9325f706454da45f9c3582d6b6444b4d5b1cde528578fce WatchSource:0}: Error finding container 5c4fff9bf23ec77fa9325f706454da45f9c3582d6b6444b4d5b1cde528578fce: Status 404 returned error can't find the container with id 5c4fff9bf23ec77fa9325f706454da45f9c3582d6b6444b4d5b1cde528578fce Jun 13 01:15:51.817504 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:51.817465 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v57zn" event={"ID":"11693fcd-f558-4148-a311-9552a7c78e4f","Type":"ContainerStarted","Data":"5c4fff9bf23ec77fa9325f706454da45f9c3582d6b6444b4d5b1cde528578fce"} Jun 13 01:15:52.118942 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:52.118843 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:52.803812 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:52.803769 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" podUID="0919664c-ade5-406f-90e1-284794a42370" containerName="registry" containerID="cri-o://2f77ca2d7f438bd9b3eed9521b45c14252403749d57cdd2bd65dae0a2ead8c8d" gracePeriod=30 Jun 13 01:15:53.828041 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:53.828006 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v57zn" event={"ID":"11693fcd-f558-4148-a311-9552a7c78e4f","Type":"ContainerStarted","Data":"60cd82e994ea6b474919120483144f46c9243018c646789c43f31ef68e5933b7"} Jun 13 01:15:53.828468 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:53.828087 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v57zn" event={"ID":"11693fcd-f558-4148-a311-9552a7c78e4f","Type":"ContainerStarted","Data":"eba25a00ce4111bd2720e1f913b747eb9db5ec75acca8776d16144b77eb39fb2"} Jun 13 01:15:53.828468 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:53.828168 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-v57zn" Jun 13 01:15:53.851614 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:53.851573 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-v57zn" podStartSLOduration=252.049956966 podStartE2EDuration="4m13.851558569s" totalImagesPullingTime="1.801601603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:11:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:15:53.850408656 +0000 UTC m=+288.466424433" watchObservedRunningTime="2026-06-13 01:15:53.851558569 +0000 UTC m=+288.467574349" Jun 13 01:15:54.808409 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:54.808370 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:54.833035 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:54.832999 2563 generic.go:356] "Generic (PLEG): container finished" podID="0919664c-ade5-406f-90e1-284794a42370" containerID="2f77ca2d7f438bd9b3eed9521b45c14252403749d57cdd2bd65dae0a2ead8c8d" exitCode=0 Jun 13 01:15:54.833402 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:54.833070 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" event={"ID":"0919664c-ade5-406f-90e1-284794a42370","Type":"ContainerDied","Data":"2f77ca2d7f438bd9b3eed9521b45c14252403749d57cdd2bd65dae0a2ead8c8d"} Jun 13 01:15:54.833402 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:54.833122 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" event={"ID":"0919664c-ade5-406f-90e1-284794a42370","Type":"ContainerStarted","Data":"96ef844b21a19db92540dd2fe59057f93db7a86fc5ec024bbbf3b8192f37550f"} Jun 13 01:15:54.837372 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:54.837345 2563 status_manager.go:444] "Container readiness changed for unknown container" pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" containerID="cri-o://2f77ca2d7f438bd9b3eed9521b45c14252403749d57cdd2bd65dae0a2ead8c8d" Jun 13 01:15:54.837372 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:54.837367 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:15:54.863234 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:54.863211 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:55.668684 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:55.668652 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:55.836448 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:55.836419 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:15:57.963619 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:57.963591 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75b5b466bc-vhj2k"] Jun 13 01:15:58.089025 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:58.088993 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:58.190648 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:58.190615 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:58.240452 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:15:58.240373 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:00.720764 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:00.720730 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:00.772325 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:00.772294 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:01.468934 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:01.468902 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:01.570138 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:01.570092 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:01.638663 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:01.638634 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:03.835459 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:03.835427 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-v57zn" Jun 13 01:16:05.796655 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:05.796622 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ppvdn_e98f7500-070e-4c57-a4b0-a711e20b8c26/ovn-acl-logging/0.log" Jun 13 01:16:05.798062 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:05.798035 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ppvdn_e98f7500-070e-4c57-a4b0-a711e20b8c26/ovn-acl-logging/0.log" Jun 13 01:16:05.803112 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:05.803090 2563 kubelet.go:1648] "Image garbage collection succeeded" Jun 13 01:16:09.299727 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:09.299670 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:16:09.320103 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:09.320079 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:16:09.562433 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:09.562340 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:09.617524 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:09.617497 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:09.809167 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:09.809110 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:09.902056 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:09.901980 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 01:16:09.908879 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:09.908857 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:10.393852 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:10.393815 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:12.970026 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:12.969990 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:13.032012 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:13.031983 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:16.844055 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:16.844025 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-dc84f6c56-n5sz9" Jun 13 01:16:16.966607 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:16.966576 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:17.069041 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:17.069009 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:17.132969 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:17.132883 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:22.005580 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:22.005548 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:22.205982 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:22.205949 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:22.983121 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:22.983086 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-75b5b466bc-vhj2k" podUID="fee5a139-6db7-4056-917a-d494ef083c74" containerName="console" containerID="cri-o://fb61dc4caa610114ad2af1ead3e44d4ae50008ea775291b9945bdfbebb1e0a1e" gracePeriod=15 Jun 13 01:16:23.225903 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.225880 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:16:23.278398 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.278308 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fee5a139-6db7-4056-917a-d494ef083c74-service-ca\") pod \"fee5a139-6db7-4056-917a-d494ef083c74\" (UID: \"fee5a139-6db7-4056-917a-d494ef083c74\") " Jun 13 01:16:23.278398 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.278353 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fee5a139-6db7-4056-917a-d494ef083c74-console-serving-cert\") pod \"fee5a139-6db7-4056-917a-d494ef083c74\" (UID: \"fee5a139-6db7-4056-917a-d494ef083c74\") " Jun 13 01:16:23.278398 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.278369 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee5a139-6db7-4056-917a-d494ef083c74-trusted-ca-bundle\") pod \"fee5a139-6db7-4056-917a-d494ef083c74\" (UID: \"fee5a139-6db7-4056-917a-d494ef083c74\") " Jun 13 01:16:23.278398 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.278391 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fee5a139-6db7-4056-917a-d494ef083c74-console-oauth-config\") pod \"fee5a139-6db7-4056-917a-d494ef083c74\" (UID: \"fee5a139-6db7-4056-917a-d494ef083c74\") " Jun 13 01:16:23.278720 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.278464 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fee5a139-6db7-4056-917a-d494ef083c74-console-config\") pod \"fee5a139-6db7-4056-917a-d494ef083c74\" (UID: \"fee5a139-6db7-4056-917a-d494ef083c74\") " Jun 13 01:16:23.278720 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.278493 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqm9j\" (UniqueName: \"kubernetes.io/projected/fee5a139-6db7-4056-917a-d494ef083c74-kube-api-access-fqm9j\") pod \"fee5a139-6db7-4056-917a-d494ef083c74\" (UID: \"fee5a139-6db7-4056-917a-d494ef083c74\") " Jun 13 01:16:23.278720 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.278520 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fee5a139-6db7-4056-917a-d494ef083c74-oauth-serving-cert\") pod \"fee5a139-6db7-4056-917a-d494ef083c74\" (UID: \"fee5a139-6db7-4056-917a-d494ef083c74\") " Jun 13 01:16:23.278867 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.278825 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fee5a139-6db7-4056-917a-d494ef083c74-service-ca" (OuterVolumeSpecName: "service-ca") pod "fee5a139-6db7-4056-917a-d494ef083c74" (UID: "fee5a139-6db7-4056-917a-d494ef083c74"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:16:23.278993 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.278959 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fee5a139-6db7-4056-917a-d494ef083c74-console-config" (OuterVolumeSpecName: "console-config") pod "fee5a139-6db7-4056-917a-d494ef083c74" (UID: "fee5a139-6db7-4056-917a-d494ef083c74"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:16:23.279147 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.278986 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fee5a139-6db7-4056-917a-d494ef083c74-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fee5a139-6db7-4056-917a-d494ef083c74" (UID: "fee5a139-6db7-4056-917a-d494ef083c74"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:16:23.279147 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.279047 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fee5a139-6db7-4056-917a-d494ef083c74-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fee5a139-6db7-4056-917a-d494ef083c74" (UID: "fee5a139-6db7-4056-917a-d494ef083c74"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:16:23.280890 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.280861 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fee5a139-6db7-4056-917a-d494ef083c74-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fee5a139-6db7-4056-917a-d494ef083c74" (UID: "fee5a139-6db7-4056-917a-d494ef083c74"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:16:23.281121 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.281099 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fee5a139-6db7-4056-917a-d494ef083c74-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fee5a139-6db7-4056-917a-d494ef083c74" (UID: "fee5a139-6db7-4056-917a-d494ef083c74"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:16:23.281200 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.281101 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fee5a139-6db7-4056-917a-d494ef083c74-kube-api-access-fqm9j" (OuterVolumeSpecName: "kube-api-access-fqm9j") pod "fee5a139-6db7-4056-917a-d494ef083c74" (UID: "fee5a139-6db7-4056-917a-d494ef083c74"). InnerVolumeSpecName "kube-api-access-fqm9j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:16:23.379232 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.379197 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fee5a139-6db7-4056-917a-d494ef083c74-console-config\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:16:23.379232 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.379227 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqm9j\" (UniqueName: \"kubernetes.io/projected/fee5a139-6db7-4056-917a-d494ef083c74-kube-api-access-fqm9j\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:16:23.379232 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.379237 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fee5a139-6db7-4056-917a-d494ef083c74-oauth-serving-cert\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:16:23.379232 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.379245 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fee5a139-6db7-4056-917a-d494ef083c74-service-ca\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:16:23.379494 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.379254 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fee5a139-6db7-4056-917a-d494ef083c74-console-serving-cert\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:16:23.379494 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.379262 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee5a139-6db7-4056-917a-d494ef083c74-trusted-ca-bundle\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:16:23.379494 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.379270 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fee5a139-6db7-4056-917a-d494ef083c74-console-oauth-config\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:16:23.936997 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.936956 2563 generic.go:356] "Generic (PLEG): container finished" podID="fee5a139-6db7-4056-917a-d494ef083c74" containerID="fb61dc4caa610114ad2af1ead3e44d4ae50008ea775291b9945bdfbebb1e0a1e" exitCode=0 Jun 13 01:16:23.937226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.937025 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75b5b466bc-vhj2k" Jun 13 01:16:23.937226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.937045 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75b5b466bc-vhj2k" event={"ID":"fee5a139-6db7-4056-917a-d494ef083c74","Type":"ContainerDied","Data":"fb61dc4caa610114ad2af1ead3e44d4ae50008ea775291b9945bdfbebb1e0a1e"} Jun 13 01:16:23.937226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.937114 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75b5b466bc-vhj2k" event={"ID":"fee5a139-6db7-4056-917a-d494ef083c74","Type":"ContainerDied","Data":"479f6c4f70ea9f0b20563ff9a045b6aad3b06ac333e8a5856c1618768c9b1b86"} Jun 13 01:16:23.937226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.937164 2563 scope.go:117] "RemoveContainer" containerID="fb61dc4caa610114ad2af1ead3e44d4ae50008ea775291b9945bdfbebb1e0a1e" Jun 13 01:16:23.945435 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.945412 2563 scope.go:117] "RemoveContainer" containerID="fb61dc4caa610114ad2af1ead3e44d4ae50008ea775291b9945bdfbebb1e0a1e" Jun 13 01:16:23.945696 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:16:23.945676 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb61dc4caa610114ad2af1ead3e44d4ae50008ea775291b9945bdfbebb1e0a1e\": container with ID starting with fb61dc4caa610114ad2af1ead3e44d4ae50008ea775291b9945bdfbebb1e0a1e not found: ID does not exist" containerID="fb61dc4caa610114ad2af1ead3e44d4ae50008ea775291b9945bdfbebb1e0a1e" Jun 13 01:16:23.945765 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.945705 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb61dc4caa610114ad2af1ead3e44d4ae50008ea775291b9945bdfbebb1e0a1e"} err="failed to get container status \"fb61dc4caa610114ad2af1ead3e44d4ae50008ea775291b9945bdfbebb1e0a1e\": rpc error: code = NotFound desc = could not find container \"fb61dc4caa610114ad2af1ead3e44d4ae50008ea775291b9945bdfbebb1e0a1e\": container with ID starting with fb61dc4caa610114ad2af1ead3e44d4ae50008ea775291b9945bdfbebb1e0a1e not found: ID does not exist" Jun 13 01:16:23.953389 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.953361 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75b5b466bc-vhj2k"] Jun 13 01:16:23.959192 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:23.959171 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75b5b466bc-vhj2k"] Jun 13 01:16:24.541006 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:24.540977 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:24.602003 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:24.601970 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:25.850505 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:25.850472 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fee5a139-6db7-4056-917a-d494ef083c74" path="/var/lib/kubelet/pods/fee5a139-6db7-4056-917a-d494ef083c74/volumes" Jun 13 01:16:31.768404 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:31.768367 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:31.824170 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:31.824111 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:37.214697 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:37.214659 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:37.270815 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:37.270782 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:43.205712 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:43.205678 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:43.264344 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:43.264304 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:43.681833 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:43.681799 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:47.839559 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:47.839516 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:47.943542 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:47.943512 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:53.398446 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:53.398407 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:53.493539 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:53.493502 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:54.173614 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:54.173525 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:54.228608 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:54.228576 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:54.331290 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:16:54.331254 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:17:03.978121 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:17:03.978082 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:17:04.035940 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:17:04.035906 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:17:09.585222 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:17:09.585188 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:17:09.706318 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:17:09.706283 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:17:32.457046 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:17:32.457010 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:17:32.559624 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:17:32.559592 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:17:59.287189 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:17:59.287112 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:00.638107 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:00.638075 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:02.889212 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:02.889175 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:02.989675 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:02.989635 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:04.430033 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:04.429995 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:04.523830 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:04.523797 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:04.621792 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:04.621752 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:07.892511 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:07.892476 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:08.264723 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:08.264639 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:09.672777 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:09.672741 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:09.773782 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:09.773750 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:11.922152 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:11.922012 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:14.386910 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:14.386873 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:14.491542 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:14.491506 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:15.478191 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:15.478155 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:21.075439 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:21.075401 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:21.171286 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:21.171254 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:26.934092 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:26.934016 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:27.033932 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:27.033898 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:28.622966 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:28.622929 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:43.083460 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:43.083428 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:43.182170 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:43.182120 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:43.698319 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:43.698289 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:43.939423 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:43.939386 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:44.073102 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.073068 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:44.152485 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.152457 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-gdf68"] Jun 13 01:18:44.152858 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.152702 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fee5a139-6db7-4056-917a-d494ef083c74" containerName="console" Jun 13 01:18:44.152858 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.152712 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fee5a139-6db7-4056-917a-d494ef083c74" containerName="console" Jun 13 01:18:44.152858 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.152763 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fee5a139-6db7-4056-917a-d494ef083c74" containerName="console" Jun 13 01:18:44.155449 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.155433 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-gdf68" Jun 13 01:18:44.157745 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.157727 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qth8m\"" Jun 13 01:18:44.158068 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.158044 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 13 01:18:44.158068 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.158057 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 13 01:18:44.158332 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.158315 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 13 01:18:44.158422 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.158344 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 13 01:18:44.174839 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.174817 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-gdf68"] Jun 13 01:18:44.255955 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.255909 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e2abe744-c80c-441c-9878-c5db6ecba767-manifests\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-gdf68\" (UID: \"e2abe744-c80c-441c-9878-c5db6ecba767\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-gdf68" Jun 13 01:18:44.256146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.255962 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng96w\" (UniqueName: \"kubernetes.io/projected/e2abe744-c80c-441c-9878-c5db6ecba767-kube-api-access-ng96w\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-gdf68\" (UID: \"e2abe744-c80c-441c-9878-c5db6ecba767\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-gdf68" Jun 13 01:18:44.256146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.256022 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2abe744-c80c-441c-9878-c5db6ecba767-tmp\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-gdf68\" (UID: \"e2abe744-c80c-441c-9878-c5db6ecba767\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-gdf68" Jun 13 01:18:44.256146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.256058 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e2abe744-c80c-441c-9878-c5db6ecba767-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-gdf68\" (UID: \"e2abe744-c80c-441c-9878-c5db6ecba767\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-gdf68" Jun 13 01:18:44.256146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.256075 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e2abe744-c80c-441c-9878-c5db6ecba767-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-gdf68\" (UID: \"e2abe744-c80c-441c-9878-c5db6ecba767\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-gdf68" Jun 13 01:18:44.258441 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.258415 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:44.356727 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.356641 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e2abe744-c80c-441c-9878-c5db6ecba767-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-gdf68\" (UID: \"e2abe744-c80c-441c-9878-c5db6ecba767\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-gdf68" Jun 13 01:18:44.356727 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.356682 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e2abe744-c80c-441c-9878-c5db6ecba767-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-gdf68\" (UID: \"e2abe744-c80c-441c-9878-c5db6ecba767\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-gdf68" Jun 13 01:18:44.356910 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.356812 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e2abe744-c80c-441c-9878-c5db6ecba767-manifests\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-gdf68\" (UID: \"e2abe744-c80c-441c-9878-c5db6ecba767\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-gdf68" Jun 13 01:18:44.356910 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.356874 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng96w\" (UniqueName: \"kubernetes.io/projected/e2abe744-c80c-441c-9878-c5db6ecba767-kube-api-access-ng96w\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-gdf68\" (UID: \"e2abe744-c80c-441c-9878-c5db6ecba767\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-gdf68" Jun 13 01:18:44.357009 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.356940 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2abe744-c80c-441c-9878-c5db6ecba767-tmp\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-gdf68\" (UID: \"e2abe744-c80c-441c-9878-c5db6ecba767\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-gdf68" Jun 13 01:18:44.357337 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.357312 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e2abe744-c80c-441c-9878-c5db6ecba767-manifests\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-gdf68\" (UID: \"e2abe744-c80c-441c-9878-c5db6ecba767\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-gdf68" Jun 13 01:18:44.358851 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.358824 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:44.359393 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.359364 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e2abe744-c80c-441c-9878-c5db6ecba767-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-gdf68\" (UID: \"e2abe744-c80c-441c-9878-c5db6ecba767\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-gdf68" Jun 13 01:18:44.359393 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.359359 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2abe744-c80c-441c-9878-c5db6ecba767-tmp\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-gdf68\" (UID: \"e2abe744-c80c-441c-9878-c5db6ecba767\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-gdf68" Jun 13 01:18:44.359534 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.359367 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e2abe744-c80c-441c-9878-c5db6ecba767-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-gdf68\" (UID: \"e2abe744-c80c-441c-9878-c5db6ecba767\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-gdf68" Jun 13 01:18:44.364485 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.364469 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng96w\" (UniqueName: \"kubernetes.io/projected/e2abe744-c80c-441c-9878-c5db6ecba767-kube-api-access-ng96w\") pod \"opendatahub-operator-controller-manager-6f7bcb9597-gdf68\" (UID: \"e2abe744-c80c-441c-9878-c5db6ecba767\") " pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-gdf68" Jun 13 01:18:44.460525 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.460491 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:44.465719 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.465702 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-gdf68" Jun 13 01:18:44.561139 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.561078 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:44.606261 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.606224 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-gdf68"] Jun 13 01:18:44.613818 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:18:44.613792 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2abe744_c80c_441c_9878_c5db6ecba767.slice/crio-25c475c8f672601f4a8c1a6da02aed308905e16bf942f39dcade05f756b50634 WatchSource:0}: Error finding container 25c475c8f672601f4a8c1a6da02aed308905e16bf942f39dcade05f756b50634: Status 404 returned error can't find the container with id 25c475c8f672601f4a8c1a6da02aed308905e16bf942f39dcade05f756b50634 Jun 13 01:18:44.615525 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.615507 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 01:18:44.667330 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:44.667287 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:45.433398 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:45.433344 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-gdf68" event={"ID":"e2abe744-c80c-441c-9878-c5db6ecba767","Type":"ContainerStarted","Data":"25c475c8f672601f4a8c1a6da02aed308905e16bf942f39dcade05f756b50634"} Jun 13 01:18:48.446104 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:48.446068 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-gdf68" event={"ID":"e2abe744-c80c-441c-9878-c5db6ecba767","Type":"ContainerStarted","Data":"b59db460c4b90e82c52bd486bff739607964e8b1cbffab8dc6bb4c6c1d420844"} Jun 13 01:18:49.450726 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:49.450688 2563 generic.go:356] "Generic (PLEG): container finished" podID="e2abe744-c80c-441c-9878-c5db6ecba767" containerID="b59db460c4b90e82c52bd486bff739607964e8b1cbffab8dc6bb4c6c1d420844" exitCode=0 Jun 13 01:18:49.451101 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:49.450748 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-gdf68" event={"ID":"e2abe744-c80c-441c-9878-c5db6ecba767","Type":"ContainerDied","Data":"b59db460c4b90e82c52bd486bff739607964e8b1cbffab8dc6bb4c6c1d420844"} Jun 13 01:18:50.457187 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:50.457116 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-gdf68" event={"ID":"e2abe744-c80c-441c-9878-c5db6ecba767","Type":"ContainerStarted","Data":"7be00c7ab9d098019f50d03bdd7c06e367d02be2b1ec2490539b424400a6cd03"} Jun 13 01:18:50.457583 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:50.457254 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-gdf68" Jun 13 01:18:50.480326 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:50.480269 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-gdf68" podStartSLOduration=2.140271801 podStartE2EDuration="6.480254954s" totalImagesPullingTime="3.349840065s" totalInitContainerRuntime="990.143088ms" isStatefulPod=false podCreationTimestamp="2026-06-13 01:18:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:18:50.47935993 +0000 UTC m=+465.095375705" watchObservedRunningTime="2026-06-13 01:18:50.480254954 +0000 UTC m=+465.096270728" Jun 13 01:18:50.853502 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:50.853466 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:18:50.974594 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:18:50.974563 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:01.463295 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:01.463261 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f7bcb9597-gdf68" Jun 13 01:19:02.988116 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:02.988084 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:03.157714 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:03.157678 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:03.327725 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:03.327691 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:03.454057 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:03.454022 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:03.707999 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:03.707917 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:03.817728 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:03.817695 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:03.938039 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:03.938008 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:04.051273 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:04.051244 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:04.304785 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:04.304712 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:04.439315 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:04.439278 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:04.871393 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:04.871357 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:11.670959 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:11.670923 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8554b6f6b8-95d7p"] Jun 13 01:19:11.677374 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:11.677352 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-95d7p" Jun 13 01:19:11.680049 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:11.680026 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fccpl\"" Jun 13 01:19:11.680784 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:11.680760 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 13 01:19:11.680784 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:11.680770 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 13 01:19:11.680930 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:11.680785 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 13 01:19:11.680930 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:11.680806 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 13 01:19:11.683628 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:11.683599 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 13 01:19:11.684349 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:11.684328 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8554b6f6b8-95d7p"] Jun 13 01:19:11.790566 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:11.790534 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/033bf3f3-40be-49af-92ff-5b0eea32a27e-cert\") pod \"lws-controller-manager-8554b6f6b8-95d7p\" (UID: \"033bf3f3-40be-49af-92ff-5b0eea32a27e\") " pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-95d7p" Jun 13 01:19:11.790566 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:11.790570 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/033bf3f3-40be-49af-92ff-5b0eea32a27e-metrics-cert\") pod \"lws-controller-manager-8554b6f6b8-95d7p\" (UID: \"033bf3f3-40be-49af-92ff-5b0eea32a27e\") " pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-95d7p" Jun 13 01:19:11.790786 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:11.790595 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jthg\" (UniqueName: \"kubernetes.io/projected/033bf3f3-40be-49af-92ff-5b0eea32a27e-kube-api-access-6jthg\") pod \"lws-controller-manager-8554b6f6b8-95d7p\" (UID: \"033bf3f3-40be-49af-92ff-5b0eea32a27e\") " pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-95d7p" Jun 13 01:19:11.790786 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:11.790613 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/033bf3f3-40be-49af-92ff-5b0eea32a27e-manager-config\") pod \"lws-controller-manager-8554b6f6b8-95d7p\" (UID: \"033bf3f3-40be-49af-92ff-5b0eea32a27e\") " pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-95d7p" Jun 13 01:19:11.890982 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:11.890947 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/033bf3f3-40be-49af-92ff-5b0eea32a27e-cert\") pod \"lws-controller-manager-8554b6f6b8-95d7p\" (UID: \"033bf3f3-40be-49af-92ff-5b0eea32a27e\") " pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-95d7p" Jun 13 01:19:11.890982 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:11.890986 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/033bf3f3-40be-49af-92ff-5b0eea32a27e-metrics-cert\") pod \"lws-controller-manager-8554b6f6b8-95d7p\" (UID: \"033bf3f3-40be-49af-92ff-5b0eea32a27e\") " pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-95d7p" Jun 13 01:19:11.891229 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:11.891012 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jthg\" (UniqueName: \"kubernetes.io/projected/033bf3f3-40be-49af-92ff-5b0eea32a27e-kube-api-access-6jthg\") pod \"lws-controller-manager-8554b6f6b8-95d7p\" (UID: \"033bf3f3-40be-49af-92ff-5b0eea32a27e\") " pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-95d7p" Jun 13 01:19:11.891229 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:11.891041 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/033bf3f3-40be-49af-92ff-5b0eea32a27e-manager-config\") pod \"lws-controller-manager-8554b6f6b8-95d7p\" (UID: \"033bf3f3-40be-49af-92ff-5b0eea32a27e\") " pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-95d7p" Jun 13 01:19:11.891818 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:11.891785 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/033bf3f3-40be-49af-92ff-5b0eea32a27e-manager-config\") pod \"lws-controller-manager-8554b6f6b8-95d7p\" (UID: \"033bf3f3-40be-49af-92ff-5b0eea32a27e\") " pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-95d7p" Jun 13 01:19:11.893620 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:11.893583 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/033bf3f3-40be-49af-92ff-5b0eea32a27e-cert\") pod \"lws-controller-manager-8554b6f6b8-95d7p\" (UID: \"033bf3f3-40be-49af-92ff-5b0eea32a27e\") " pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-95d7p" Jun 13 01:19:11.893727 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:11.893652 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/033bf3f3-40be-49af-92ff-5b0eea32a27e-metrics-cert\") pod \"lws-controller-manager-8554b6f6b8-95d7p\" (UID: \"033bf3f3-40be-49af-92ff-5b0eea32a27e\") " pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-95d7p" Jun 13 01:19:11.900671 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:11.900644 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jthg\" (UniqueName: \"kubernetes.io/projected/033bf3f3-40be-49af-92ff-5b0eea32a27e-kube-api-access-6jthg\") pod \"lws-controller-manager-8554b6f6b8-95d7p\" (UID: \"033bf3f3-40be-49af-92ff-5b0eea32a27e\") " pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-95d7p" Jun 13 01:19:11.987255 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:11.987152 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-95d7p" Jun 13 01:19:12.119836 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:12.119804 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8554b6f6b8-95d7p"] Jun 13 01:19:12.122784 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:19:12.122757 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod033bf3f3_40be_49af_92ff_5b0eea32a27e.slice/crio-01c753293b17e290d6cb37cf62f4e130fe82f9236d3bdb5693f0ff32b94606d3 WatchSource:0}: Error finding container 01c753293b17e290d6cb37cf62f4e130fe82f9236d3bdb5693f0ff32b94606d3: Status 404 returned error can't find the container with id 01c753293b17e290d6cb37cf62f4e130fe82f9236d3bdb5693f0ff32b94606d3 Jun 13 01:19:12.555019 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:12.554980 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-95d7p" event={"ID":"033bf3f3-40be-49af-92ff-5b0eea32a27e","Type":"ContainerStarted","Data":"01c753293b17e290d6cb37cf62f4e130fe82f9236d3bdb5693f0ff32b94606d3"} Jun 13 01:19:14.438566 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:14.438485 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:14.527884 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:14.527852 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:14.563984 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:14.563946 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-95d7p" event={"ID":"033bf3f3-40be-49af-92ff-5b0eea32a27e","Type":"ContainerStarted","Data":"2fef0a036bed816ead8e6476d49f578cb87a41ced1c55914eb8043985aef9907"} Jun 13 01:19:14.564198 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:14.564009 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-95d7p" Jun 13 01:19:14.590762 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:14.590711 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-95d7p" podStartSLOduration=1.55877067 podStartE2EDuration="3.590695037s" totalImagesPullingTime="2.031924367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:19:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:19:14.590073306 +0000 UTC m=+489.206089117" watchObservedRunningTime="2026-06-13 01:19:14.590695037 +0000 UTC m=+489.206710812" Jun 13 01:19:14.673380 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:14.673345 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:14.886848 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:14.886808 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:15.779544 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:15.779510 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:15.875382 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:15.875351 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:15.975278 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:15.975243 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:16.343152 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:16.343101 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:16.405239 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:16.405209 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:19.709528 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:19.709489 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:19.815791 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:19.815757 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:20.992653 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:20.992610 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:21.101913 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:21.101882 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:21.375438 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:21.375405 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:21.476310 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:21.476277 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:22.053237 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:22.053209 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:25.569632 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:25.569604 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8554b6f6b8-95d7p" Jun 13 01:19:28.410389 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:28.410349 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:28.498646 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:28.498611 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:29.032943 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:29.032912 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:31.864606 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:31.864567 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:31.964777 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:31.964746 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:32.865422 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:32.865393 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:32.966509 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:32.966475 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:33.107525 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.107491 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn"] Jun 13 01:19:33.110636 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.110615 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.112994 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.112965 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 13 01:19:33.113179 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.113007 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 13 01:19:33.113179 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.113036 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 13 01:19:33.113179 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.113085 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-fwb6g\"" Jun 13 01:19:33.122284 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.122255 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn"] Jun 13 01:19:33.142263 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.142238 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:33.166407 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.166382 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85a9e38d-1d71-4ec8-afea-602588e665d8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bctjvnn\" (UID: \"85a9e38d-1d71-4ec8-afea-602588e665d8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.166552 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.166413 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85a9e38d-1d71-4ec8-afea-602588e665d8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bctjvnn\" (UID: \"85a9e38d-1d71-4ec8-afea-602588e665d8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.166552 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.166431 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85a9e38d-1d71-4ec8-afea-602588e665d8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bctjvnn\" (UID: \"85a9e38d-1d71-4ec8-afea-602588e665d8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.166552 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.166474 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85a9e38d-1d71-4ec8-afea-602588e665d8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bctjvnn\" (UID: \"85a9e38d-1d71-4ec8-afea-602588e665d8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.166552 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.166528 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85a9e38d-1d71-4ec8-afea-602588e665d8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bctjvnn\" (UID: \"85a9e38d-1d71-4ec8-afea-602588e665d8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.166766 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.166618 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdcc6\" (UniqueName: \"kubernetes.io/projected/85a9e38d-1d71-4ec8-afea-602588e665d8-kube-api-access-qdcc6\") pod \"data-science-gateway-data-science-gateway-class-5b556588bctjvnn\" (UID: \"85a9e38d-1d71-4ec8-afea-602588e665d8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.166766 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.166663 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85a9e38d-1d71-4ec8-afea-602588e665d8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bctjvnn\" (UID: \"85a9e38d-1d71-4ec8-afea-602588e665d8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.166766 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.166707 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85a9e38d-1d71-4ec8-afea-602588e665d8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bctjvnn\" (UID: \"85a9e38d-1d71-4ec8-afea-602588e665d8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.166766 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.166743 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85a9e38d-1d71-4ec8-afea-602588e665d8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bctjvnn\" (UID: \"85a9e38d-1d71-4ec8-afea-602588e665d8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.241629 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.241572 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:33.267884 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.267845 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85a9e38d-1d71-4ec8-afea-602588e665d8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bctjvnn\" (UID: \"85a9e38d-1d71-4ec8-afea-602588e665d8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.268041 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.267909 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdcc6\" (UniqueName: \"kubernetes.io/projected/85a9e38d-1d71-4ec8-afea-602588e665d8-kube-api-access-qdcc6\") pod \"data-science-gateway-data-science-gateway-class-5b556588bctjvnn\" (UID: \"85a9e38d-1d71-4ec8-afea-602588e665d8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.268041 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.267943 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85a9e38d-1d71-4ec8-afea-602588e665d8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bctjvnn\" (UID: \"85a9e38d-1d71-4ec8-afea-602588e665d8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.268041 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.267976 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85a9e38d-1d71-4ec8-afea-602588e665d8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bctjvnn\" (UID: \"85a9e38d-1d71-4ec8-afea-602588e665d8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.268041 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.268002 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85a9e38d-1d71-4ec8-afea-602588e665d8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bctjvnn\" (UID: \"85a9e38d-1d71-4ec8-afea-602588e665d8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.268271 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.268050 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85a9e38d-1d71-4ec8-afea-602588e665d8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bctjvnn\" (UID: \"85a9e38d-1d71-4ec8-afea-602588e665d8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.268271 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.268081 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85a9e38d-1d71-4ec8-afea-602588e665d8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bctjvnn\" (UID: \"85a9e38d-1d71-4ec8-afea-602588e665d8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.268271 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.268110 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85a9e38d-1d71-4ec8-afea-602588e665d8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bctjvnn\" (UID: \"85a9e38d-1d71-4ec8-afea-602588e665d8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.268414 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.268265 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85a9e38d-1d71-4ec8-afea-602588e665d8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bctjvnn\" (UID: \"85a9e38d-1d71-4ec8-afea-602588e665d8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.268414 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.268337 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85a9e38d-1d71-4ec8-afea-602588e665d8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bctjvnn\" (UID: \"85a9e38d-1d71-4ec8-afea-602588e665d8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.268527 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.268505 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85a9e38d-1d71-4ec8-afea-602588e665d8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bctjvnn\" (UID: \"85a9e38d-1d71-4ec8-afea-602588e665d8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.268591 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.268536 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85a9e38d-1d71-4ec8-afea-602588e665d8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bctjvnn\" (UID: \"85a9e38d-1d71-4ec8-afea-602588e665d8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.268699 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.268683 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85a9e38d-1d71-4ec8-afea-602588e665d8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bctjvnn\" (UID: \"85a9e38d-1d71-4ec8-afea-602588e665d8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.268757 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.268700 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85a9e38d-1d71-4ec8-afea-602588e665d8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bctjvnn\" (UID: \"85a9e38d-1d71-4ec8-afea-602588e665d8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.270416 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.270395 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85a9e38d-1d71-4ec8-afea-602588e665d8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bctjvnn\" (UID: \"85a9e38d-1d71-4ec8-afea-602588e665d8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.270728 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.270709 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85a9e38d-1d71-4ec8-afea-602588e665d8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bctjvnn\" (UID: \"85a9e38d-1d71-4ec8-afea-602588e665d8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.275284 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.275262 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85a9e38d-1d71-4ec8-afea-602588e665d8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bctjvnn\" (UID: \"85a9e38d-1d71-4ec8-afea-602588e665d8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.275648 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.275628 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdcc6\" (UniqueName: \"kubernetes.io/projected/85a9e38d-1d71-4ec8-afea-602588e665d8-kube-api-access-qdcc6\") pod \"data-science-gateway-data-science-gateway-class-5b556588bctjvnn\" (UID: \"85a9e38d-1d71-4ec8-afea-602588e665d8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.419826 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.419728 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:33.421393 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.421375 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:33.554248 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.554212 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn"] Jun 13 01:19:33.559259 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:19:33.559232 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85a9e38d_1d71_4ec8_afea_602588e665d8.slice/crio-b4cd240afe317c1cafba9354aa93ef781604049555f8e85b08e624b1106c1195 WatchSource:0}: Error finding container b4cd240afe317c1cafba9354aa93ef781604049555f8e85b08e624b1106c1195: Status 404 returned error can't find the container with id b4cd240afe317c1cafba9354aa93ef781604049555f8e85b08e624b1106c1195 Jun 13 01:19:33.637088 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:33.637055 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" event={"ID":"85a9e38d-1d71-4ec8-afea-602588e665d8","Type":"ContainerStarted","Data":"b4cd240afe317c1cafba9354aa93ef781604049555f8e85b08e624b1106c1195"} Jun 13 01:19:36.356334 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:36.356293 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 13 01:19:36.356699 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:36.356394 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 13 01:19:36.356699 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:36.356443 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 13 01:19:36.650814 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:36.650728 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" event={"ID":"85a9e38d-1d71-4ec8-afea-602588e665d8","Type":"ContainerStarted","Data":"f9a786358c553f6ddcc78957f8ee1ca98719e2fca3df89ad6a3c7ed71a91c8b8"} Jun 13 01:19:36.669462 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:36.669401 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" podStartSLOduration=0.874776017 podStartE2EDuration="3.669381077s" totalImagesPullingTime="2.79460506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:19:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:19:36.668928345 +0000 UTC m=+511.284944120" watchObservedRunningTime="2026-06-13 01:19:36.669381077 +0000 UTC m=+511.285396853" Jun 13 01:19:37.040264 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:37.040227 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7bc9d68775-q9qg4"] Jun 13 01:19:37.043775 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:37.043753 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7bc9d68775-q9qg4" Jun 13 01:19:37.046250 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:37.046227 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 13 01:19:37.046349 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:37.046231 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5mp7d\"" Jun 13 01:19:37.052784 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:37.052757 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7bc9d68775-q9qg4"] Jun 13 01:19:37.083645 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:37.083616 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:19:37.102584 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:37.102545 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s72c\" (UniqueName: \"kubernetes.io/projected/52f97dad-f304-4275-8d30-e43bc0ff2025-kube-api-access-6s72c\") pod \"dashboard-redirect-7bc9d68775-q9qg4\" (UID: \"52f97dad-f304-4275-8d30-e43bc0ff2025\") " pod="opendatahub/dashboard-redirect-7bc9d68775-q9qg4" Jun 13 01:19:37.102753 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:37.102614 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/52f97dad-f304-4275-8d30-e43bc0ff2025-redirect-config\") pod \"dashboard-redirect-7bc9d68775-q9qg4\" (UID: \"52f97dad-f304-4275-8d30-e43bc0ff2025\") " pod="opendatahub/dashboard-redirect-7bc9d68775-q9qg4" Jun 13 01:19:37.203484 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:37.203443 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s72c\" (UniqueName: \"kubernetes.io/projected/52f97dad-f304-4275-8d30-e43bc0ff2025-kube-api-access-6s72c\") pod \"dashboard-redirect-7bc9d68775-q9qg4\" (UID: \"52f97dad-f304-4275-8d30-e43bc0ff2025\") " pod="opendatahub/dashboard-redirect-7bc9d68775-q9qg4" Jun 13 01:19:37.203681 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:37.203511 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/52f97dad-f304-4275-8d30-e43bc0ff2025-redirect-config\") pod \"dashboard-redirect-7bc9d68775-q9qg4\" (UID: \"52f97dad-f304-4275-8d30-e43bc0ff2025\") " pod="opendatahub/dashboard-redirect-7bc9d68775-q9qg4" Jun 13 01:19:37.204284 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:37.204258 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/52f97dad-f304-4275-8d30-e43bc0ff2025-redirect-config\") pod \"dashboard-redirect-7bc9d68775-q9qg4\" (UID: \"52f97dad-f304-4275-8d30-e43bc0ff2025\") " pod="opendatahub/dashboard-redirect-7bc9d68775-q9qg4" Jun 13 01:19:37.213813 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:37.213789 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s72c\" (UniqueName: \"kubernetes.io/projected/52f97dad-f304-4275-8d30-e43bc0ff2025-kube-api-access-6s72c\") pod \"dashboard-redirect-7bc9d68775-q9qg4\" (UID: \"52f97dad-f304-4275-8d30-e43bc0ff2025\") " pod="opendatahub/dashboard-redirect-7bc9d68775-q9qg4" Jun 13 01:19:37.355319 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:37.355233 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7bc9d68775-q9qg4" Jun 13 01:19:37.422010 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:37.421981 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:37.426953 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:37.426926 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:37.486622 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:37.486469 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7bc9d68775-q9qg4"] Jun 13 01:19:37.489259 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:19:37.489231 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52f97dad_f304_4275_8d30_e43bc0ff2025.slice/crio-85677c3e40e199a63d9f1ebb413430e1b0d63a2edf11fe8b939121a8ece9b7ff WatchSource:0}: Error finding container 85677c3e40e199a63d9f1ebb413430e1b0d63a2edf11fe8b939121a8ece9b7ff: Status 404 returned error can't find the container with id 85677c3e40e199a63d9f1ebb413430e1b0d63a2edf11fe8b939121a8ece9b7ff Jun 13 01:19:37.655434 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:37.655351 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7bc9d68775-q9qg4" event={"ID":"52f97dad-f304-4275-8d30-e43bc0ff2025","Type":"ContainerStarted","Data":"85677c3e40e199a63d9f1ebb413430e1b0d63a2edf11fe8b939121a8ece9b7ff"} Jun 13 01:19:37.655597 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:37.655531 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:37.656679 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:37.656659 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bctjvnn" Jun 13 01:19:40.670027 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:40.669996 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7bc9d68775-q9qg4" event={"ID":"52f97dad-f304-4275-8d30-e43bc0ff2025","Type":"ContainerStarted","Data":"08795be8970667bfaedc275bf2890aad161c005bee2fe5ded4d7e0407cd38f68"} Jun 13 01:19:40.688170 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:40.688102 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7bc9d68775-q9qg4" podStartSLOduration=1.564403135 podStartE2EDuration="3.68808582s" totalImagesPullingTime="2.123682685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:19:40.686922518 +0000 UTC m=+515.302938298" watchObservedRunningTime="2026-06-13 01:19:40.68808582 +0000 UTC m=+515.304101595" Jun 13 01:19:55.653285 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:19:55.653202 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:20:04.033464 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:04.033428 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:20:04.129506 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:04.129477 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:20:04.146262 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:04.146229 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ncvrz"] Jun 13 01:20:04.149883 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:04.149859 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ncvrz" Jun 13 01:20:04.152523 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:04.152496 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 13 01:20:04.152666 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:04.152545 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 13 01:20:04.152918 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:04.152901 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-5tnst\"" Jun 13 01:20:04.164349 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:04.164318 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ncvrz"] Jun 13 01:20:04.223076 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:04.223042 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:20:04.236284 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:04.236255 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqqdq\" (UniqueName: \"kubernetes.io/projected/3bbaa547-3a62-4186-887d-9c26811b935e-kube-api-access-mqqdq\") pod \"kuadrant-operator-catalog-ncvrz\" (UID: \"3bbaa547-3a62-4186-887d-9c26811b935e\") " pod="kuadrant-system/kuadrant-operator-catalog-ncvrz" Jun 13 01:20:04.337054 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:04.336976 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqqdq\" (UniqueName: \"kubernetes.io/projected/3bbaa547-3a62-4186-887d-9c26811b935e-kube-api-access-mqqdq\") pod \"kuadrant-operator-catalog-ncvrz\" (UID: \"3bbaa547-3a62-4186-887d-9c26811b935e\") " pod="kuadrant-system/kuadrant-operator-catalog-ncvrz" Jun 13 01:20:04.345421 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:04.345398 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqqdq\" (UniqueName: \"kubernetes.io/projected/3bbaa547-3a62-4186-887d-9c26811b935e-kube-api-access-mqqdq\") pod \"kuadrant-operator-catalog-ncvrz\" (UID: \"3bbaa547-3a62-4186-887d-9c26811b935e\") " pod="kuadrant-system/kuadrant-operator-catalog-ncvrz" Jun 13 01:20:04.460475 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:04.460435 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ncvrz" Jun 13 01:20:04.515969 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:04.515933 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ncvrz"] Jun 13 01:20:04.598978 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:04.598901 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ncvrz"] Jun 13 01:20:04.602121 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:20:04.602081 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bbaa547_3a62_4186_887d_9c26811b935e.slice/crio-bec79daf60d3b022256ee0db66e3580daab7fdad754fa02c37fddbb6624bb960 WatchSource:0}: Error finding container bec79daf60d3b022256ee0db66e3580daab7fdad754fa02c37fddbb6624bb960: Status 404 returned error can't find the container with id bec79daf60d3b022256ee0db66e3580daab7fdad754fa02c37fddbb6624bb960 Jun 13 01:20:04.725694 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:04.725658 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sjw86"] Jun 13 01:20:04.729927 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:04.729910 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sjw86" Jun 13 01:20:04.735626 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:04.735599 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sjw86"] Jun 13 01:20:04.764357 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:04.764325 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ncvrz" event={"ID":"3bbaa547-3a62-4186-887d-9c26811b935e","Type":"ContainerStarted","Data":"bec79daf60d3b022256ee0db66e3580daab7fdad754fa02c37fddbb6624bb960"} Jun 13 01:20:04.841812 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:04.841775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hmdp\" (UniqueName: \"kubernetes.io/projected/d6c20059-b473-458e-95db-721f33bbe4a5-kube-api-access-2hmdp\") pod \"kuadrant-operator-catalog-sjw86\" (UID: \"d6c20059-b473-458e-95db-721f33bbe4a5\") " pod="kuadrant-system/kuadrant-operator-catalog-sjw86" Jun 13 01:20:04.943443 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:04.943353 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hmdp\" (UniqueName: \"kubernetes.io/projected/d6c20059-b473-458e-95db-721f33bbe4a5-kube-api-access-2hmdp\") pod \"kuadrant-operator-catalog-sjw86\" (UID: \"d6c20059-b473-458e-95db-721f33bbe4a5\") " pod="kuadrant-system/kuadrant-operator-catalog-sjw86" Jun 13 01:20:04.944810 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:04.944786 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:20:04.951204 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:04.951187 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hmdp\" (UniqueName: \"kubernetes.io/projected/d6c20059-b473-458e-95db-721f33bbe4a5-kube-api-access-2hmdp\") pod \"kuadrant-operator-catalog-sjw86\" (UID: \"d6c20059-b473-458e-95db-721f33bbe4a5\") " pod="kuadrant-system/kuadrant-operator-catalog-sjw86" Jun 13 01:20:05.041326 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:05.041290 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sjw86" Jun 13 01:20:05.160984 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:05.160944 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:20:05.178250 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:05.178220 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sjw86"] Jun 13 01:20:05.221764 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:20:05.221695 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6c20059_b473_458e_95db_721f33bbe4a5.slice/crio-12c4d426eee23c106609647465a5b3a3145677f5e3587617072b686be58d6ba1 WatchSource:0}: Error finding container 12c4d426eee23c106609647465a5b3a3145677f5e3587617072b686be58d6ba1: Status 404 returned error can't find the container with id 12c4d426eee23c106609647465a5b3a3145677f5e3587617072b686be58d6ba1 Jun 13 01:20:05.772195 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:05.772152 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sjw86" event={"ID":"d6c20059-b473-458e-95db-721f33bbe4a5","Type":"ContainerStarted","Data":"12c4d426eee23c106609647465a5b3a3145677f5e3587617072b686be58d6ba1"} Jun 13 01:20:06.779307 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:06.779272 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sjw86" event={"ID":"d6c20059-b473-458e-95db-721f33bbe4a5","Type":"ContainerStarted","Data":"0b95afd1db729cc4b8c78f5dfb8329bc850d6a64df471bbba58575f43f413a42"} Jun 13 01:20:06.780838 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:06.780812 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ncvrz" event={"ID":"3bbaa547-3a62-4186-887d-9c26811b935e","Type":"ContainerStarted","Data":"92e4d06a65e862e8f73c3bd1f7d5d233ac1e6b36f687f837eec189331558c487"} Jun 13 01:20:06.780954 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:06.780922 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-ncvrz" podUID="3bbaa547-3a62-4186-887d-9c26811b935e" containerName="registry-server" containerID="cri-o://92e4d06a65e862e8f73c3bd1f7d5d233ac1e6b36f687f837eec189331558c487" gracePeriod=2 Jun 13 01:20:06.794120 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:06.794064 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-sjw86" podStartSLOduration=1.358409029 podStartE2EDuration="2.794049743s" totalImagesPullingTime="1.435640714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:20:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:20:06.79359509 +0000 UTC m=+541.409610865" watchObservedRunningTime="2026-06-13 01:20:06.794049743 +0000 UTC m=+541.410065572" Jun 13 01:20:06.808424 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:06.808362 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ncvrz" podStartSLOduration=0.756131049 podStartE2EDuration="2.808342407s" totalImagesPullingTime="2.052211358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:20:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:20:06.80676682 +0000 UTC m=+541.422782617" watchObservedRunningTime="2026-06-13 01:20:06.808342407 +0000 UTC m=+541.424358183" Jun 13 01:20:07.023872 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:07.023847 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ncvrz" Jun 13 01:20:07.162380 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:07.162341 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqqdq\" (UniqueName: \"kubernetes.io/projected/3bbaa547-3a62-4186-887d-9c26811b935e-kube-api-access-mqqdq\") pod \"3bbaa547-3a62-4186-887d-9c26811b935e\" (UID: \"3bbaa547-3a62-4186-887d-9c26811b935e\") " Jun 13 01:20:07.164522 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:07.164495 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bbaa547-3a62-4186-887d-9c26811b935e-kube-api-access-mqqdq" (OuterVolumeSpecName: "kube-api-access-mqqdq") pod "3bbaa547-3a62-4186-887d-9c26811b935e" (UID: "3bbaa547-3a62-4186-887d-9c26811b935e"). InnerVolumeSpecName "kube-api-access-mqqdq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:20:07.263535 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:07.263451 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqqdq\" (UniqueName: \"kubernetes.io/projected/3bbaa547-3a62-4186-887d-9c26811b935e-kube-api-access-mqqdq\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:20:07.786577 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:07.786545 2563 generic.go:356] "Generic (PLEG): container finished" podID="3bbaa547-3a62-4186-887d-9c26811b935e" containerID="92e4d06a65e862e8f73c3bd1f7d5d233ac1e6b36f687f837eec189331558c487" exitCode=0 Jun 13 01:20:07.787044 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:07.786597 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ncvrz" Jun 13 01:20:07.787044 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:07.786633 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ncvrz" event={"ID":"3bbaa547-3a62-4186-887d-9c26811b935e","Type":"ContainerDied","Data":"92e4d06a65e862e8f73c3bd1f7d5d233ac1e6b36f687f837eec189331558c487"} Jun 13 01:20:07.787044 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:07.786706 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ncvrz" event={"ID":"3bbaa547-3a62-4186-887d-9c26811b935e","Type":"ContainerDied","Data":"bec79daf60d3b022256ee0db66e3580daab7fdad754fa02c37fddbb6624bb960"} Jun 13 01:20:07.787044 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:07.786727 2563 scope.go:117] "RemoveContainer" containerID="92e4d06a65e862e8f73c3bd1f7d5d233ac1e6b36f687f837eec189331558c487" Jun 13 01:20:07.795968 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:07.795953 2563 scope.go:117] "RemoveContainer" containerID="92e4d06a65e862e8f73c3bd1f7d5d233ac1e6b36f687f837eec189331558c487" Jun 13 01:20:07.796256 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:20:07.796239 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92e4d06a65e862e8f73c3bd1f7d5d233ac1e6b36f687f837eec189331558c487\": container with ID starting with 92e4d06a65e862e8f73c3bd1f7d5d233ac1e6b36f687f837eec189331558c487 not found: ID does not exist" containerID="92e4d06a65e862e8f73c3bd1f7d5d233ac1e6b36f687f837eec189331558c487" Jun 13 01:20:07.796334 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:07.796262 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92e4d06a65e862e8f73c3bd1f7d5d233ac1e6b36f687f837eec189331558c487"} err="failed to get container status \"92e4d06a65e862e8f73c3bd1f7d5d233ac1e6b36f687f837eec189331558c487\": rpc error: code = NotFound desc = could not find container \"92e4d06a65e862e8f73c3bd1f7d5d233ac1e6b36f687f837eec189331558c487\": container with ID starting with 92e4d06a65e862e8f73c3bd1f7d5d233ac1e6b36f687f837eec189331558c487 not found: ID does not exist" Jun 13 01:20:07.807251 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:07.807228 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ncvrz"] Jun 13 01:20:07.811230 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:07.811206 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ncvrz"] Jun 13 01:20:07.851090 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:07.851053 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bbaa547-3a62-4186-887d-9c26811b935e" path="/var/lib/kubelet/pods/3bbaa547-3a62-4186-887d-9c26811b935e/volumes" Jun 13 01:20:15.041619 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:15.041561 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-sjw86" Jun 13 01:20:15.042012 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:15.041650 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-sjw86" Jun 13 01:20:15.063925 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:15.063896 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-sjw86" Jun 13 01:20:15.839997 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:15.839969 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-sjw86" Jun 13 01:20:22.290731 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:22.290691 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:20:22.344950 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:22.344913 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:20:33.677357 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:33.677316 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:20:36.292638 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:36.292590 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-r94pr"] Jun 13 01:20:36.293278 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:36.293256 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bbaa547-3a62-4186-887d-9c26811b935e" containerName="registry-server" Jun 13 01:20:36.293369 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:36.293281 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bbaa547-3a62-4186-887d-9c26811b935e" containerName="registry-server" Jun 13 01:20:36.293430 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:36.293403 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bbaa547-3a62-4186-887d-9c26811b935e" containerName="registry-server" Jun 13 01:20:36.300724 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:36.300699 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r94pr" Jun 13 01:20:36.305041 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:36.305012 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-r94pr"] Jun 13 01:20:36.305190 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:36.305022 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 13 01:20:36.305190 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:36.305075 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-m45fr\"" Jun 13 01:20:36.398029 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:36.397995 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ght5r\" (UniqueName: \"kubernetes.io/projected/70b78dfc-61a1-4744-8a8f-aca0858ac865-kube-api-access-ght5r\") pod \"dns-operator-controller-manager-864dd78c4c-r94pr\" (UID: \"70b78dfc-61a1-4744-8a8f-aca0858ac865\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r94pr" Jun 13 01:20:36.498457 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:36.498421 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ght5r\" (UniqueName: \"kubernetes.io/projected/70b78dfc-61a1-4744-8a8f-aca0858ac865-kube-api-access-ght5r\") pod \"dns-operator-controller-manager-864dd78c4c-r94pr\" (UID: \"70b78dfc-61a1-4744-8a8f-aca0858ac865\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r94pr" Jun 13 01:20:36.523105 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:36.523066 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ght5r\" (UniqueName: \"kubernetes.io/projected/70b78dfc-61a1-4744-8a8f-aca0858ac865-kube-api-access-ght5r\") pod \"dns-operator-controller-manager-864dd78c4c-r94pr\" (UID: \"70b78dfc-61a1-4744-8a8f-aca0858ac865\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r94pr" Jun 13 01:20:36.611442 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:36.611358 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r94pr" Jun 13 01:20:36.755113 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:36.755085 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-r94pr"] Jun 13 01:20:36.758442 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:20:36.758413 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70b78dfc_61a1_4744_8a8f_aca0858ac865.slice/crio-e5bc9b20fe80192f6cb65c1c507e05a8cedc821f48a3fb4bbd3104071fa21443 WatchSource:0}: Error finding container e5bc9b20fe80192f6cb65c1c507e05a8cedc821f48a3fb4bbd3104071fa21443: Status 404 returned error can't find the container with id e5bc9b20fe80192f6cb65c1c507e05a8cedc821f48a3fb4bbd3104071fa21443 Jun 13 01:20:36.899823 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:36.899739 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r94pr" event={"ID":"70b78dfc-61a1-4744-8a8f-aca0858ac865","Type":"ContainerStarted","Data":"e5bc9b20fe80192f6cb65c1c507e05a8cedc821f48a3fb4bbd3104071fa21443"} Jun 13 01:20:37.875226 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:37.875195 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:20:39.797181 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:39.797121 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8zlvn"] Jun 13 01:20:39.800444 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:39.800428 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8zlvn" Jun 13 01:20:39.802596 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:39.802576 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-m5qbw\"" Jun 13 01:20:39.811023 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:39.811001 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8zlvn"] Jun 13 01:20:39.914144 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:39.914088 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r94pr" event={"ID":"70b78dfc-61a1-4744-8a8f-aca0858ac865","Type":"ContainerStarted","Data":"3e7825eec6f3d33930996dbcf241b67499e0fa43fac64d9ada68b7ed3fb89296"} Jun 13 01:20:39.914314 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:39.914186 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r94pr" Jun 13 01:20:39.930564 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:39.930539 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kt94\" (UniqueName: \"kubernetes.io/projected/5a251e8d-662e-4379-8d27-61fb1e8daf49-kube-api-access-7kt94\") pod \"limitador-operator-controller-manager-859d7b78bd-8zlvn\" (UID: \"5a251e8d-662e-4379-8d27-61fb1e8daf49\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8zlvn" Jun 13 01:20:39.942426 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:39.942374 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r94pr" podStartSLOduration=1.473841805 podStartE2EDuration="3.942357696s" totalImagesPullingTime="2.468515891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:20:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:20:39.940272226 +0000 UTC m=+574.556288013" watchObservedRunningTime="2026-06-13 01:20:39.942357696 +0000 UTC m=+574.558373464" Jun 13 01:20:40.032753 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:40.032332 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kt94\" (UniqueName: \"kubernetes.io/projected/5a251e8d-662e-4379-8d27-61fb1e8daf49-kube-api-access-7kt94\") pod \"limitador-operator-controller-manager-859d7b78bd-8zlvn\" (UID: \"5a251e8d-662e-4379-8d27-61fb1e8daf49\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8zlvn" Jun 13 01:20:40.040723 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:40.040696 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kt94\" (UniqueName: \"kubernetes.io/projected/5a251e8d-662e-4379-8d27-61fb1e8daf49-kube-api-access-7kt94\") pod \"limitador-operator-controller-manager-859d7b78bd-8zlvn\" (UID: \"5a251e8d-662e-4379-8d27-61fb1e8daf49\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8zlvn" Jun 13 01:20:40.110787 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:40.110696 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8zlvn" Jun 13 01:20:40.251676 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:40.251555 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8zlvn"] Jun 13 01:20:40.254105 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:20:40.254068 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a251e8d_662e_4379_8d27_61fb1e8daf49.slice/crio-e15c255c8b19d989d5fe479fd52451aee8d74b058f573360651a076e67c94937 WatchSource:0}: Error finding container e15c255c8b19d989d5fe479fd52451aee8d74b058f573360651a076e67c94937: Status 404 returned error can't find the container with id e15c255c8b19d989d5fe479fd52451aee8d74b058f573360651a076e67c94937 Jun 13 01:20:40.390315 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:40.390233 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:20:40.516798 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:40.516761 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:20:40.920887 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:40.920846 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8zlvn" event={"ID":"5a251e8d-662e-4379-8d27-61fb1e8daf49","Type":"ContainerStarted","Data":"e15c255c8b19d989d5fe479fd52451aee8d74b058f573360651a076e67c94937"} Jun 13 01:20:41.769924 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:41.769890 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:20:42.932377 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:42.932345 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8zlvn" event={"ID":"5a251e8d-662e-4379-8d27-61fb1e8daf49","Type":"ContainerStarted","Data":"dca958fe7b46c82c7fd54ee30719abd591af7283dc19bb5cdd5e1318841bb8d3"} Jun 13 01:20:42.932770 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:42.932411 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8zlvn" Jun 13 01:20:42.950099 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:42.950046 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8zlvn" podStartSLOduration=2.221724372 podStartE2EDuration="3.950029988s" totalImagesPullingTime="1.728305616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:20:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:20:42.949077312 +0000 UTC m=+577.565093106" watchObservedRunningTime="2026-06-13 01:20:42.950029988 +0000 UTC m=+577.566045763" Jun 13 01:20:44.884213 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:44.884178 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:20:45.264785 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:45.264694 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:20:45.574983 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:45.574952 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:20:45.757112 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:45.757078 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:20:48.314300 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:48.314257 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:20:49.733534 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:49.733507 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:20:49.844146 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:49.844093 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:20:50.923618 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:50.923588 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-r94pr" Jun 13 01:20:53.457045 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:53.457008 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:20:53.939423 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:53.939384 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8zlvn" Jun 13 01:20:54.676872 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:54.676833 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:20:56.451841 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:56.451805 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:20:56.765732 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:56.765648 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:20:56.866118 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:56.866081 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:20:56.967262 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:20:56.967225 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:05.281842 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:05.281793 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:05.414082 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:05.414047 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:05.825257 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:05.825227 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ppvdn_e98f7500-070e-4c57-a4b0-a711e20b8c26/ovn-acl-logging/0.log" Jun 13 01:21:05.825257 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:05.825249 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ppvdn_e98f7500-070e-4c57-a4b0-a711e20b8c26/ovn-acl-logging/0.log" Jun 13 01:21:06.642710 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:06.642672 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z5sdd"] Jun 13 01:21:06.647142 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:06.647111 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z5sdd" Jun 13 01:21:06.649449 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:06.649431 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-bp66b\"" Jun 13 01:21:06.660981 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:06.660958 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z5sdd"] Jun 13 01:21:06.738288 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:06.738254 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z5sdd"] Jun 13 01:21:06.738533 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:21:06.738514 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-rh7vb], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z5sdd" podUID="3c3bb864-3950-4ab9-a4ca-fba47b715ebc" Jun 13 01:21:06.766942 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:06.766913 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh7vb\" (UniqueName: \"kubernetes.io/projected/3c3bb864-3950-4ab9-a4ca-fba47b715ebc-kube-api-access-rh7vb\") pod \"kuadrant-operator-controller-manager-55467d9f7-z5sdd\" (UID: \"3c3bb864-3950-4ab9-a4ca-fba47b715ebc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z5sdd" Jun 13 01:21:06.767090 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:06.766960 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c3bb864-3950-4ab9-a4ca-fba47b715ebc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-z5sdd\" (UID: \"3c3bb864-3950-4ab9-a4ca-fba47b715ebc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z5sdd" Jun 13 01:21:06.813594 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:06.813558 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z5sdd"] Jun 13 01:21:06.828746 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:06.828713 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z5sdd"] Jun 13 01:21:06.867833 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:06.867800 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh7vb\" (UniqueName: \"kubernetes.io/projected/3c3bb864-3950-4ab9-a4ca-fba47b715ebc-kube-api-access-rh7vb\") pod \"kuadrant-operator-controller-manager-55467d9f7-z5sdd\" (UID: \"3c3bb864-3950-4ab9-a4ca-fba47b715ebc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z5sdd" Jun 13 01:21:06.868015 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:06.867848 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c3bb864-3950-4ab9-a4ca-fba47b715ebc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-z5sdd\" (UID: \"3c3bb864-3950-4ab9-a4ca-fba47b715ebc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z5sdd" Jun 13 01:21:06.868233 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:06.868214 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c3bb864-3950-4ab9-a4ca-fba47b715ebc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-z5sdd\" (UID: \"3c3bb864-3950-4ab9-a4ca-fba47b715ebc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z5sdd" Jun 13 01:21:06.870662 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:21:06.870643 2563 projected.go:196] Error preparing data for projected volume kube-api-access-rh7vb for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z5sdd: failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-136-115.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-136-115.ec2.internal' and this object Jun 13 01:21:06.870758 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:21:06.870723 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c3bb864-3950-4ab9-a4ca-fba47b715ebc-kube-api-access-rh7vb podName:3c3bb864-3950-4ab9-a4ca-fba47b715ebc nodeName:}" failed. No retries permitted until 2026-06-13 01:21:07.370699684 +0000 UTC m=+601.986715441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rh7vb" (UniqueName: "kubernetes.io/projected/3c3bb864-3950-4ab9-a4ca-fba47b715ebc-kube-api-access-rh7vb") pod "kuadrant-operator-controller-manager-55467d9f7-z5sdd" (UID: "3c3bb864-3950-4ab9-a4ca-fba47b715ebc") : failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-136-115.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-136-115.ec2.internal' and this object Jun 13 01:21:06.883964 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:06.883932 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kp2gp"] Jun 13 01:21:06.887814 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:06.887789 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kp2gp" Jun 13 01:21:06.889091 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:06.889067 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8zlvn"] Jun 13 01:21:06.889309 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:06.889286 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8zlvn" podUID="5a251e8d-662e-4379-8d27-61fb1e8daf49" containerName="manager" containerID="cri-o://dca958fe7b46c82c7fd54ee30719abd591af7283dc19bb5cdd5e1318841bb8d3" gracePeriod=2 Jun 13 01:21:06.897024 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:06.896963 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8zlvn"] Jun 13 01:21:06.904749 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:06.904704 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kp2gp"] Jun 13 01:21:06.921808 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:06.921774 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmw54"] Jun 13 01:21:06.922278 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:06.922257 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a251e8d-662e-4379-8d27-61fb1e8daf49" containerName="manager" Jun 13 01:21:06.922278 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:06.922280 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a251e8d-662e-4379-8d27-61fb1e8daf49" containerName="manager" Jun 13 01:21:06.922438 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:06.922391 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a251e8d-662e-4379-8d27-61fb1e8daf49" containerName="manager" Jun 13 01:21:06.925653 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:06.925632 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmw54" Jun 13 01:21:06.938661 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:06.938629 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmw54"] Jun 13 01:21:06.952453 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:21:06.952421 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8zlvn\" is forbidden: User \"system:node:ip-10-0-136-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-115.ec2.internal' and this object" podUID="5a251e8d-662e-4379-8d27-61fb1e8daf49" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8zlvn" Jun 13 01:21:07.035659 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:07.035622 2563 generic.go:356] "Generic (PLEG): container finished" podID="5a251e8d-662e-4379-8d27-61fb1e8daf49" containerID="dca958fe7b46c82c7fd54ee30719abd591af7283dc19bb5cdd5e1318841bb8d3" exitCode=0 Jun 13 01:21:07.035821 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:07.035775 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z5sdd" Jun 13 01:21:07.037841 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:21:07.037811 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-z5sdd\" is forbidden: User \"system:node:ip-10-0-136-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-115.ec2.internal' and this object" podUID="3c3bb864-3950-4ab9-a4ca-fba47b715ebc" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z5sdd" Jun 13 01:21:07.039563 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:21:07.039538 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8zlvn\" is forbidden: User \"system:node:ip-10-0-136-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-115.ec2.internal' and this object" podUID="5a251e8d-662e-4379-8d27-61fb1e8daf49" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8zlvn" Jun 13 01:21:07.042793 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:07.042774 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z5sdd" Jun 13 01:21:07.044601 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:21:07.044580 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-z5sdd\" is forbidden: User \"system:node:ip-10-0-136-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-115.ec2.internal' and this object" podUID="3c3bb864-3950-4ab9-a4ca-fba47b715ebc" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z5sdd" Jun 13 01:21:07.046215 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:21:07.046191 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8zlvn\" is forbidden: User \"system:node:ip-10-0-136-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-115.ec2.internal' and this object" podUID="5a251e8d-662e-4379-8d27-61fb1e8daf49" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8zlvn" Jun 13 01:21:07.069761 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:07.069698 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aca7016d-e228-443e-a06c-e90104d21420-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kp2gp\" (UID: \"aca7016d-e228-443e-a06c-e90104d21420\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kp2gp" Jun 13 01:21:07.069761 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:07.069752 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsd27\" (UniqueName: \"kubernetes.io/projected/aca7016d-e228-443e-a06c-e90104d21420-kube-api-access-wsd27\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kp2gp\" (UID: \"aca7016d-e228-443e-a06c-e90104d21420\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kp2gp" Jun 13 01:21:07.069996 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:07.069899 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzg78\" (UniqueName: \"kubernetes.io/projected/749bcb61-8793-430d-8f71-9deeb5ac34a2-kube-api-access-qzg78\") pod \"limitador-operator-controller-manager-859d7b78bd-zmw54\" (UID: \"749bcb61-8793-430d-8f71-9deeb5ac34a2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmw54" Jun 13 01:21:07.123218 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:07.123191 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8zlvn" Jun 13 01:21:07.125380 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:21:07.125354 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8zlvn\" is forbidden: User \"system:node:ip-10-0-136-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-115.ec2.internal' and this object" podUID="5a251e8d-662e-4379-8d27-61fb1e8daf49" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8zlvn" Jun 13 01:21:07.127181 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:21:07.127159 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-z5sdd\" is forbidden: User \"system:node:ip-10-0-136-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-115.ec2.internal' and this object" podUID="3c3bb864-3950-4ab9-a4ca-fba47b715ebc" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z5sdd" Jun 13 01:21:07.171080 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:07.171012 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c3bb864-3950-4ab9-a4ca-fba47b715ebc-extensions-socket-volume\") pod \"3c3bb864-3950-4ab9-a4ca-fba47b715ebc\" (UID: \"3c3bb864-3950-4ab9-a4ca-fba47b715ebc\") " Jun 13 01:21:07.171245 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:07.171223 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aca7016d-e228-443e-a06c-e90104d21420-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kp2gp\" (UID: \"aca7016d-e228-443e-a06c-e90104d21420\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kp2gp" Jun 13 01:21:07.171292 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:07.171276 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsd27\" (UniqueName: \"kubernetes.io/projected/aca7016d-e228-443e-a06c-e90104d21420-kube-api-access-wsd27\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kp2gp\" (UID: \"aca7016d-e228-443e-a06c-e90104d21420\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kp2gp" Jun 13 01:21:07.171328 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:07.171290 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c3bb864-3950-4ab9-a4ca-fba47b715ebc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3c3bb864-3950-4ab9-a4ca-fba47b715ebc" (UID: "3c3bb864-3950-4ab9-a4ca-fba47b715ebc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:21:07.171405 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:07.171391 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzg78\" (UniqueName: \"kubernetes.io/projected/749bcb61-8793-430d-8f71-9deeb5ac34a2-kube-api-access-qzg78\") pod \"limitador-operator-controller-manager-859d7b78bd-zmw54\" (UID: \"749bcb61-8793-430d-8f71-9deeb5ac34a2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmw54" Jun 13 01:21:07.171481 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:07.171460 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rh7vb\" (UniqueName: \"kubernetes.io/projected/3c3bb864-3950-4ab9-a4ca-fba47b715ebc-kube-api-access-rh7vb\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:21:07.171532 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:07.171477 2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c3bb864-3950-4ab9-a4ca-fba47b715ebc-extensions-socket-volume\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:21:07.171591 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:07.171568 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aca7016d-e228-443e-a06c-e90104d21420-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kp2gp\" (UID: \"aca7016d-e228-443e-a06c-e90104d21420\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kp2gp" Jun 13 01:21:07.179442 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:07.179412 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzg78\" (UniqueName: \"kubernetes.io/projected/749bcb61-8793-430d-8f71-9deeb5ac34a2-kube-api-access-qzg78\") pod \"limitador-operator-controller-manager-859d7b78bd-zmw54\" (UID: \"749bcb61-8793-430d-8f71-9deeb5ac34a2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmw54" Jun 13 01:21:07.179442 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:07.179413 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsd27\" (UniqueName: \"kubernetes.io/projected/aca7016d-e228-443e-a06c-e90104d21420-kube-api-access-wsd27\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kp2gp\" (UID: \"aca7016d-e228-443e-a06c-e90104d21420\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kp2gp" Jun 13 01:21:07.247969 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:07.247922 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kp2gp" Jun 13 01:21:07.259186 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:07.259152 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmw54" Jun 13 01:21:07.272391 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:07.272364 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kt94\" (UniqueName: \"kubernetes.io/projected/5a251e8d-662e-4379-8d27-61fb1e8daf49-kube-api-access-7kt94\") pod \"5a251e8d-662e-4379-8d27-61fb1e8daf49\" (UID: \"5a251e8d-662e-4379-8d27-61fb1e8daf49\") " Jun 13 01:21:07.274335 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:07.274304 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a251e8d-662e-4379-8d27-61fb1e8daf49-kube-api-access-7kt94" (OuterVolumeSpecName: "kube-api-access-7kt94") pod "5a251e8d-662e-4379-8d27-61fb1e8daf49" (UID: "5a251e8d-662e-4379-8d27-61fb1e8daf49"). InnerVolumeSpecName "kube-api-access-7kt94". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:21:07.373571 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:07.373538 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kt94\" (UniqueName: \"kubernetes.io/projected/5a251e8d-662e-4379-8d27-61fb1e8daf49-kube-api-access-7kt94\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:21:07.393781 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:07.393746 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kp2gp"] Jun 13 01:21:07.397088 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:21:07.397061 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaca7016d_e228_443e_a06c_e90104d21420.slice/crio-70d813343341b0f07ceaaa8d5737a58adadd9b1d4f0b0556b6f3cfb8d0b48ac9 WatchSource:0}: Error finding container 70d813343341b0f07ceaaa8d5737a58adadd9b1d4f0b0556b6f3cfb8d0b48ac9: Status 404 returned error can't find the container with id 70d813343341b0f07ceaaa8d5737a58adadd9b1d4f0b0556b6f3cfb8d0b48ac9 Jun 13 01:21:07.412245 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:07.412219 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmw54"] Jun 13 01:21:07.416092 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:21:07.416068 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod749bcb61_8793_430d_8f71_9deeb5ac34a2.slice/crio-2500ec2a6abfca58a419b992d0e360d7b4c828d7b649e35288d44e5bb5453bd0 WatchSource:0}: Error finding container 2500ec2a6abfca58a419b992d0e360d7b4c828d7b649e35288d44e5bb5453bd0: Status 404 returned error can't find the container with id 2500ec2a6abfca58a419b992d0e360d7b4c828d7b649e35288d44e5bb5453bd0 Jun 13 01:21:07.853110 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:07.853081 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c3bb864-3950-4ab9-a4ca-fba47b715ebc" path="/var/lib/kubelet/pods/3c3bb864-3950-4ab9-a4ca-fba47b715ebc/volumes" Jun 13 01:21:07.853465 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:07.853329 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a251e8d-662e-4379-8d27-61fb1e8daf49" path="/var/lib/kubelet/pods/5a251e8d-662e-4379-8d27-61fb1e8daf49/volumes" Jun 13 01:21:07.902603 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:07.902569 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:07.997686 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:07.997653 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:08.041180 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:08.041120 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8zlvn" Jun 13 01:21:08.041180 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:08.041173 2563 scope.go:117] "RemoveContainer" containerID="dca958fe7b46c82c7fd54ee30719abd591af7283dc19bb5cdd5e1318841bb8d3" Jun 13 01:21:08.042775 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:08.042750 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmw54" event={"ID":"749bcb61-8793-430d-8f71-9deeb5ac34a2","Type":"ContainerStarted","Data":"a779e1344eb684fb2afbb1bf25bd1552e40b273a051ea270f9d481a76c45ecfd"} Jun 13 01:21:08.042900 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:08.042796 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmw54" event={"ID":"749bcb61-8793-430d-8f71-9deeb5ac34a2","Type":"ContainerStarted","Data":"2500ec2a6abfca58a419b992d0e360d7b4c828d7b649e35288d44e5bb5453bd0"} Jun 13 01:21:08.042900 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:08.042857 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmw54" Jun 13 01:21:08.044686 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:08.044661 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z5sdd" Jun 13 01:21:08.044686 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:08.044663 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kp2gp" event={"ID":"aca7016d-e228-443e-a06c-e90104d21420","Type":"ContainerStarted","Data":"70d813343341b0f07ceaaa8d5737a58adadd9b1d4f0b0556b6f3cfb8d0b48ac9"} Jun 13 01:21:08.073031 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:08.072980 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmw54" podStartSLOduration=2.072964081 podStartE2EDuration="2.072964081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:21:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:21:08.071423037 +0000 UTC m=+602.687438811" watchObservedRunningTime="2026-06-13 01:21:08.072964081 +0000 UTC m=+602.688979856" Jun 13 01:21:08.073442 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:21:08.073417 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-z5sdd\" is forbidden: User \"system:node:ip-10-0-136-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-115.ec2.internal' and this object" podUID="3c3bb864-3950-4ab9-a4ca-fba47b715ebc" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z5sdd" Jun 13 01:21:10.722723 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:10.722680 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:10.828467 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:10.828437 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:14.075298 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:14.075255 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kp2gp" event={"ID":"aca7016d-e228-443e-a06c-e90104d21420","Type":"ContainerStarted","Data":"5549ad10ae9c599b597a4a9a63a69923f4e1b9ac37725c461c5343c19df54d30"} Jun 13 01:21:14.075689 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:14.075411 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kp2gp" Jun 13 01:21:14.109112 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:14.109060 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kp2gp" podStartSLOduration=1.726635924 podStartE2EDuration="8.109044165s" totalImagesPullingTime="6.382408241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:21:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:21:14.107428835 +0000 UTC m=+608.723444601" watchObservedRunningTime="2026-06-13 01:21:14.109044165 +0000 UTC m=+608.725059939" Jun 13 01:21:14.414776 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:14.414691 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:14.510700 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:14.510643 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:19.053176 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:19.053118 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmw54" Jun 13 01:21:19.217021 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:19.216980 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kp2gp"] Jun 13 01:21:19.217229 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:19.217185 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kp2gp" podUID="aca7016d-e228-443e-a06c-e90104d21420" containerName="manager" containerID="cri-o://5549ad10ae9c599b597a4a9a63a69923f4e1b9ac37725c461c5343c19df54d30" gracePeriod=10 Jun 13 01:21:19.219059 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:19.219034 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kp2gp" Jun 13 01:21:19.466663 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:19.466638 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kp2gp" Jun 13 01:21:19.574323 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:19.574284 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aca7016d-e228-443e-a06c-e90104d21420-extensions-socket-volume\") pod \"aca7016d-e228-443e-a06c-e90104d21420\" (UID: \"aca7016d-e228-443e-a06c-e90104d21420\") " Jun 13 01:21:19.574521 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:19.574354 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsd27\" (UniqueName: \"kubernetes.io/projected/aca7016d-e228-443e-a06c-e90104d21420-kube-api-access-wsd27\") pod \"aca7016d-e228-443e-a06c-e90104d21420\" (UID: \"aca7016d-e228-443e-a06c-e90104d21420\") " Jun 13 01:21:19.574864 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:19.574835 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aca7016d-e228-443e-a06c-e90104d21420-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "aca7016d-e228-443e-a06c-e90104d21420" (UID: "aca7016d-e228-443e-a06c-e90104d21420"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:21:19.576507 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:19.576475 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aca7016d-e228-443e-a06c-e90104d21420-kube-api-access-wsd27" (OuterVolumeSpecName: "kube-api-access-wsd27") pod "aca7016d-e228-443e-a06c-e90104d21420" (UID: "aca7016d-e228-443e-a06c-e90104d21420"). InnerVolumeSpecName "kube-api-access-wsd27". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:21:19.675474 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:19.675377 2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aca7016d-e228-443e-a06c-e90104d21420-extensions-socket-volume\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:21:19.675474 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:19.675412 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsd27\" (UniqueName: \"kubernetes.io/projected/aca7016d-e228-443e-a06c-e90104d21420-kube-api-access-wsd27\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:21:20.102062 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:20.102024 2563 generic.go:356] "Generic (PLEG): container finished" podID="aca7016d-e228-443e-a06c-e90104d21420" containerID="5549ad10ae9c599b597a4a9a63a69923f4e1b9ac37725c461c5343c19df54d30" exitCode=0 Jun 13 01:21:20.102522 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:20.102060 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kp2gp" event={"ID":"aca7016d-e228-443e-a06c-e90104d21420","Type":"ContainerDied","Data":"5549ad10ae9c599b597a4a9a63a69923f4e1b9ac37725c461c5343c19df54d30"} Jun 13 01:21:20.102522 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:20.102086 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kp2gp" Jun 13 01:21:20.102522 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:20.102120 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kp2gp" event={"ID":"aca7016d-e228-443e-a06c-e90104d21420","Type":"ContainerDied","Data":"70d813343341b0f07ceaaa8d5737a58adadd9b1d4f0b0556b6f3cfb8d0b48ac9"} Jun 13 01:21:20.102522 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:20.102165 2563 scope.go:117] "RemoveContainer" containerID="5549ad10ae9c599b597a4a9a63a69923f4e1b9ac37725c461c5343c19df54d30" Jun 13 01:21:20.110328 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:20.110307 2563 scope.go:117] "RemoveContainer" containerID="5549ad10ae9c599b597a4a9a63a69923f4e1b9ac37725c461c5343c19df54d30" Jun 13 01:21:20.110597 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:21:20.110578 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5549ad10ae9c599b597a4a9a63a69923f4e1b9ac37725c461c5343c19df54d30\": container with ID starting with 5549ad10ae9c599b597a4a9a63a69923f4e1b9ac37725c461c5343c19df54d30 not found: ID does not exist" containerID="5549ad10ae9c599b597a4a9a63a69923f4e1b9ac37725c461c5343c19df54d30" Jun 13 01:21:20.110643 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:20.110606 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5549ad10ae9c599b597a4a9a63a69923f4e1b9ac37725c461c5343c19df54d30"} err="failed to get container status \"5549ad10ae9c599b597a4a9a63a69923f4e1b9ac37725c461c5343c19df54d30\": rpc error: code = NotFound desc = could not find container \"5549ad10ae9c599b597a4a9a63a69923f4e1b9ac37725c461c5343c19df54d30\": container with ID starting with 5549ad10ae9c599b597a4a9a63a69923f4e1b9ac37725c461c5343c19df54d30 not found: ID does not exist" Jun 13 01:21:20.130541 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:20.130502 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kp2gp"] Jun 13 01:21:20.134113 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:20.134090 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kp2gp"] Jun 13 01:21:21.851911 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:21.851879 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aca7016d-e228-443e-a06c-e90104d21420" path="/var/lib/kubelet/pods/aca7016d-e228-443e-a06c-e90104d21420/volumes" Jun 13 01:21:23.104586 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:23.104547 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:23.205046 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:23.205009 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:25.741655 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:25.741548 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:25.853897 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:25.853840 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:28.925954 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:28.925917 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:29.019001 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:29.018961 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:32.713549 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:32.713518 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:32.775896 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:32.775859 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:35.552049 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.552018 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f"] Jun 13 01:21:35.552446 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.552347 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aca7016d-e228-443e-a06c-e90104d21420" containerName="manager" Jun 13 01:21:35.552446 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.552360 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="aca7016d-e228-443e-a06c-e90104d21420" containerName="manager" Jun 13 01:21:35.552446 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.552408 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="aca7016d-e228-443e-a06c-e90104d21420" containerName="manager" Jun 13 01:21:35.555538 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.555521 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:35.557746 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.557718 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-tltnf\"" Jun 13 01:21:35.567956 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.567934 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f"] Jun 13 01:21:35.584470 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.584445 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:35.604670 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.604643 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96b81e41-cc93-445d-86a5-fa69336708c4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-8tk7f\" (UID: \"96b81e41-cc93-445d-86a5-fa69336708c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:35.604784 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.604680 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96b81e41-cc93-445d-86a5-fa69336708c4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-8tk7f\" (UID: \"96b81e41-cc93-445d-86a5-fa69336708c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:35.604784 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.604704 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96b81e41-cc93-445d-86a5-fa69336708c4-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-8tk7f\" (UID: \"96b81e41-cc93-445d-86a5-fa69336708c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:35.604861 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.604787 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96b81e41-cc93-445d-86a5-fa69336708c4-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-8tk7f\" (UID: \"96b81e41-cc93-445d-86a5-fa69336708c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:35.604861 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.604819 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjl49\" (UniqueName: \"kubernetes.io/projected/96b81e41-cc93-445d-86a5-fa69336708c4-kube-api-access-mjl49\") pod \"maas-default-gateway-openshift-default-8559cd5744-8tk7f\" (UID: \"96b81e41-cc93-445d-86a5-fa69336708c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:35.604861 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.604850 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96b81e41-cc93-445d-86a5-fa69336708c4-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-8tk7f\" (UID: \"96b81e41-cc93-445d-86a5-fa69336708c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:35.604959 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.604884 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96b81e41-cc93-445d-86a5-fa69336708c4-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-8tk7f\" (UID: \"96b81e41-cc93-445d-86a5-fa69336708c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:35.604959 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.604900 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96b81e41-cc93-445d-86a5-fa69336708c4-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-8tk7f\" (UID: \"96b81e41-cc93-445d-86a5-fa69336708c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:35.604959 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.604935 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96b81e41-cc93-445d-86a5-fa69336708c4-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-8tk7f\" (UID: \"96b81e41-cc93-445d-86a5-fa69336708c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:35.705787 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.705749 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96b81e41-cc93-445d-86a5-fa69336708c4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-8tk7f\" (UID: \"96b81e41-cc93-445d-86a5-fa69336708c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:35.705787 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.705791 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96b81e41-cc93-445d-86a5-fa69336708c4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-8tk7f\" (UID: \"96b81e41-cc93-445d-86a5-fa69336708c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:35.706031 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.705830 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96b81e41-cc93-445d-86a5-fa69336708c4-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-8tk7f\" (UID: \"96b81e41-cc93-445d-86a5-fa69336708c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:35.706031 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.705874 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96b81e41-cc93-445d-86a5-fa69336708c4-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-8tk7f\" (UID: \"96b81e41-cc93-445d-86a5-fa69336708c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:35.706031 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.705909 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjl49\" (UniqueName: \"kubernetes.io/projected/96b81e41-cc93-445d-86a5-fa69336708c4-kube-api-access-mjl49\") pod \"maas-default-gateway-openshift-default-8559cd5744-8tk7f\" (UID: \"96b81e41-cc93-445d-86a5-fa69336708c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:35.706031 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.705944 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96b81e41-cc93-445d-86a5-fa69336708c4-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-8tk7f\" (UID: \"96b81e41-cc93-445d-86a5-fa69336708c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:35.706031 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.705985 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96b81e41-cc93-445d-86a5-fa69336708c4-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-8tk7f\" (UID: \"96b81e41-cc93-445d-86a5-fa69336708c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:35.706364 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.706331 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96b81e41-cc93-445d-86a5-fa69336708c4-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-8tk7f\" (UID: \"96b81e41-cc93-445d-86a5-fa69336708c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:35.706441 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.706406 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96b81e41-cc93-445d-86a5-fa69336708c4-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-8tk7f\" (UID: \"96b81e41-cc93-445d-86a5-fa69336708c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:35.706498 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.706442 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96b81e41-cc93-445d-86a5-fa69336708c4-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-8tk7f\" (UID: \"96b81e41-cc93-445d-86a5-fa69336708c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:35.706498 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.706472 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96b81e41-cc93-445d-86a5-fa69336708c4-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-8tk7f\" (UID: \"96b81e41-cc93-445d-86a5-fa69336708c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:35.706609 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.706545 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96b81e41-cc93-445d-86a5-fa69336708c4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-8tk7f\" (UID: \"96b81e41-cc93-445d-86a5-fa69336708c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:35.706681 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.706661 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96b81e41-cc93-445d-86a5-fa69336708c4-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-8tk7f\" (UID: \"96b81e41-cc93-445d-86a5-fa69336708c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:35.706768 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.706749 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96b81e41-cc93-445d-86a5-fa69336708c4-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-8tk7f\" (UID: \"96b81e41-cc93-445d-86a5-fa69336708c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:35.708378 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.708359 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96b81e41-cc93-445d-86a5-fa69336708c4-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-8tk7f\" (UID: \"96b81e41-cc93-445d-86a5-fa69336708c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:35.708613 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.708591 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96b81e41-cc93-445d-86a5-fa69336708c4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-8tk7f\" (UID: \"96b81e41-cc93-445d-86a5-fa69336708c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:35.716935 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.716907 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96b81e41-cc93-445d-86a5-fa69336708c4-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-8tk7f\" (UID: \"96b81e41-cc93-445d-86a5-fa69336708c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:35.717292 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.717270 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjl49\" (UniqueName: \"kubernetes.io/projected/96b81e41-cc93-445d-86a5-fa69336708c4-kube-api-access-mjl49\") pod \"maas-default-gateway-openshift-default-8559cd5744-8tk7f\" (UID: \"96b81e41-cc93-445d-86a5-fa69336708c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:35.865595 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:35.865510 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:36.014618 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:21:36.014579 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96b81e41_cc93_445d_86a5_fa69336708c4.slice/crio-b50323d7caca7dbba02e93389c022e1aa895773d2a09b9c983d31af4419b4401 WatchSource:0}: Error finding container b50323d7caca7dbba02e93389c022e1aa895773d2a09b9c983d31af4419b4401: Status 404 returned error can't find the container with id b50323d7caca7dbba02e93389c022e1aa895773d2a09b9c983d31af4419b4401 Jun 13 01:21:36.016685 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:36.016661 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f"] Jun 13 01:21:36.016777 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:36.016677 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 13 01:21:36.016777 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:36.016736 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 13 01:21:36.016777 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:36.016763 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 13 01:21:36.080338 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:36.080307 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:36.173498 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:36.173400 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" event={"ID":"96b81e41-cc93-445d-86a5-fa69336708c4","Type":"ContainerStarted","Data":"23ea7d9f3006221a23f9679f8f220a3023640df04ca99c4a553e8c0bf2868e86"} Jun 13 01:21:36.173498 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:36.173464 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" event={"ID":"96b81e41-cc93-445d-86a5-fa69336708c4","Type":"ContainerStarted","Data":"b50323d7caca7dbba02e93389c022e1aa895773d2a09b9c983d31af4419b4401"} Jun 13 01:21:36.195895 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:36.195834 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" podStartSLOduration=1.195819225 podStartE2EDuration="1.195819225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:21:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:21:36.194203617 +0000 UTC m=+630.810219407" watchObservedRunningTime="2026-06-13 01:21:36.195819225 +0000 UTC m=+630.811835000" Jun 13 01:21:36.865821 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:36.865791 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:37.211727 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:37.211595 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:37.225184 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:37.225154 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5tkdw"] Jun 13 01:21:37.230241 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:37.230212 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5tkdw" Jun 13 01:21:37.232578 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:37.232558 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 13 01:21:37.233118 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:37.233098 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gnhtx\"" Jun 13 01:21:37.241538 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:37.241514 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5tkdw"] Jun 13 01:21:37.321345 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:37.321301 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b630d1f5-24ab-480b-8cc9-96bbb557ccae-config-file\") pod \"limitador-limitador-64c94fd64f-5tkdw\" (UID: \"b630d1f5-24ab-480b-8cc9-96bbb557ccae\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5tkdw" Jun 13 01:21:37.321595 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:37.321545 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwslp\" (UniqueName: \"kubernetes.io/projected/b630d1f5-24ab-480b-8cc9-96bbb557ccae-kube-api-access-pwslp\") pod \"limitador-limitador-64c94fd64f-5tkdw\" (UID: \"b630d1f5-24ab-480b-8cc9-96bbb557ccae\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5tkdw" Jun 13 01:21:37.323844 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:37.323816 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5tkdw"] Jun 13 01:21:37.334555 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:37.334526 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:37.422975 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:37.422938 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwslp\" (UniqueName: \"kubernetes.io/projected/b630d1f5-24ab-480b-8cc9-96bbb557ccae-kube-api-access-pwslp\") pod \"limitador-limitador-64c94fd64f-5tkdw\" (UID: \"b630d1f5-24ab-480b-8cc9-96bbb557ccae\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5tkdw" Jun 13 01:21:37.422975 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:37.422975 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b630d1f5-24ab-480b-8cc9-96bbb557ccae-config-file\") pod \"limitador-limitador-64c94fd64f-5tkdw\" (UID: \"b630d1f5-24ab-480b-8cc9-96bbb557ccae\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5tkdw" Jun 13 01:21:37.423653 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:37.423635 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b630d1f5-24ab-480b-8cc9-96bbb557ccae-config-file\") pod \"limitador-limitador-64c94fd64f-5tkdw\" (UID: \"b630d1f5-24ab-480b-8cc9-96bbb557ccae\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5tkdw" Jun 13 01:21:37.431198 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:37.431172 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwslp\" (UniqueName: \"kubernetes.io/projected/b630d1f5-24ab-480b-8cc9-96bbb557ccae-kube-api-access-pwslp\") pod \"limitador-limitador-64c94fd64f-5tkdw\" (UID: \"b630d1f5-24ab-480b-8cc9-96bbb557ccae\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5tkdw" Jun 13 01:21:37.436789 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:37.436754 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:37.542534 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:37.542491 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5tkdw" Jun 13 01:21:37.670861 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:37.670775 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5tkdw"] Jun 13 01:21:37.673548 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:21:37.673508 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb630d1f5_24ab_480b_8cc9_96bbb557ccae.slice/crio-fb3063934251441abb8b422024341967fd91e59624255b5d454c2f653227b3e2 WatchSource:0}: Error finding container fb3063934251441abb8b422024341967fd91e59624255b5d454c2f653227b3e2: Status 404 returned error can't find the container with id fb3063934251441abb8b422024341967fd91e59624255b5d454c2f653227b3e2 Jun 13 01:21:37.871852 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:37.871776 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:38.013008 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:38.012972 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-mrkbv"] Jun 13 01:21:38.017448 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:38.017432 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mrkbv" Jun 13 01:21:38.019559 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:38.019534 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-m9lqh\"" Jun 13 01:21:38.026208 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:38.026187 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mrkbv"] Jun 13 01:21:38.054505 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:38.054470 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:38.121202 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:38.121164 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:38.130026 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:38.129946 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhw5x\" (UniqueName: \"kubernetes.io/projected/092fe974-1379-47ee-8325-dc6fc83a964b-kube-api-access-fhw5x\") pod \"authorino-58cd955675-mrkbv\" (UID: \"092fe974-1379-47ee-8325-dc6fc83a964b\") " pod="kuadrant-system/authorino-58cd955675-mrkbv" Jun 13 01:21:38.183051 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:38.183015 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5tkdw" event={"ID":"b630d1f5-24ab-480b-8cc9-96bbb557ccae","Type":"ContainerStarted","Data":"fb3063934251441abb8b422024341967fd91e59624255b5d454c2f653227b3e2"} Jun 13 01:21:38.183335 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:38.183315 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:38.184435 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:38.184414 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:21:38.230861 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:38.230813 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhw5x\" (UniqueName: \"kubernetes.io/projected/092fe974-1379-47ee-8325-dc6fc83a964b-kube-api-access-fhw5x\") pod \"authorino-58cd955675-mrkbv\" (UID: \"092fe974-1379-47ee-8325-dc6fc83a964b\") " pod="kuadrant-system/authorino-58cd955675-mrkbv" Jun 13 01:21:38.242534 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:38.242501 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhw5x\" (UniqueName: \"kubernetes.io/projected/092fe974-1379-47ee-8325-dc6fc83a964b-kube-api-access-fhw5x\") pod \"authorino-58cd955675-mrkbv\" (UID: \"092fe974-1379-47ee-8325-dc6fc83a964b\") " pod="kuadrant-system/authorino-58cd955675-mrkbv" Jun 13 01:21:38.327519 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:38.327486 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mrkbv" Jun 13 01:21:38.490587 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:38.490550 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mrkbv"] Jun 13 01:21:38.494468 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:21:38.494435 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod092fe974_1379_47ee_8325_dc6fc83a964b.slice/crio-41be1c38040a5211eb23e951f6bad8d0d7fe9a265787ff70a2b28dc618fd638a WatchSource:0}: Error finding container 41be1c38040a5211eb23e951f6bad8d0d7fe9a265787ff70a2b28dc618fd638a: Status 404 returned error can't find the container with id 41be1c38040a5211eb23e951f6bad8d0d7fe9a265787ff70a2b28dc618fd638a Jun 13 01:21:39.189517 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:39.189480 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mrkbv" event={"ID":"092fe974-1379-47ee-8325-dc6fc83a964b","Type":"ContainerStarted","Data":"41be1c38040a5211eb23e951f6bad8d0d7fe9a265787ff70a2b28dc618fd638a"} Jun 13 01:21:42.512332 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:42.512293 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:42.609741 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:42.609643 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:43.107758 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:43.107724 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:43.213719 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:43.213676 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5tkdw" event={"ID":"b630d1f5-24ab-480b-8cc9-96bbb557ccae","Type":"ContainerStarted","Data":"d13517eabb4ecb5533f8c1729b9a697835094187c9c9aaf041c02c3476c9e726"} Jun 13 01:21:43.213913 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:43.213758 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-5tkdw" Jun 13 01:21:43.215214 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:43.215180 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mrkbv" event={"ID":"092fe974-1379-47ee-8325-dc6fc83a964b","Type":"ContainerStarted","Data":"e3c8fce4cc4cf5a1c29ff41c019f312a70e952a8f47d4f03c71f69692369b77f"} Jun 13 01:21:43.235916 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:43.235889 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:43.243790 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:43.243754 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-5tkdw" podStartSLOduration=1.624542168 podStartE2EDuration="6.243738132s" totalImagesPullingTime="4.619195964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:21:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:21:43.242636032 +0000 UTC m=+637.858651806" watchObservedRunningTime="2026-06-13 01:21:43.243738132 +0000 UTC m=+637.859753906" Jun 13 01:21:43.260208 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:43.260161 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-mrkbv" podStartSLOduration=2.418104702 podStartE2EDuration="6.260146169s" totalImagesPullingTime="3.842041467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:21:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:21:43.258899447 +0000 UTC m=+637.874915234" watchObservedRunningTime="2026-06-13 01:21:43.260146169 +0000 UTC m=+637.876161938" Jun 13 01:21:44.419281 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:44.419195 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mrkbv"] Jun 13 01:21:45.224446 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:45.224405 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-mrkbv" podUID="092fe974-1379-47ee-8325-dc6fc83a964b" containerName="authorino" containerID="cri-o://e3c8fce4cc4cf5a1c29ff41c019f312a70e952a8f47d4f03c71f69692369b77f" gracePeriod=30 Jun 13 01:21:45.466552 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:45.466528 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mrkbv" Jun 13 01:21:45.600620 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:45.600587 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhw5x\" (UniqueName: \"kubernetes.io/projected/092fe974-1379-47ee-8325-dc6fc83a964b-kube-api-access-fhw5x\") pod \"092fe974-1379-47ee-8325-dc6fc83a964b\" (UID: \"092fe974-1379-47ee-8325-dc6fc83a964b\") " Jun 13 01:21:45.602817 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:45.602782 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/092fe974-1379-47ee-8325-dc6fc83a964b-kube-api-access-fhw5x" (OuterVolumeSpecName: "kube-api-access-fhw5x") pod "092fe974-1379-47ee-8325-dc6fc83a964b" (UID: "092fe974-1379-47ee-8325-dc6fc83a964b"). InnerVolumeSpecName "kube-api-access-fhw5x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:21:45.701210 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:45.701174 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhw5x\" (UniqueName: \"kubernetes.io/projected/092fe974-1379-47ee-8325-dc6fc83a964b-kube-api-access-fhw5x\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:21:46.230199 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:46.230091 2563 generic.go:356] "Generic (PLEG): container finished" podID="092fe974-1379-47ee-8325-dc6fc83a964b" containerID="e3c8fce4cc4cf5a1c29ff41c019f312a70e952a8f47d4f03c71f69692369b77f" exitCode=0 Jun 13 01:21:46.230199 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:46.230160 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mrkbv" Jun 13 01:21:46.230199 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:46.230186 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mrkbv" event={"ID":"092fe974-1379-47ee-8325-dc6fc83a964b","Type":"ContainerDied","Data":"e3c8fce4cc4cf5a1c29ff41c019f312a70e952a8f47d4f03c71f69692369b77f"} Jun 13 01:21:46.230471 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:46.230243 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mrkbv" event={"ID":"092fe974-1379-47ee-8325-dc6fc83a964b","Type":"ContainerDied","Data":"41be1c38040a5211eb23e951f6bad8d0d7fe9a265787ff70a2b28dc618fd638a"} Jun 13 01:21:46.230471 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:46.230266 2563 scope.go:117] "RemoveContainer" containerID="e3c8fce4cc4cf5a1c29ff41c019f312a70e952a8f47d4f03c71f69692369b77f" Jun 13 01:21:46.238445 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:46.238424 2563 scope.go:117] "RemoveContainer" containerID="e3c8fce4cc4cf5a1c29ff41c019f312a70e952a8f47d4f03c71f69692369b77f" Jun 13 01:21:46.238729 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:21:46.238710 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3c8fce4cc4cf5a1c29ff41c019f312a70e952a8f47d4f03c71f69692369b77f\": container with ID starting with e3c8fce4cc4cf5a1c29ff41c019f312a70e952a8f47d4f03c71f69692369b77f not found: ID does not exist" containerID="e3c8fce4cc4cf5a1c29ff41c019f312a70e952a8f47d4f03c71f69692369b77f" Jun 13 01:21:46.238815 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:46.238735 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3c8fce4cc4cf5a1c29ff41c019f312a70e952a8f47d4f03c71f69692369b77f"} err="failed to get container status \"e3c8fce4cc4cf5a1c29ff41c019f312a70e952a8f47d4f03c71f69692369b77f\": rpc error: code = NotFound desc = could not find container \"e3c8fce4cc4cf5a1c29ff41c019f312a70e952a8f47d4f03c71f69692369b77f\": container with ID starting with e3c8fce4cc4cf5a1c29ff41c019f312a70e952a8f47d4f03c71f69692369b77f not found: ID does not exist" Jun 13 01:21:46.247337 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:46.247313 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mrkbv"] Jun 13 01:21:46.251075 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:46.251053 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-mrkbv"] Jun 13 01:21:47.852035 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:47.851988 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="092fe974-1379-47ee-8325-dc6fc83a964b" path="/var/lib/kubelet/pods/092fe974-1379-47ee-8325-dc6fc83a964b/volumes" Jun 13 01:21:52.877105 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:52.877068 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:52.933819 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:52.933785 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:54.221478 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:54.221439 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-5tkdw" Jun 13 01:21:55.419393 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:55.419351 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5tkdw"] Jun 13 01:21:55.419866 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:55.419578 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-5tkdw" podUID="b630d1f5-24ab-480b-8cc9-96bbb557ccae" containerName="limitador" containerID="cri-o://d13517eabb4ecb5533f8c1729b9a697835094187c9c9aaf041c02c3476c9e726" gracePeriod=30 Jun 13 01:21:55.958145 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:55.958104 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5tkdw" Jun 13 01:21:56.094464 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:56.094433 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwslp\" (UniqueName: \"kubernetes.io/projected/b630d1f5-24ab-480b-8cc9-96bbb557ccae-kube-api-access-pwslp\") pod \"b630d1f5-24ab-480b-8cc9-96bbb557ccae\" (UID: \"b630d1f5-24ab-480b-8cc9-96bbb557ccae\") " Jun 13 01:21:56.094666 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:56.094481 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b630d1f5-24ab-480b-8cc9-96bbb557ccae-config-file\") pod \"b630d1f5-24ab-480b-8cc9-96bbb557ccae\" (UID: \"b630d1f5-24ab-480b-8cc9-96bbb557ccae\") " Jun 13 01:21:56.094877 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:56.094854 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b630d1f5-24ab-480b-8cc9-96bbb557ccae-config-file" (OuterVolumeSpecName: "config-file") pod "b630d1f5-24ab-480b-8cc9-96bbb557ccae" (UID: "b630d1f5-24ab-480b-8cc9-96bbb557ccae"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:21:56.096623 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:56.096590 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b630d1f5-24ab-480b-8cc9-96bbb557ccae-kube-api-access-pwslp" (OuterVolumeSpecName: "kube-api-access-pwslp") pod "b630d1f5-24ab-480b-8cc9-96bbb557ccae" (UID: "b630d1f5-24ab-480b-8cc9-96bbb557ccae"). InnerVolumeSpecName "kube-api-access-pwslp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:21:56.195155 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:56.195096 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwslp\" (UniqueName: \"kubernetes.io/projected/b630d1f5-24ab-480b-8cc9-96bbb557ccae-kube-api-access-pwslp\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:21:56.195155 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:56.195149 2563 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b630d1f5-24ab-480b-8cc9-96bbb557ccae-config-file\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:21:56.276366 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:56.276331 2563 generic.go:356] "Generic (PLEG): container finished" podID="b630d1f5-24ab-480b-8cc9-96bbb557ccae" containerID="d13517eabb4ecb5533f8c1729b9a697835094187c9c9aaf041c02c3476c9e726" exitCode=0 Jun 13 01:21:56.276366 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:56.276369 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5tkdw" Jun 13 01:21:56.276572 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:56.276372 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5tkdw" event={"ID":"b630d1f5-24ab-480b-8cc9-96bbb557ccae","Type":"ContainerDied","Data":"d13517eabb4ecb5533f8c1729b9a697835094187c9c9aaf041c02c3476c9e726"} Jun 13 01:21:56.276572 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:56.276503 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5tkdw" event={"ID":"b630d1f5-24ab-480b-8cc9-96bbb557ccae","Type":"ContainerDied","Data":"fb3063934251441abb8b422024341967fd91e59624255b5d454c2f653227b3e2"} Jun 13 01:21:56.276572 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:56.276538 2563 scope.go:117] "RemoveContainer" containerID="d13517eabb4ecb5533f8c1729b9a697835094187c9c9aaf041c02c3476c9e726" Jun 13 01:21:56.285325 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:56.285309 2563 scope.go:117] "RemoveContainer" containerID="d13517eabb4ecb5533f8c1729b9a697835094187c9c9aaf041c02c3476c9e726" Jun 13 01:21:56.285584 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:21:56.285566 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d13517eabb4ecb5533f8c1729b9a697835094187c9c9aaf041c02c3476c9e726\": container with ID starting with d13517eabb4ecb5533f8c1729b9a697835094187c9c9aaf041c02c3476c9e726 not found: ID does not exist" containerID="d13517eabb4ecb5533f8c1729b9a697835094187c9c9aaf041c02c3476c9e726" Jun 13 01:21:56.285657 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:56.285590 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d13517eabb4ecb5533f8c1729b9a697835094187c9c9aaf041c02c3476c9e726"} err="failed to get container status \"d13517eabb4ecb5533f8c1729b9a697835094187c9c9aaf041c02c3476c9e726\": rpc error: code = NotFound desc = could not find container \"d13517eabb4ecb5533f8c1729b9a697835094187c9c9aaf041c02c3476c9e726\": container with ID starting with d13517eabb4ecb5533f8c1729b9a697835094187c9c9aaf041c02c3476c9e726 not found: ID does not exist" Jun 13 01:21:56.297362 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:56.297337 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5tkdw"] Jun 13 01:21:56.301013 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:56.300987 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5tkdw"] Jun 13 01:21:57.856232 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:57.856198 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b630d1f5-24ab-480b-8cc9-96bbb557ccae" path="/var/lib/kubelet/pods/b630d1f5-24ab-480b-8cc9-96bbb557ccae/volumes" Jun 13 01:21:58.766605 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:58.766571 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-8wdd6"] Jun 13 01:21:58.766904 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:58.766879 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b630d1f5-24ab-480b-8cc9-96bbb557ccae" containerName="limitador" Jun 13 01:21:58.766904 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:58.766895 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b630d1f5-24ab-480b-8cc9-96bbb557ccae" containerName="limitador" Jun 13 01:21:58.767053 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:58.766916 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092fe974-1379-47ee-8325-dc6fc83a964b" containerName="authorino" Jun 13 01:21:58.767053 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:58.766922 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="092fe974-1379-47ee-8325-dc6fc83a964b" containerName="authorino" Jun 13 01:21:58.767053 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:58.766969 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="092fe974-1379-47ee-8325-dc6fc83a964b" containerName="authorino" Jun 13 01:21:58.767053 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:58.766981 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b630d1f5-24ab-480b-8cc9-96bbb557ccae" containerName="limitador" Jun 13 01:21:58.771243 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:58.771219 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-8wdd6" Jun 13 01:21:58.773395 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:58.773374 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 13 01:21:58.777053 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:58.777025 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-8wdd6"] Jun 13 01:21:58.798620 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:58.798589 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:21:58.918800 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:58.918772 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k8jr\" (UniqueName: \"kubernetes.io/projected/416cbdcc-744f-4c42-b83e-f3ecadb88870-kube-api-access-8k8jr\") pod \"postgres-69fb4594cf-8wdd6\" (UID: \"416cbdcc-744f-4c42-b83e-f3ecadb88870\") " pod="opendatahub/postgres-69fb4594cf-8wdd6" Jun 13 01:21:58.918800 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:58.918802 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/416cbdcc-744f-4c42-b83e-f3ecadb88870-data\") pod \"postgres-69fb4594cf-8wdd6\" (UID: \"416cbdcc-744f-4c42-b83e-f3ecadb88870\") " pod="opendatahub/postgres-69fb4594cf-8wdd6" Jun 13 01:21:59.020461 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:59.020367 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k8jr\" (UniqueName: \"kubernetes.io/projected/416cbdcc-744f-4c42-b83e-f3ecadb88870-kube-api-access-8k8jr\") pod \"postgres-69fb4594cf-8wdd6\" (UID: \"416cbdcc-744f-4c42-b83e-f3ecadb88870\") " pod="opendatahub/postgres-69fb4594cf-8wdd6" Jun 13 01:21:59.020461 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:59.020405 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/416cbdcc-744f-4c42-b83e-f3ecadb88870-data\") pod \"postgres-69fb4594cf-8wdd6\" (UID: \"416cbdcc-744f-4c42-b83e-f3ecadb88870\") " pod="opendatahub/postgres-69fb4594cf-8wdd6" Jun 13 01:21:59.020818 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:59.020794 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/416cbdcc-744f-4c42-b83e-f3ecadb88870-data\") pod \"postgres-69fb4594cf-8wdd6\" (UID: \"416cbdcc-744f-4c42-b83e-f3ecadb88870\") " pod="opendatahub/postgres-69fb4594cf-8wdd6" Jun 13 01:21:59.028669 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:59.028640 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k8jr\" (UniqueName: \"kubernetes.io/projected/416cbdcc-744f-4c42-b83e-f3ecadb88870-kube-api-access-8k8jr\") pod \"postgres-69fb4594cf-8wdd6\" (UID: \"416cbdcc-744f-4c42-b83e-f3ecadb88870\") " pod="opendatahub/postgres-69fb4594cf-8wdd6" Jun 13 01:21:59.083160 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:59.083103 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-8wdd6" Jun 13 01:21:59.211670 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:59.211632 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-8wdd6"] Jun 13 01:21:59.214664 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:21:59.214634 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod416cbdcc_744f_4c42_b83e_f3ecadb88870.slice/crio-5b537cf326746ec7b2f1b1d9487eacd088081eebbe7bec065268958de70b9072 WatchSource:0}: Error finding container 5b537cf326746ec7b2f1b1d9487eacd088081eebbe7bec065268958de70b9072: Status 404 returned error can't find the container with id 5b537cf326746ec7b2f1b1d9487eacd088081eebbe7bec065268958de70b9072 Jun 13 01:21:59.292722 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:21:59.292687 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-8wdd6" event={"ID":"416cbdcc-744f-4c42-b83e-f3ecadb88870","Type":"ContainerStarted","Data":"5b537cf326746ec7b2f1b1d9487eacd088081eebbe7bec065268958de70b9072"} Jun 13 01:22:01.303820 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:22:01.303784 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-8wdd6" event={"ID":"416cbdcc-744f-4c42-b83e-f3ecadb88870","Type":"ContainerStarted","Data":"a2deee49a1b83132cecc00ddc2a807b8e7e670992059490eb039cb81fb972694"} Jun 13 01:22:01.304188 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:22:01.303918 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-8wdd6" Jun 13 01:22:01.319077 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:22:01.319012 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-8wdd6" podStartSLOduration=1.429462193 podStartE2EDuration="3.318993771s" totalImagesPullingTime="1.889531578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:21:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:22:01.31888743 +0000 UTC m=+655.934903206" watchObservedRunningTime="2026-06-13 01:22:01.318993771 +0000 UTC m=+655.935009548" Jun 13 01:22:07.342210 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:22:07.342183 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-8wdd6" Jun 13 01:22:07.853277 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:22:07.853245 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:22:07.941013 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:22:07.940983 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:22:18.295879 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:22:18.295842 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-qxhnl"] Jun 13 01:22:18.306001 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:22:18.305980 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-qxhnl" Jun 13 01:22:18.309474 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:22:18.309448 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 13 01:22:18.309650 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:22:18.309638 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-llhvm\"" Jun 13 01:22:18.310058 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:22:18.310044 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 13 01:22:18.315663 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:22:18.315630 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-qxhnl"] Jun 13 01:22:18.386290 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:22:18.386261 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fxh2\" (UniqueName: \"kubernetes.io/projected/0b104639-fea5-4674-9d75-d88b20e94526-kube-api-access-2fxh2\") pod \"keycloak-operator-d67dbbb48-qxhnl\" (UID: \"0b104639-fea5-4674-9d75-d88b20e94526\") " pod="keycloak-system/keycloak-operator-d67dbbb48-qxhnl" Jun 13 01:22:18.487438 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:22:18.487390 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fxh2\" (UniqueName: \"kubernetes.io/projected/0b104639-fea5-4674-9d75-d88b20e94526-kube-api-access-2fxh2\") pod \"keycloak-operator-d67dbbb48-qxhnl\" (UID: \"0b104639-fea5-4674-9d75-d88b20e94526\") " pod="keycloak-system/keycloak-operator-d67dbbb48-qxhnl" Jun 13 01:22:18.496645 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:22:18.496614 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fxh2\" (UniqueName: \"kubernetes.io/projected/0b104639-fea5-4674-9d75-d88b20e94526-kube-api-access-2fxh2\") pod \"keycloak-operator-d67dbbb48-qxhnl\" (UID: \"0b104639-fea5-4674-9d75-d88b20e94526\") " pod="keycloak-system/keycloak-operator-d67dbbb48-qxhnl" Jun 13 01:22:18.617060 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:22:18.616975 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-qxhnl" Jun 13 01:22:18.749926 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:22:18.749897 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-qxhnl"] Jun 13 01:22:18.753005 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:22:18.752972 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b104639_fea5_4674_9d75_d88b20e94526.slice/crio-80af7e1659693617af44aab2f1fb190557973ef2a9e0c962d1d1e83261fa9fc1 WatchSource:0}: Error finding container 80af7e1659693617af44aab2f1fb190557973ef2a9e0c962d1d1e83261fa9fc1: Status 404 returned error can't find the container with id 80af7e1659693617af44aab2f1fb190557973ef2a9e0c962d1d1e83261fa9fc1 Jun 13 01:22:19.381097 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:22:19.381012 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-qxhnl" event={"ID":"0b104639-fea5-4674-9d75-d88b20e94526","Type":"ContainerStarted","Data":"80af7e1659693617af44aab2f1fb190557973ef2a9e0c962d1d1e83261fa9fc1"} Jun 13 01:22:25.413072 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:22:25.413033 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-qxhnl" event={"ID":"0b104639-fea5-4674-9d75-d88b20e94526","Type":"ContainerStarted","Data":"405c8f9d78b6b776177cc108dea3da6eec8464f094afd2ab938ac723baec4244"} Jun 13 01:22:25.430527 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:22:25.430464 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-qxhnl" podStartSLOduration=0.883373588 podStartE2EDuration="7.430444411s" totalImagesPullingTime="6.547070823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:22:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:22:25.429896395 +0000 UTC m=+680.045912190" watchObservedRunningTime="2026-06-13 01:22:25.430444411 +0000 UTC m=+680.046460187" Jun 13 01:22:34.274907 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:22:34.274870 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:22:34.346879 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:22:34.346845 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:23:03.800949 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:03.800916 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:23:03.920507 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:03.920473 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:23:09.468499 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:09.468459 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:23:09.549319 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:09.549288 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:23:09.627754 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:09.627720 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:23:10.041604 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:10.041562 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:23:10.245552 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:10.245516 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:23:12.638548 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:12.638517 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:23:12.745206 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:12.745169 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:23:33.485474 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:33.485437 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:23:43.508101 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:43.508064 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:23:43.776718 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:43.776634 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:23:43.948851 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:43.948790 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:23:44.049293 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:44.049258 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:23:51.787285 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:51.787253 2563 generic.go:356] "Generic (PLEG): container finished" podID="96b81e41-cc93-445d-86a5-fa69336708c4" containerID="23ea7d9f3006221a23f9679f8f220a3023640df04ca99c4a553e8c0bf2868e86" exitCode=0 Jun 13 01:23:51.787688 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:51.787334 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" event={"ID":"96b81e41-cc93-445d-86a5-fa69336708c4","Type":"ContainerDied","Data":"23ea7d9f3006221a23f9679f8f220a3023640df04ca99c4a553e8c0bf2868e86"} Jun 13 01:23:51.787745 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:51.787731 2563 scope.go:117] "RemoveContainer" containerID="23ea7d9f3006221a23f9679f8f220a3023640df04ca99c4a553e8c0bf2868e86" Jun 13 01:23:51.788792 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:51.788770 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 13 01:23:51.788852 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:51.788835 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 13 01:23:51.788891 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:51.788865 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 13 01:23:52.793646 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:52.793613 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" event={"ID":"96b81e41-cc93-445d-86a5-fa69336708c4","Type":"ContainerStarted","Data":"37275b42a90f06a4f5a5d8c0814ea2f46779739170b063f5de703c7fa92a4709"} Jun 13 01:23:52.865895 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:52.865854 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:23:52.866963 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:52.866935 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-8tk7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jun 13 01:23:52.867080 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:52.867005 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" podUID="96b81e41-cc93-445d-86a5-fa69336708c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jun 13 01:23:53.184172 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:53.184063 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:23:53.866414 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:53.866382 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-8tk7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jun 13 01:23:53.866808 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:53.866433 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" podUID="96b81e41-cc93-445d-86a5-fa69336708c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jun 13 01:23:54.866720 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:54.866675 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-8tk7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jun 13 01:23:54.867103 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:54.866735 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" podUID="96b81e41-cc93-445d-86a5-fa69336708c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jun 13 01:23:55.866241 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:55.866203 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-8tk7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jun 13 01:23:55.866409 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:55.866270 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" podUID="96b81e41-cc93-445d-86a5-fa69336708c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jun 13 01:23:56.870580 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:56.870547 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:23:56.871413 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:23:56.871393 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-8tk7f" Jun 13 01:24:44.046180 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:24:44.046071 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:24:44.143927 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:24:44.143892 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:24:52.835489 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:24:52.835448 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:25:10.683554 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:10.683517 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m"] Jun 13 01:25:10.686026 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:10.686010 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" Jun 13 01:25:10.688318 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:10.688293 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mg6hv\"" Jun 13 01:25:10.688471 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:10.688451 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 13 01:25:10.688902 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:10.688888 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 13 01:25:10.688957 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:10.688932 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 13 01:25:10.699823 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:10.699801 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m"] Jun 13 01:25:10.722467 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:10.722442 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:25:10.813080 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:10.813045 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9f42a4a-8063-4330-a6ec-97dadc949ea7-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2cp8m\" (UID: \"c9f42a4a-8063-4330-a6ec-97dadc949ea7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" Jun 13 01:25:10.813290 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:10.813106 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw48m\" (UniqueName: \"kubernetes.io/projected/c9f42a4a-8063-4330-a6ec-97dadc949ea7-kube-api-access-kw48m\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2cp8m\" (UID: \"c9f42a4a-8063-4330-a6ec-97dadc949ea7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" Jun 13 01:25:10.813364 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:10.813292 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9f42a4a-8063-4330-a6ec-97dadc949ea7-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2cp8m\" (UID: \"c9f42a4a-8063-4330-a6ec-97dadc949ea7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" Jun 13 01:25:10.813364 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:10.813335 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c9f42a4a-8063-4330-a6ec-97dadc949ea7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2cp8m\" (UID: \"c9f42a4a-8063-4330-a6ec-97dadc949ea7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" Jun 13 01:25:10.813364 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:10.813356 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9f42a4a-8063-4330-a6ec-97dadc949ea7-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2cp8m\" (UID: \"c9f42a4a-8063-4330-a6ec-97dadc949ea7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" Jun 13 01:25:10.813521 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:10.813377 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9f42a4a-8063-4330-a6ec-97dadc949ea7-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2cp8m\" (UID: \"c9f42a4a-8063-4330-a6ec-97dadc949ea7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" Jun 13 01:25:10.914818 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:10.914776 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9f42a4a-8063-4330-a6ec-97dadc949ea7-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2cp8m\" (UID: \"c9f42a4a-8063-4330-a6ec-97dadc949ea7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" Jun 13 01:25:10.914996 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:10.914829 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9f42a4a-8063-4330-a6ec-97dadc949ea7-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2cp8m\" (UID: \"c9f42a4a-8063-4330-a6ec-97dadc949ea7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" Jun 13 01:25:10.914996 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:10.914848 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw48m\" (UniqueName: \"kubernetes.io/projected/c9f42a4a-8063-4330-a6ec-97dadc949ea7-kube-api-access-kw48m\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2cp8m\" (UID: \"c9f42a4a-8063-4330-a6ec-97dadc949ea7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" Jun 13 01:25:10.914996 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:10.914901 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9f42a4a-8063-4330-a6ec-97dadc949ea7-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2cp8m\" (UID: \"c9f42a4a-8063-4330-a6ec-97dadc949ea7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" Jun 13 01:25:10.914996 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:10.914928 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c9f42a4a-8063-4330-a6ec-97dadc949ea7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2cp8m\" (UID: \"c9f42a4a-8063-4330-a6ec-97dadc949ea7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" Jun 13 01:25:10.915185 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:10.915065 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9f42a4a-8063-4330-a6ec-97dadc949ea7-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2cp8m\" (UID: \"c9f42a4a-8063-4330-a6ec-97dadc949ea7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" Jun 13 01:25:10.915248 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:10.915223 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9f42a4a-8063-4330-a6ec-97dadc949ea7-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2cp8m\" (UID: \"c9f42a4a-8063-4330-a6ec-97dadc949ea7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" Jun 13 01:25:10.915299 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:10.915280 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9f42a4a-8063-4330-a6ec-97dadc949ea7-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2cp8m\" (UID: \"c9f42a4a-8063-4330-a6ec-97dadc949ea7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" Jun 13 01:25:10.915375 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:10.915357 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c9f42a4a-8063-4330-a6ec-97dadc949ea7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2cp8m\" (UID: \"c9f42a4a-8063-4330-a6ec-97dadc949ea7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" Jun 13 01:25:10.917275 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:10.917243 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9f42a4a-8063-4330-a6ec-97dadc949ea7-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2cp8m\" (UID: \"c9f42a4a-8063-4330-a6ec-97dadc949ea7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" Jun 13 01:25:10.917456 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:10.917441 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9f42a4a-8063-4330-a6ec-97dadc949ea7-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2cp8m\" (UID: \"c9f42a4a-8063-4330-a6ec-97dadc949ea7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" Jun 13 01:25:10.923215 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:10.923195 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw48m\" (UniqueName: \"kubernetes.io/projected/c9f42a4a-8063-4330-a6ec-97dadc949ea7-kube-api-access-kw48m\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2cp8m\" (UID: \"c9f42a4a-8063-4330-a6ec-97dadc949ea7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" Jun 13 01:25:10.996300 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:10.996211 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" Jun 13 01:25:11.129380 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:11.129215 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m"] Jun 13 01:25:11.132081 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:25:11.132047 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9f42a4a_8063_4330_a6ec_97dadc949ea7.slice/crio-2791c15914639f68e74f8255386eec54f7baee707a30580e9e6af76d24fd8d22 WatchSource:0}: Error finding container 2791c15914639f68e74f8255386eec54f7baee707a30580e9e6af76d24fd8d22: Status 404 returned error can't find the container with id 2791c15914639f68e74f8255386eec54f7baee707a30580e9e6af76d24fd8d22 Jun 13 01:25:11.133966 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:11.133950 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 01:25:11.138861 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:11.138829 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" event={"ID":"c9f42a4a-8063-4330-a6ec-97dadc949ea7","Type":"ContainerStarted","Data":"2791c15914639f68e74f8255386eec54f7baee707a30580e9e6af76d24fd8d22"} Jun 13 01:25:16.165694 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:16.165655 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" event={"ID":"c9f42a4a-8063-4330-a6ec-97dadc949ea7","Type":"ContainerStarted","Data":"f558ca02ffbee975d4aa9f9432ab0997a66190e5dabf7df56dda6bdd3e808f7a"} Jun 13 01:25:29.556647 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:29.556610 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:25:34.593203 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:34.593168 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:25:43.017694 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:43.017657 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:25:52.733489 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:52.733459 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:25:52.786909 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:52.786879 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:25:55.285451 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:55.285358 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv"] Jun 13 01:25:55.289115 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:55.289089 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" Jun 13 01:25:55.291280 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:55.291256 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 13 01:25:55.297862 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:55.297838 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv"] Jun 13 01:25:55.326916 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:55.326886 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zlq2\" (UniqueName: \"kubernetes.io/projected/b2b90ff7-5002-4991-b654-796f5027ac12-kube-api-access-5zlq2\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-68ddv\" (UID: \"b2b90ff7-5002-4991-b654-796f5027ac12\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" Jun 13 01:25:55.327053 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:55.326984 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2b90ff7-5002-4991-b654-796f5027ac12-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-68ddv\" (UID: \"b2b90ff7-5002-4991-b654-796f5027ac12\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" Jun 13 01:25:55.327053 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:55.327021 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2b90ff7-5002-4991-b654-796f5027ac12-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-68ddv\" (UID: \"b2b90ff7-5002-4991-b654-796f5027ac12\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" Jun 13 01:25:55.327152 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:55.327077 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2b90ff7-5002-4991-b654-796f5027ac12-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-68ddv\" (UID: \"b2b90ff7-5002-4991-b654-796f5027ac12\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" Jun 13 01:25:55.327193 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:55.327153 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2b90ff7-5002-4991-b654-796f5027ac12-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-68ddv\" (UID: \"b2b90ff7-5002-4991-b654-796f5027ac12\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" Jun 13 01:25:55.327237 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:55.327189 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b2b90ff7-5002-4991-b654-796f5027ac12-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-68ddv\" (UID: \"b2b90ff7-5002-4991-b654-796f5027ac12\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" Jun 13 01:25:55.338095 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:55.338064 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:25:55.427643 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:55.427606 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2b90ff7-5002-4991-b654-796f5027ac12-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-68ddv\" (UID: \"b2b90ff7-5002-4991-b654-796f5027ac12\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" Jun 13 01:25:55.427815 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:55.427652 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2b90ff7-5002-4991-b654-796f5027ac12-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-68ddv\" (UID: \"b2b90ff7-5002-4991-b654-796f5027ac12\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" Jun 13 01:25:55.427815 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:55.427687 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b2b90ff7-5002-4991-b654-796f5027ac12-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-68ddv\" (UID: \"b2b90ff7-5002-4991-b654-796f5027ac12\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" Jun 13 01:25:55.427815 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:55.427723 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zlq2\" (UniqueName: \"kubernetes.io/projected/b2b90ff7-5002-4991-b654-796f5027ac12-kube-api-access-5zlq2\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-68ddv\" (UID: \"b2b90ff7-5002-4991-b654-796f5027ac12\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" Jun 13 01:25:55.427815 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:55.427778 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2b90ff7-5002-4991-b654-796f5027ac12-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-68ddv\" (UID: \"b2b90ff7-5002-4991-b654-796f5027ac12\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" Jun 13 01:25:55.427815 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:55.427808 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2b90ff7-5002-4991-b654-796f5027ac12-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-68ddv\" (UID: \"b2b90ff7-5002-4991-b654-796f5027ac12\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" Jun 13 01:25:55.428101 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:55.428078 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2b90ff7-5002-4991-b654-796f5027ac12-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-68ddv\" (UID: \"b2b90ff7-5002-4991-b654-796f5027ac12\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" Jun 13 01:25:55.428200 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:55.428122 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b2b90ff7-5002-4991-b654-796f5027ac12-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-68ddv\" (UID: \"b2b90ff7-5002-4991-b654-796f5027ac12\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" Jun 13 01:25:55.428200 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:55.428188 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2b90ff7-5002-4991-b654-796f5027ac12-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-68ddv\" (UID: \"b2b90ff7-5002-4991-b654-796f5027ac12\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" Jun 13 01:25:55.430026 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:55.430006 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2b90ff7-5002-4991-b654-796f5027ac12-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-68ddv\" (UID: \"b2b90ff7-5002-4991-b654-796f5027ac12\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" Jun 13 01:25:55.430317 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:55.430302 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2b90ff7-5002-4991-b654-796f5027ac12-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-68ddv\" (UID: \"b2b90ff7-5002-4991-b654-796f5027ac12\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" Jun 13 01:25:55.435502 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:55.435484 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zlq2\" (UniqueName: \"kubernetes.io/projected/b2b90ff7-5002-4991-b654-796f5027ac12-kube-api-access-5zlq2\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-68ddv\" (UID: \"b2b90ff7-5002-4991-b654-796f5027ac12\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" Jun 13 01:25:55.615644 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:55.615556 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" Jun 13 01:25:55.745666 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:55.745537 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv"] Jun 13 01:25:55.748231 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:25:55.748205 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2b90ff7_5002_4991_b654_796f5027ac12.slice/crio-a498801e44420cb5c357357d5e441aaf9a2f18de7670a55b45143f6b87b46ea6 WatchSource:0}: Error finding container a498801e44420cb5c357357d5e441aaf9a2f18de7670a55b45143f6b87b46ea6: Status 404 returned error can't find the container with id a498801e44420cb5c357357d5e441aaf9a2f18de7670a55b45143f6b87b46ea6 Jun 13 01:25:56.346875 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:56.346844 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" event={"ID":"b2b90ff7-5002-4991-b654-796f5027ac12","Type":"ContainerStarted","Data":"b01c95c871054375162c414e5379184b81507a31311a077dc1fa6a7e0288a45a"} Jun 13 01:25:56.347282 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:25:56.346886 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" event={"ID":"b2b90ff7-5002-4991-b654-796f5027ac12","Type":"ContainerStarted","Data":"a498801e44420cb5c357357d5e441aaf9a2f18de7670a55b45143f6b87b46ea6"} Jun 13 01:26:05.856612 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:26:05.856586 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ppvdn_e98f7500-070e-4c57-a4b0-a711e20b8c26/ovn-acl-logging/0.log" Jun 13 01:26:05.856998 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:26:05.856983 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ppvdn_e98f7500-070e-4c57-a4b0-a711e20b8c26/ovn-acl-logging/0.log" Jun 13 01:26:38.650669 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:26:38.650628 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:26:50.598175 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:26:50.598124 2563 generic.go:356] "Generic (PLEG): container finished" podID="b2b90ff7-5002-4991-b654-796f5027ac12" containerID="b01c95c871054375162c414e5379184b81507a31311a077dc1fa6a7e0288a45a" exitCode=0 Jun 13 01:26:50.598175 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:26:50.598160 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" event={"ID":"b2b90ff7-5002-4991-b654-796f5027ac12","Type":"ContainerDied","Data":"b01c95c871054375162c414e5379184b81507a31311a077dc1fa6a7e0288a45a"} Jun 13 01:26:52.608852 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:26:52.608817 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" event={"ID":"b2b90ff7-5002-4991-b654-796f5027ac12","Type":"ContainerStarted","Data":"f152ae022082bde3ddde82ad7b80d94b404467c4687d6e1998b6fa92dbdee35a"} Jun 13 01:26:52.626784 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:26:52.626735 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" podStartSLOduration=2.721873224 podStartE2EDuration="57.626715045s" totalImagesPullingTime="989.406771ms" totalInitContainerRuntime="53.91543505s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:26:52.626108875 +0000 UTC m=+947.242124651" watchObservedRunningTime="2026-06-13 01:26:52.626715045 +0000 UTC m=+947.242730816" Jun 13 01:26:55.615722 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:26:55.615681 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" Jun 13 01:26:55.616162 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:26:55.615742 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" Jun 13 01:26:55.628356 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:26:55.628328 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" Jun 13 01:26:55.639615 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:26:55.639590 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-68ddv" Jun 13 01:26:58.784276 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:26:58.784240 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:26:58.884995 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:26:58.884957 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:26:59.907460 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:26:59.907428 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:27:00.011536 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:27:00.011499 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:27:03.658678 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:27:03.658648 2563 generic.go:356] "Generic (PLEG): container finished" podID="c9f42a4a-8063-4330-a6ec-97dadc949ea7" containerID="f558ca02ffbee975d4aa9f9432ab0997a66190e5dabf7df56dda6bdd3e808f7a" exitCode=0 Jun 13 01:27:03.659086 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:27:03.658705 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" event={"ID":"c9f42a4a-8063-4330-a6ec-97dadc949ea7","Type":"ContainerDied","Data":"f558ca02ffbee975d4aa9f9432ab0997a66190e5dabf7df56dda6bdd3e808f7a"} Jun 13 01:27:04.664981 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:27:04.664944 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" event={"ID":"c9f42a4a-8063-4330-a6ec-97dadc949ea7","Type":"ContainerStarted","Data":"5f3a03910a8afbf878dfe80d734186d4b467dc83e372ad38e3684098bb5fcbc6"} Jun 13 01:27:04.683152 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:27:04.683077 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" podStartSLOduration=2.9084136149999997 podStartE2EDuration="1m54.683058394s" totalImagesPullingTime="4.241380899s" totalInitContainerRuntime="1m47.53326388s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:25:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:27:04.681829984 +0000 UTC m=+959.297845780" watchObservedRunningTime="2026-06-13 01:27:04.683058394 +0000 UTC m=+959.299074168" Jun 13 01:27:10.997320 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:27:10.997278 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" Jun 13 01:27:10.997809 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:27:10.997601 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" Jun 13 01:27:11.010052 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:27:11.010027 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" Jun 13 01:27:11.710265 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:27:11.710234 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2cp8m" Jun 13 01:27:38.144889 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:27:38.144802 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:28:26.694493 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:28:26.694454 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:28:28.208244 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:28:28.208202 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:29:10.305216 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:29:10.305172 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:29:10.404108 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:29:10.404076 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:29:10.602532 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:29:10.602436 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:29:11.031533 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:29:11.031499 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:29:11.130415 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:29:11.130383 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:29:18.897806 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:29:18.897751 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:29:24.552653 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:29:24.552619 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:29:24.669000 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:29:24.668955 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:29:48.738448 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:29:48.738405 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:29:48.791109 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:29:48.791073 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:29:56.805862 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:29:56.805822 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:29:56.898314 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:29:56.898272 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:29:57.175244 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:29:57.175158 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:29:57.640996 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:29:57.640961 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:29:57.746283 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:29:57.746245 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:30:20.862601 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:30:20.862554 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:30:26.703922 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:30:26.703834 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:30:26.812104 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:30:26.812066 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:30:26.927455 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:30:26.927426 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:30:27.102247 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:30:27.102210 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:30:27.202517 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:30:27.202484 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:30:43.749425 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:30:43.749387 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:30:43.865886 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:30:43.865847 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:30:43.970456 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:30:43.970423 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:30:49.830155 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:30:49.830099 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:30:49.926498 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:30:49.926467 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:30:57.996585 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:30:57.996548 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:30:59.162011 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:30:59.161974 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:31:05.889173 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:31:05.889118 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ppvdn_e98f7500-070e-4c57-a4b0-a711e20b8c26/ovn-acl-logging/0.log" Jun 13 01:31:05.891638 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:31:05.891617 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ppvdn_e98f7500-070e-4c57-a4b0-a711e20b8c26/ovn-acl-logging/0.log" Jun 13 01:31:14.736252 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:31:14.736214 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:31:14.859147 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:31:14.859098 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:31:14.966725 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:31:14.966690 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:31:20.988218 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:31:20.988185 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:31:21.092008 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:31:21.091970 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:31:37.205734 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:31:37.205696 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:31:37.303238 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:31:37.303203 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:31:37.419446 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:31:37.419415 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:31:43.240080 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:31:43.240044 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:31:43.348059 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:31:43.348024 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:31:43.440461 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:31:43.440425 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:31:43.589943 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:31:43.589911 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:31:49.309530 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:31:49.309501 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:31:49.368417 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:31:49.368378 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:33:43.041223 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:33:43.041093 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:33:52.250477 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:33:52.250443 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:33:52.764056 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:33:52.764013 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:33:52.867107 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:33:52.867072 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:34:28.240180 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:34:28.240139 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:34:29.539626 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:34:29.539584 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:36:05.919208 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:36:05.919175 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ppvdn_e98f7500-070e-4c57-a4b0-a711e20b8c26/ovn-acl-logging/0.log" Jun 13 01:36:05.923560 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:36:05.923540 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ppvdn_e98f7500-070e-4c57-a4b0-a711e20b8c26/ovn-acl-logging/0.log" Jun 13 01:41:05.947159 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:41:05.947115 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ppvdn_e98f7500-070e-4c57-a4b0-a711e20b8c26/ovn-acl-logging/0.log" Jun 13 01:41:05.955489 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:41:05.955465 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ppvdn_e98f7500-070e-4c57-a4b0-a711e20b8c26/ovn-acl-logging/0.log" Jun 13 01:42:36.493200 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:42:36.493089 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:42:37.508685 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:42:37.508640 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:43:54.849401 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:43:54.849311 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:45:28.810923 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:45:28.810826 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:45:28.875213 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:45:28.875175 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:46:05.974032 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:46:05.973996 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ppvdn_e98f7500-070e-4c57-a4b0-a711e20b8c26/ovn-acl-logging/0.log" Jun 13 01:46:05.982624 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:46:05.982600 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ppvdn_e98f7500-070e-4c57-a4b0-a711e20b8c26/ovn-acl-logging/0.log" Jun 13 01:48:08.492001 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:08.491967 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:48:13.867829 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:13.867789 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:48:38.140413 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:38.140337 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:48:51.216587 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:51.216552 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:48:52.885412 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:52.885370 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d"] Jun 13 01:48:52.888748 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:52.888732 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:52.890700 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:52.890677 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-7225cfcd-openshift-default-dockercfg-x86bt\"" Jun 13 01:48:52.908538 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:52.908509 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d"] Jun 13 01:48:52.915705 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:52.915670 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:48:52.966579 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:52.966547 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-credential-socket\") pod \"e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:52.966738 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:52.966584 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-istio-data\") pod \"e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:52.966738 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:52.966603 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5112f373-6c51-45a2-a73d-c73744f4e507-istio-token\") pod \"e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:52.966738 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:52.966627 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk4r6\" (UniqueName: \"kubernetes.io/projected/5112f373-6c51-45a2-a73d-c73744f4e507-kube-api-access-tk4r6\") pod \"e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:52.966738 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:52.966672 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-istio-envoy\") pod \"e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:52.966738 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:52.966711 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-workload-socket\") pod \"e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:52.966738 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:52.966728 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5112f373-6c51-45a2-a73d-c73744f4e507-istiod-ca-cert\") pod \"e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:52.966928 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:52.966750 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-workload-certs\") pod \"e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:52.966928 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:52.966825 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5112f373-6c51-45a2-a73d-c73744f4e507-istio-podinfo\") pod \"e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:53.019741 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.019699 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:48:53.068018 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.067981 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-istio-envoy\") pod \"e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:53.068218 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.068037 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-workload-socket\") pod \"e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:53.068218 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.068056 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5112f373-6c51-45a2-a73d-c73744f4e507-istiod-ca-cert\") pod \"e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:53.068218 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.068077 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-workload-certs\") pod \"e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:53.068218 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.068110 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5112f373-6c51-45a2-a73d-c73744f4e507-istio-podinfo\") pod \"e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:53.068218 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.068168 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-credential-socket\") pod \"e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:53.068218 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.068195 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-istio-data\") pod \"e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:53.068218 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.068219 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5112f373-6c51-45a2-a73d-c73744f4e507-istio-token\") pod \"e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:53.068797 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.068532 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk4r6\" (UniqueName: \"kubernetes.io/projected/5112f373-6c51-45a2-a73d-c73744f4e507-kube-api-access-tk4r6\") pod \"e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:53.068797 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.068591 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-workload-certs\") pod \"e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:53.068797 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.068646 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-credential-socket\") pod \"e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:53.068797 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.068689 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-istio-data\") pod \"e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:53.068986 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.068840 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-workload-socket\") pod \"e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:53.068986 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.068954 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5112f373-6c51-45a2-a73d-c73744f4e507-istiod-ca-cert\") pod \"e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:53.070416 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.070396 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-istio-envoy\") pod \"e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:53.070644 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.070625 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5112f373-6c51-45a2-a73d-c73744f4e507-istio-podinfo\") pod \"e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:53.079764 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.079730 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5112f373-6c51-45a2-a73d-c73744f4e507-istio-token\") pod \"e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:53.080880 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.080858 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk4r6\" (UniqueName: \"kubernetes.io/projected/5112f373-6c51-45a2-a73d-c73744f4e507-kube-api-access-tk4r6\") pod \"e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:53.141070 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.140979 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:48:53.199677 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.199643 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:53.380878 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.380844 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d"] Jun 13 01:48:53.388689 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:48:53.388653 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5112f373_6c51_45a2_a73d_c73744f4e507.slice/crio-78aa7f46ebda65d090949d7f7feccfaf856d93a164653e484eebeb07217647ba WatchSource:0}: Error finding container 78aa7f46ebda65d090949d7f7feccfaf856d93a164653e484eebeb07217647ba: Status 404 returned error can't find the container with id 78aa7f46ebda65d090949d7f7feccfaf856d93a164653e484eebeb07217647ba Jun 13 01:48:53.390890 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.390857 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 13 01:48:53.390970 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.390944 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 13 01:48:53.391012 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.390974 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 13 01:48:53.407392 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.407369 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:48:53.579691 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.579651 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" event={"ID":"5112f373-6c51-45a2-a73d-c73744f4e507","Type":"ContainerStarted","Data":"0c8abe4942b3f289f85a2fa5edeb1557813b835a488329f3aca6a077ffb2c42d"} Jun 13 01:48:53.579891 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.579716 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" event={"ID":"5112f373-6c51-45a2-a73d-c73744f4e507","Type":"ContainerStarted","Data":"78aa7f46ebda65d090949d7f7feccfaf856d93a164653e484eebeb07217647ba"} Jun 13 01:48:53.603468 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.603414 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" podStartSLOduration=1.60339741 podStartE2EDuration="1.60339741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:48:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:48:53.601070378 +0000 UTC m=+2268.217086153" watchObservedRunningTime="2026-06-13 01:48:53.60339741 +0000 UTC m=+2268.219413184" Jun 13 01:48:53.626154 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.626102 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:48:53.763904 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.763790 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:48:53.895908 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.895874 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:48:53.999392 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:53.999360 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:48:54.098314 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:54.098269 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:48:54.197428 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:54.197390 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:48:54.200337 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:54.200318 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:54.205469 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:54.205447 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:54.584519 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:54.584489 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:54.585356 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:54.585339 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:48:54.723660 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:54.723629 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:48:54.824271 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:54.824231 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:48:55.199435 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:55.199391 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:48:55.748632 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:55.748601 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:48:55.850801 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:55.850772 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:48:56.395987 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:56.395953 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:48:56.607041 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:56.607010 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:48:56.995577 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:56.995544 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:48:57.781525 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:57.781491 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:48:59.170745 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:59.170707 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:48:59.334338 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:59.334309 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d"] Jun 13 01:48:59.334510 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:59.334485 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" podUID="5112f373-6c51-45a2-a73d-c73744f4e507" containerName="istio-proxy" containerID="cri-o://0c8abe4942b3f289f85a2fa5edeb1557813b835a488329f3aca6a077ffb2c42d" gracePeriod=30 Jun 13 01:48:59.360685 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:59.360657 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:48:59.462515 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:48:59.462348 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:01.236475 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:01.236440 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:05.381623 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.381596 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:49:05.427103 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.427017 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:05.481800 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.481757 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5112f373-6c51-45a2-a73d-c73744f4e507-istio-token\") pod \"5112f373-6c51-45a2-a73d-c73744f4e507\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " Jun 13 01:49:05.481989 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.481816 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-istio-envoy\") pod \"5112f373-6c51-45a2-a73d-c73744f4e507\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " Jun 13 01:49:05.481989 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.481876 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-istio-data\") pod \"5112f373-6c51-45a2-a73d-c73744f4e507\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " Jun 13 01:49:05.481989 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.481897 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-workload-socket\") pod \"5112f373-6c51-45a2-a73d-c73744f4e507\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " Jun 13 01:49:05.481989 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.481938 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tk4r6\" (UniqueName: \"kubernetes.io/projected/5112f373-6c51-45a2-a73d-c73744f4e507-kube-api-access-tk4r6\") pod \"5112f373-6c51-45a2-a73d-c73744f4e507\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " Jun 13 01:49:05.481989 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.481970 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-workload-certs\") pod \"5112f373-6c51-45a2-a73d-c73744f4e507\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " Jun 13 01:49:05.482273 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.482010 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5112f373-6c51-45a2-a73d-c73744f4e507-istiod-ca-cert\") pod \"5112f373-6c51-45a2-a73d-c73744f4e507\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " Jun 13 01:49:05.482273 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.482086 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-credential-socket\") pod \"5112f373-6c51-45a2-a73d-c73744f4e507\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " Jun 13 01:49:05.482273 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.482112 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5112f373-6c51-45a2-a73d-c73744f4e507-istio-podinfo\") pod \"5112f373-6c51-45a2-a73d-c73744f4e507\" (UID: \"5112f373-6c51-45a2-a73d-c73744f4e507\") " Jun 13 01:49:05.482414 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.482298 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5112f373-6c51-45a2-a73d-c73744f4e507" (UID: "5112f373-6c51-45a2-a73d-c73744f4e507"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:49:05.482491 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.482472 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-workload-certs\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:49:05.482557 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.482292 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5112f373-6c51-45a2-a73d-c73744f4e507" (UID: "5112f373-6c51-45a2-a73d-c73744f4e507"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:49:05.482557 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.482488 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5112f373-6c51-45a2-a73d-c73744f4e507" (UID: "5112f373-6c51-45a2-a73d-c73744f4e507"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:49:05.482662 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.482546 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5112f373-6c51-45a2-a73d-c73744f4e507-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5112f373-6c51-45a2-a73d-c73744f4e507" (UID: "5112f373-6c51-45a2-a73d-c73744f4e507"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:49:05.482771 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.482745 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-istio-data" (OuterVolumeSpecName: "istio-data") pod "5112f373-6c51-45a2-a73d-c73744f4e507" (UID: "5112f373-6c51-45a2-a73d-c73744f4e507"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:49:05.484596 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.484570 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5112f373-6c51-45a2-a73d-c73744f4e507-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5112f373-6c51-45a2-a73d-c73744f4e507" (UID: "5112f373-6c51-45a2-a73d-c73744f4e507"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 13 01:49:05.484695 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.484603 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5112f373-6c51-45a2-a73d-c73744f4e507-istio-token" (OuterVolumeSpecName: "istio-token") pod "5112f373-6c51-45a2-a73d-c73744f4e507" (UID: "5112f373-6c51-45a2-a73d-c73744f4e507"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:49:05.484695 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.484668 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5112f373-6c51-45a2-a73d-c73744f4e507" (UID: "5112f373-6c51-45a2-a73d-c73744f4e507"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:49:05.484782 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.484668 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5112f373-6c51-45a2-a73d-c73744f4e507-kube-api-access-tk4r6" (OuterVolumeSpecName: "kube-api-access-tk4r6") pod "5112f373-6c51-45a2-a73d-c73744f4e507" (UID: "5112f373-6c51-45a2-a73d-c73744f4e507"). InnerVolumeSpecName "kube-api-access-tk4r6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:49:05.529057 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.529023 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:05.588195 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.583552 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5112f373-6c51-45a2-a73d-c73744f4e507-istiod-ca-cert\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:49:05.588195 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.583589 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-credential-socket\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:49:05.588195 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.583603 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5112f373-6c51-45a2-a73d-c73744f4e507-istio-podinfo\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:49:05.588195 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.583623 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5112f373-6c51-45a2-a73d-c73744f4e507-istio-token\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:49:05.588195 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.583637 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-istio-envoy\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:49:05.588195 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.583650 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-istio-data\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:49:05.588195 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.583662 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5112f373-6c51-45a2-a73d-c73744f4e507-workload-socket\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:49:05.588195 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.583678 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tk4r6\" (UniqueName: \"kubernetes.io/projected/5112f373-6c51-45a2-a73d-c73744f4e507-kube-api-access-tk4r6\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:49:05.595889 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.595851 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm"] Jun 13 01:49:05.596448 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.596423 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5112f373-6c51-45a2-a73d-c73744f4e507" containerName="istio-proxy" Jun 13 01:49:05.596448 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.596445 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5112f373-6c51-45a2-a73d-c73744f4e507" containerName="istio-proxy" Jun 13 01:49:05.596609 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.596536 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5112f373-6c51-45a2-a73d-c73744f4e507" containerName="istio-proxy" Jun 13 01:49:05.599088 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.599066 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.601180 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.601114 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8ef6cb6a-openshift-default-dockercfg-xcfs6\"" Jun 13 01:49:05.612067 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.611996 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm"] Jun 13 01:49:05.633754 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.633717 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:05.643446 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.643417 2563 generic.go:356] "Generic (PLEG): container finished" podID="5112f373-6c51-45a2-a73d-c73744f4e507" containerID="0c8abe4942b3f289f85a2fa5edeb1557813b835a488329f3aca6a077ffb2c42d" exitCode=0 Jun 13 01:49:05.643592 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.643481 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" Jun 13 01:49:05.643592 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.643498 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" event={"ID":"5112f373-6c51-45a2-a73d-c73744f4e507","Type":"ContainerDied","Data":"0c8abe4942b3f289f85a2fa5edeb1557813b835a488329f3aca6a077ffb2c42d"} Jun 13 01:49:05.643592 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.643556 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d" event={"ID":"5112f373-6c51-45a2-a73d-c73744f4e507","Type":"ContainerDied","Data":"78aa7f46ebda65d090949d7f7feccfaf856d93a164653e484eebeb07217647ba"} Jun 13 01:49:05.643592 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.643588 2563 scope.go:117] "RemoveContainer" containerID="0c8abe4942b3f289f85a2fa5edeb1557813b835a488329f3aca6a077ffb2c42d" Jun 13 01:49:05.652640 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.652622 2563 scope.go:117] "RemoveContainer" containerID="0c8abe4942b3f289f85a2fa5edeb1557813b835a488329f3aca6a077ffb2c42d" Jun 13 01:49:05.652927 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:49:05.652910 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c8abe4942b3f289f85a2fa5edeb1557813b835a488329f3aca6a077ffb2c42d\": container with ID starting with 0c8abe4942b3f289f85a2fa5edeb1557813b835a488329f3aca6a077ffb2c42d not found: ID does not exist" containerID="0c8abe4942b3f289f85a2fa5edeb1557813b835a488329f3aca6a077ffb2c42d" Jun 13 01:49:05.652977 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.652936 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c8abe4942b3f289f85a2fa5edeb1557813b835a488329f3aca6a077ffb2c42d"} err="failed to get container status \"0c8abe4942b3f289f85a2fa5edeb1557813b835a488329f3aca6a077ffb2c42d\": rpc error: code = NotFound desc = could not find container \"0c8abe4942b3f289f85a2fa5edeb1557813b835a488329f3aca6a077ffb2c42d\": container with ID starting with 0c8abe4942b3f289f85a2fa5edeb1557813b835a488329f3aca6a077ffb2c42d not found: ID does not exist" Jun 13 01:49:05.664323 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.664296 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d"] Jun 13 01:49:05.668421 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.668398 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-7225cfcd-openshift-default-848f7ffd46-9ps2d"] Jun 13 01:49:05.684484 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.684421 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-workload-socket\") pod \"e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.684484 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.684451 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istiod-ca-cert\") pod \"e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.684619 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.684488 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istio-podinfo\") pod \"e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.684619 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.684552 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-credential-socket\") pod \"e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.684619 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.684585 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istio-token\") pod \"e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.684619 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.684610 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxsv8\" (UniqueName: \"kubernetes.io/projected/5ae252ef-3daf-42df-b61e-77fd8eb6b187-kube-api-access-vxsv8\") pod \"e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.684746 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.684650 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-workload-certs\") pod \"e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.684746 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.684726 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istio-envoy\") pod \"e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.684807 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.684760 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istio-data\") pod \"e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.747997 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.747955 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:05.786189 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.786151 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istio-envoy\") pod \"e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.786189 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.786190 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istio-data\") pod \"e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.786441 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.786214 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-workload-socket\") pod \"e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.786441 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.786231 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istiod-ca-cert\") pod \"e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.786441 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.786260 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istio-podinfo\") pod \"e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.786441 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.786294 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-credential-socket\") pod \"e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.786441 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.786417 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istio-token\") pod \"e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.786686 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.786473 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxsv8\" (UniqueName: \"kubernetes.io/projected/5ae252ef-3daf-42df-b61e-77fd8eb6b187-kube-api-access-vxsv8\") pod \"e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.786686 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.786539 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-workload-certs\") pod \"e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.786808 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.786705 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-workload-socket\") pod \"e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.786867 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.786808 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istio-data\") pod \"e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.786867 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.786846 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-workload-certs\") pod \"e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.787070 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.786907 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-credential-socket\") pod \"e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.787070 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.787021 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istiod-ca-cert\") pod \"e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.788612 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.788589 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istio-envoy\") pod \"e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.788802 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.788787 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istio-podinfo\") pod \"e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.798329 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.798301 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istio-token\") pod \"e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.798442 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.798394 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxsv8\" (UniqueName: \"kubernetes.io/projected/5ae252ef-3daf-42df-b61e-77fd8eb6b187-kube-api-access-vxsv8\") pod \"e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.853248 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.853216 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5112f373-6c51-45a2-a73d-c73744f4e507" path="/var/lib/kubelet/pods/5112f373-6c51-45a2-a73d-c73744f4e507/volumes" Jun 13 01:49:05.914452 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.914419 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8ef6cb6a-openshift-default-dockercfg-xcfs6\"" Jun 13 01:49:05.922835 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.922812 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:05.964831 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:05.964741 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:06.065654 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:06.065617 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm"] Jun 13 01:49:06.070088 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:49:06.070054 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ae252ef_3daf_42df_b61e_77fd8eb6b187.slice/crio-a092cf420cc8ccb4f6964deb32c0e2a0c0b583f0ec0bd3f7343f441d3c3e527f WatchSource:0}: Error finding container a092cf420cc8ccb4f6964deb32c0e2a0c0b583f0ec0bd3f7343f441d3c3e527f: Status 404 returned error can't find the container with id a092cf420cc8ccb4f6964deb32c0e2a0c0b583f0ec0bd3f7343f441d3c3e527f Jun 13 01:49:06.072098 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:06.072064 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 13 01:49:06.072222 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:06.072150 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 13 01:49:06.072222 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:06.072183 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 13 01:49:06.074286 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:06.074259 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:06.284574 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:06.284523 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:06.495623 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:06.495588 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:06.614772 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:06.614669 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:06.649333 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:06.649292 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" event={"ID":"5ae252ef-3daf-42df-b61e-77fd8eb6b187","Type":"ContainerStarted","Data":"c376c66ccf41646a5baa853f53b305d3446a5490d21708f3992c206ac12265e8"} Jun 13 01:49:06.649511 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:06.649349 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" event={"ID":"5ae252ef-3daf-42df-b61e-77fd8eb6b187","Type":"ContainerStarted","Data":"a092cf420cc8ccb4f6964deb32c0e2a0c0b583f0ec0bd3f7343f441d3c3e527f"} Jun 13 01:49:06.670524 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:06.670479 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" podStartSLOduration=1.6704627300000001 podStartE2EDuration="1.67046273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:49:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:49:06.668753624 +0000 UTC m=+2281.284769452" watchObservedRunningTime="2026-06-13 01:49:06.67046273 +0000 UTC m=+2281.286478504" Jun 13 01:49:06.711368 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:06.711338 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:06.810769 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:06.810741 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:06.923603 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:06.923512 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:07.257563 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:07.257472 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:07.399328 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:07.399296 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:07.877937 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:07.877891 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:07.929371 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:07.929344 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:08.469262 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:08.469227 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:08.659045 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:08.659013 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:08.705297 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:08.705266 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:08.747954 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:08.747916 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:09.077308 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:09.077273 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:09.671903 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:09.671870 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:10.276481 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:10.276439 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:11.955953 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:11.955918 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:13.109251 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:13.109208 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm"] Jun 13 01:49:13.109752 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:13.109417 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" podUID="5ae252ef-3daf-42df-b61e-77fd8eb6b187" containerName="istio-proxy" containerID="cri-o://c376c66ccf41646a5baa853f53b305d3446a5490d21708f3992c206ac12265e8" gracePeriod=30 Jun 13 01:49:13.134618 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:13.134580 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:13.229986 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:13.229932 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:15.061469 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.061442 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:15.187568 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.187523 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-credential-socket\") pod \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " Jun 13 01:49:15.187769 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.187578 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-workload-certs\") pod \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " Jun 13 01:49:15.187769 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.187614 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxsv8\" (UniqueName: \"kubernetes.io/projected/5ae252ef-3daf-42df-b61e-77fd8eb6b187-kube-api-access-vxsv8\") pod \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " Jun 13 01:49:15.187769 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.187639 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istio-data\") pod \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " Jun 13 01:49:15.187769 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.187686 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-workload-socket\") pod \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " Jun 13 01:49:15.187769 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.187723 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istio-token\") pod \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " Jun 13 01:49:15.187769 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.187767 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istiod-ca-cert\") pod \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " Jun 13 01:49:15.188244 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.187789 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istio-envoy\") pod \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " Jun 13 01:49:15.188244 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.187906 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5ae252ef-3daf-42df-b61e-77fd8eb6b187" (UID: "5ae252ef-3daf-42df-b61e-77fd8eb6b187"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:49:15.188244 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.187926 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5ae252ef-3daf-42df-b61e-77fd8eb6b187" (UID: "5ae252ef-3daf-42df-b61e-77fd8eb6b187"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:49:15.188244 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.188019 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istio-podinfo\") pod \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\" (UID: \"5ae252ef-3daf-42df-b61e-77fd8eb6b187\") " Jun 13 01:49:15.188466 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.188391 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5ae252ef-3daf-42df-b61e-77fd8eb6b187" (UID: "5ae252ef-3daf-42df-b61e-77fd8eb6b187"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:49:15.188523 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.188468 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-credential-socket\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:49:15.188523 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.188506 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-workload-certs\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:49:15.188629 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.188500 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5ae252ef-3daf-42df-b61e-77fd8eb6b187" (UID: "5ae252ef-3daf-42df-b61e-77fd8eb6b187"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:49:15.188876 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.188836 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istio-data" (OuterVolumeSpecName: "istio-data") pod "5ae252ef-3daf-42df-b61e-77fd8eb6b187" (UID: "5ae252ef-3daf-42df-b61e-77fd8eb6b187"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:49:15.190301 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.190270 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5ae252ef-3daf-42df-b61e-77fd8eb6b187" (UID: "5ae252ef-3daf-42df-b61e-77fd8eb6b187"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:49:15.190424 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.190342 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5ae252ef-3daf-42df-b61e-77fd8eb6b187" (UID: "5ae252ef-3daf-42df-b61e-77fd8eb6b187"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 13 01:49:15.190485 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.190469 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ae252ef-3daf-42df-b61e-77fd8eb6b187-kube-api-access-vxsv8" (OuterVolumeSpecName: "kube-api-access-vxsv8") pod "5ae252ef-3daf-42df-b61e-77fd8eb6b187" (UID: "5ae252ef-3daf-42df-b61e-77fd8eb6b187"). InnerVolumeSpecName "kube-api-access-vxsv8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:49:15.190578 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.190565 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istio-token" (OuterVolumeSpecName: "istio-token") pod "5ae252ef-3daf-42df-b61e-77fd8eb6b187" (UID: "5ae252ef-3daf-42df-b61e-77fd8eb6b187"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:49:15.289795 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.289745 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-workload-socket\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:49:15.289795 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.289788 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istio-token\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:49:15.289795 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.289804 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istiod-ca-cert\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:49:15.290094 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.289816 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istio-envoy\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:49:15.290094 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.289826 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istio-podinfo\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:49:15.290094 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.289838 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxsv8\" (UniqueName: \"kubernetes.io/projected/5ae252ef-3daf-42df-b61e-77fd8eb6b187-kube-api-access-vxsv8\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:49:15.290094 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.289850 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ae252ef-3daf-42df-b61e-77fd8eb6b187-istio-data\") on node \"ip-10-0-136-115.ec2.internal\" DevicePath \"\"" Jun 13 01:49:15.692742 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.692706 2563 generic.go:356] "Generic (PLEG): container finished" podID="5ae252ef-3daf-42df-b61e-77fd8eb6b187" containerID="c376c66ccf41646a5baa853f53b305d3446a5490d21708f3992c206ac12265e8" exitCode=0 Jun 13 01:49:15.692932 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.692744 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" event={"ID":"5ae252ef-3daf-42df-b61e-77fd8eb6b187","Type":"ContainerDied","Data":"c376c66ccf41646a5baa853f53b305d3446a5490d21708f3992c206ac12265e8"} Jun 13 01:49:15.692932 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.692775 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" Jun 13 01:49:15.692932 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.692817 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm" event={"ID":"5ae252ef-3daf-42df-b61e-77fd8eb6b187","Type":"ContainerDied","Data":"a092cf420cc8ccb4f6964deb32c0e2a0c0b583f0ec0bd3f7343f441d3c3e527f"} Jun 13 01:49:15.692932 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.692847 2563 scope.go:117] "RemoveContainer" containerID="c376c66ccf41646a5baa853f53b305d3446a5490d21708f3992c206ac12265e8" Jun 13 01:49:15.702167 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.702142 2563 scope.go:117] "RemoveContainer" containerID="c376c66ccf41646a5baa853f53b305d3446a5490d21708f3992c206ac12265e8" Jun 13 01:49:15.702441 ip-10-0-136-115 kubenswrapper[2563]: E0613 01:49:15.702423 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c376c66ccf41646a5baa853f53b305d3446a5490d21708f3992c206ac12265e8\": container with ID starting with c376c66ccf41646a5baa853f53b305d3446a5490d21708f3992c206ac12265e8 not found: ID does not exist" containerID="c376c66ccf41646a5baa853f53b305d3446a5490d21708f3992c206ac12265e8" Jun 13 01:49:15.702501 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.702454 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c376c66ccf41646a5baa853f53b305d3446a5490d21708f3992c206ac12265e8"} err="failed to get container status \"c376c66ccf41646a5baa853f53b305d3446a5490d21708f3992c206ac12265e8\": rpc error: code = NotFound desc = could not find container \"c376c66ccf41646a5baa853f53b305d3446a5490d21708f3992c206ac12265e8\": container with ID starting with c376c66ccf41646a5baa853f53b305d3446a5490d21708f3992c206ac12265e8 not found: ID does not exist" Jun 13 01:49:15.714799 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.714745 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm"] Jun 13 01:49:15.718842 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.718817 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-8ef6cb6a-openshift-default-5dfddb9648-4mftm"] Jun 13 01:49:15.852174 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:15.852116 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ae252ef-3daf-42df-b61e-77fd8eb6b187" path="/var/lib/kubelet/pods/5ae252ef-3daf-42df-b61e-77fd8eb6b187/volumes" Jun 13 01:49:16.016486 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:16.016458 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:19.002219 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:19.002184 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:19.102339 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:19.102301 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:30.154515 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:30.154486 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7bc9d68775-q9qg4_52f97dad-f304-4275-8d30-e43bc0ff2025/nginx/0.log" Jun 13 01:49:31.574484 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:31.574451 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f7bcb9597-gdf68_e2abe744-c80c-441c-9878-c5db6ecba767/copy-manifests/0.log" Jun 13 01:49:31.581462 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:31.581440 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f7bcb9597-gdf68_e2abe744-c80c-441c-9878-c5db6ecba767/manager/0.log" Jun 13 01:49:31.819317 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:31.819286 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-8wdd6_416cbdcc-744f-4c42-b83e-f3ecadb88870/postgres/0.log" Jun 13 01:49:33.327534 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:33.327504 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-r94pr_70b78dfc-61a1-4744-8a8f-aca0858ac865/manager/0.log" Jun 13 01:49:33.591979 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:33.591900 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-sjw86_d6c20059-b473-458e-95db-721f33bbe4a5/registry-server/0.log" Jun 13 01:49:33.965717 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:33.965642 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-zmw54_749bcb61-8793-430d-8f71-9deeb5ac34a2/manager/0.log" Jun 13 01:49:34.318005 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:34.317980 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bctjvnn_85a9e38d-1d71-4ec8-afea-602588e665d8/istio-proxy/0.log" Jun 13 01:49:34.783617 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:34.783591 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-8tk7f_96b81e41-cc93-445d-86a5-fa69336708c4/istio-proxy/1.log" Jun 13 01:49:35.606781 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:35.606748 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-2cp8m_c9f42a4a-8063-4330-a6ec-97dadc949ea7/storage-initializer/0.log" Jun 13 01:49:35.614482 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:35.614457 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-2cp8m_c9f42a4a-8063-4330-a6ec-97dadc949ea7/main/0.log" Jun 13 01:49:36.089886 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:36.089858 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-68ddv_b2b90ff7-5002-4991-b654-796f5027ac12/storage-initializer/0.log" Jun 13 01:49:36.097558 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:36.097537 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-68ddv_b2b90ff7-5002-4991-b654-796f5027ac12/main/0.log" Jun 13 01:49:40.485866 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:40.485822 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:40.548458 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:40.548423 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" limit=1024 Jun 13 01:49:43.364033 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:43.363995 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-56c2g_84d32cae-48d5-4aba-af49-e6ad82ff2e47/global-pull-secret-syncer/0.log" Jun 13 01:49:43.449655 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:43.449616 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cw7n2_c3364a81-6e76-4d46-ac19-63a163ecb01a/konnectivity-agent/0.log" Jun 13 01:49:43.541693 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:43.541665 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-115.ec2.internal_7401f1fc17763ddc1d839785e91b064c/haproxy/0.log" Jun 13 01:49:48.591354 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:48.591324 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-r94pr_70b78dfc-61a1-4744-8a8f-aca0858ac865/manager/0.log" Jun 13 01:49:48.654987 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:48.654956 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-sjw86_d6c20059-b473-458e-95db-721f33bbe4a5/registry-server/0.log" Jun 13 01:49:48.830011 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:48.829978 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-zmw54_749bcb61-8793-430d-8f71-9deeb5ac34a2/manager/0.log" Jun 13 01:49:51.018873 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:51.018789 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hd7c9_9885eff7-e777-4585-9f22-de270a173a23/node-exporter/0.log" Jun 13 01:49:51.048780 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:51.048568 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hd7c9_9885eff7-e777-4585-9f22-de270a173a23/kube-rbac-proxy/0.log" Jun 13 01:49:51.076497 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:51.076460 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hd7c9_9885eff7-e777-4585-9f22-de270a173a23/init-textfile/0.log" Jun 13 01:49:51.208437 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:51.208406 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa4523b5-985d-4c7c-b0d7-6bf981c2abf2/prometheus/0.log" Jun 13 01:49:51.229581 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:51.229556 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa4523b5-985d-4c7c-b0d7-6bf981c2abf2/config-reloader/0.log" Jun 13 01:49:51.254494 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:51.254471 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa4523b5-985d-4c7c-b0d7-6bf981c2abf2/thanos-sidecar/0.log" Jun 13 01:49:51.275100 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:51.275026 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa4523b5-985d-4c7c-b0d7-6bf981c2abf2/kube-rbac-proxy-web/0.log" Jun 13 01:49:51.299151 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:51.299098 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa4523b5-985d-4c7c-b0d7-6bf981c2abf2/kube-rbac-proxy/0.log" Jun 13 01:49:51.324681 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:51.324659 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa4523b5-985d-4c7c-b0d7-6bf981c2abf2/kube-rbac-proxy-thanos/0.log" Jun 13 01:49:51.346773 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:51.346747 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa4523b5-985d-4c7c-b0d7-6bf981c2abf2/init-config-reloader/0.log" Jun 13 01:49:51.378852 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:51.378826 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-mfx5w_43df1aa5-92e1-4c71-a4f5-4068158995e7/prometheus-operator/0.log" Jun 13 01:49:51.402632 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:51.402603 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-mfx5w_43df1aa5-92e1-4c71-a4f5-4068158995e7/kube-rbac-proxy/0.log" Jun 13 01:49:53.173857 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:53.173827 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-hjcl6_42938e76-2127-4067-9ffb-2a1d1a02c036/networking-console-plugin/0.log" Jun 13 01:49:54.852326 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:54.852244 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7rf94/perf-node-gather-daemonset-849pk"] Jun 13 01:49:54.852678 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:54.852575 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ae252ef-3daf-42df-b61e-77fd8eb6b187" containerName="istio-proxy" Jun 13 01:49:54.852678 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:54.852586 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ae252ef-3daf-42df-b61e-77fd8eb6b187" containerName="istio-proxy" Jun 13 01:49:54.852678 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:54.852655 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ae252ef-3daf-42df-b61e-77fd8eb6b187" containerName="istio-proxy" Jun 13 01:49:54.856039 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:54.856017 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-849pk" Jun 13 01:49:54.858326 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:54.858301 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7rf94\"/\"default-dockercfg-xb55v\"" Jun 13 01:49:54.858991 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:54.858975 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7rf94\"/\"openshift-service-ca.crt\"" Jun 13 01:49:54.859049 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:54.859012 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7rf94\"/\"kube-root-ca.crt\"" Jun 13 01:49:54.865173 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:54.865149 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7rf94/perf-node-gather-daemonset-849pk"] Jun 13 01:49:54.950901 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:54.950870 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/031dd026-3533-4dfa-a2e0-0ad299cf1384-lib-modules\") pod \"perf-node-gather-daemonset-849pk\" (UID: \"031dd026-3533-4dfa-a2e0-0ad299cf1384\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-849pk" Jun 13 01:49:54.951118 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:54.950972 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/031dd026-3533-4dfa-a2e0-0ad299cf1384-proc\") pod \"perf-node-gather-daemonset-849pk\" (UID: \"031dd026-3533-4dfa-a2e0-0ad299cf1384\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-849pk" Jun 13 01:49:54.951118 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:54.951017 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh77h\" (UniqueName: \"kubernetes.io/projected/031dd026-3533-4dfa-a2e0-0ad299cf1384-kube-api-access-fh77h\") pod \"perf-node-gather-daemonset-849pk\" (UID: \"031dd026-3533-4dfa-a2e0-0ad299cf1384\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-849pk" Jun 13 01:49:54.951118 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:54.951069 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/031dd026-3533-4dfa-a2e0-0ad299cf1384-sys\") pod \"perf-node-gather-daemonset-849pk\" (UID: \"031dd026-3533-4dfa-a2e0-0ad299cf1384\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-849pk" Jun 13 01:49:54.951118 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:54.951093 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/031dd026-3533-4dfa-a2e0-0ad299cf1384-podres\") pod \"perf-node-gather-daemonset-849pk\" (UID: \"031dd026-3533-4dfa-a2e0-0ad299cf1384\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-849pk" Jun 13 01:49:55.051731 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:55.051692 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/031dd026-3533-4dfa-a2e0-0ad299cf1384-sys\") pod \"perf-node-gather-daemonset-849pk\" (UID: \"031dd026-3533-4dfa-a2e0-0ad299cf1384\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-849pk" Jun 13 01:49:55.051939 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:55.051740 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/031dd026-3533-4dfa-a2e0-0ad299cf1384-podres\") pod \"perf-node-gather-daemonset-849pk\" (UID: \"031dd026-3533-4dfa-a2e0-0ad299cf1384\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-849pk" Jun 13 01:49:55.051939 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:55.051811 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/031dd026-3533-4dfa-a2e0-0ad299cf1384-sys\") pod \"perf-node-gather-daemonset-849pk\" (UID: \"031dd026-3533-4dfa-a2e0-0ad299cf1384\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-849pk" Jun 13 01:49:55.051939 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:55.051818 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/031dd026-3533-4dfa-a2e0-0ad299cf1384-lib-modules\") pod \"perf-node-gather-daemonset-849pk\" (UID: \"031dd026-3533-4dfa-a2e0-0ad299cf1384\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-849pk" Jun 13 01:49:55.051939 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:55.051870 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/031dd026-3533-4dfa-a2e0-0ad299cf1384-proc\") pod \"perf-node-gather-daemonset-849pk\" (UID: \"031dd026-3533-4dfa-a2e0-0ad299cf1384\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-849pk" Jun 13 01:49:55.051939 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:55.051898 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh77h\" (UniqueName: \"kubernetes.io/projected/031dd026-3533-4dfa-a2e0-0ad299cf1384-kube-api-access-fh77h\") pod \"perf-node-gather-daemonset-849pk\" (UID: \"031dd026-3533-4dfa-a2e0-0ad299cf1384\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-849pk" Jun 13 01:49:55.051939 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:55.051926 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/031dd026-3533-4dfa-a2e0-0ad299cf1384-lib-modules\") pod \"perf-node-gather-daemonset-849pk\" (UID: \"031dd026-3533-4dfa-a2e0-0ad299cf1384\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-849pk" Jun 13 01:49:55.051939 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:55.051933 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/031dd026-3533-4dfa-a2e0-0ad299cf1384-podres\") pod \"perf-node-gather-daemonset-849pk\" (UID: \"031dd026-3533-4dfa-a2e0-0ad299cf1384\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-849pk" Jun 13 01:49:55.052230 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:55.052073 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/031dd026-3533-4dfa-a2e0-0ad299cf1384-proc\") pod \"perf-node-gather-daemonset-849pk\" (UID: \"031dd026-3533-4dfa-a2e0-0ad299cf1384\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-849pk" Jun 13 01:49:55.059144 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:55.059102 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh77h\" (UniqueName: \"kubernetes.io/projected/031dd026-3533-4dfa-a2e0-0ad299cf1384-kube-api-access-fh77h\") pod \"perf-node-gather-daemonset-849pk\" (UID: \"031dd026-3533-4dfa-a2e0-0ad299cf1384\") " pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-849pk" Jun 13 01:49:55.166962 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:55.166871 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-849pk" Jun 13 01:49:55.297407 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:55.297375 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7rf94/perf-node-gather-daemonset-849pk"] Jun 13 01:49:55.300350 ip-10-0-136-115 kubenswrapper[2563]: W0613 01:49:55.300328 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod031dd026_3533_4dfa_a2e0_0ad299cf1384.slice/crio-0a7ded396e933c766889ae9fbc535a028fa52009c638b08b78eae7fb8de609fa WatchSource:0}: Error finding container 0a7ded396e933c766889ae9fbc535a028fa52009c638b08b78eae7fb8de609fa: Status 404 returned error can't find the container with id 0a7ded396e933c766889ae9fbc535a028fa52009c638b08b78eae7fb8de609fa Jun 13 01:49:55.882356 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:55.882313 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-849pk" event={"ID":"031dd026-3533-4dfa-a2e0-0ad299cf1384","Type":"ContainerStarted","Data":"0c3fec6db9b0697931392d9b1e7d4ea49fae822ac657baaf5adf5cfd9d46bcb5"} Jun 13 01:49:55.882855 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:55.882374 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-849pk" event={"ID":"031dd026-3533-4dfa-a2e0-0ad299cf1384","Type":"ContainerStarted","Data":"0a7ded396e933c766889ae9fbc535a028fa52009c638b08b78eae7fb8de609fa"} Jun 13 01:49:55.882855 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:55.882405 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-849pk" Jun 13 01:49:55.896739 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:55.896689 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-849pk" podStartSLOduration=1.8966736069999999 podStartE2EDuration="1.896673607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:49:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:49:55.896040515 +0000 UTC m=+2330.512056290" watchObservedRunningTime="2026-06-13 01:49:55.896673607 +0000 UTC m=+2330.512689381" Jun 13 01:49:56.276249 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:56.276150 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v57zn_11693fcd-f558-4148-a311-9552a7c78e4f/dns/0.log" Jun 13 01:49:56.295575 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:56.295548 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v57zn_11693fcd-f558-4148-a311-9552a7c78e4f/kube-rbac-proxy/0.log" Jun 13 01:49:56.363449 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:56.363422 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t6xgs_2a2385b8-b719-4fbb-a0ec-75b6dadeee56/dns-node-resolver/0.log" Jun 13 01:49:56.860949 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:56.860914 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-dc84f6c56-n5sz9_0919664c-ade5-406f-90e1-284794a42370/registry/0.log" Jun 13 01:49:56.869483 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:56.869451 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-dc84f6c56-n5sz9_0919664c-ade5-406f-90e1-284794a42370/registry/1.log" Jun 13 01:49:56.888809 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:56.888781 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-29fpw_b95fc5d7-d3d7-4d28-94d6-ec2ae9ac65b4/node-ca/0.log" Jun 13 01:49:57.871121 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:57.871089 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bctjvnn_85a9e38d-1d71-4ec8-afea-602588e665d8/istio-proxy/0.log" Jun 13 01:49:58.055239 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:58.055209 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-8tk7f_96b81e41-cc93-445d-86a5-fa69336708c4/istio-proxy/0.log" Jun 13 01:49:58.086305 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:58.086269 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-8tk7f_96b81e41-cc93-445d-86a5-fa69336708c4/istio-proxy/1.log" Jun 13 01:49:58.849945 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:58.849916 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-99zs8_a3047eef-fbf3-467d-b062-31e46ec5b236/serve-healthcheck-canary/0.log" Jun 13 01:49:59.566527 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:59.566499 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ghk4p_57844996-bb33-4c31-893f-057667812fc0/kube-rbac-proxy/0.log" Jun 13 01:49:59.600498 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:59.600469 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ghk4p_57844996-bb33-4c31-893f-057667812fc0/exporter/0.log" Jun 13 01:49:59.635857 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:49:59.635828 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ghk4p_57844996-bb33-4c31-893f-057667812fc0/extractor/0.log" Jun 13 01:50:01.897056 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:50:01.897026 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7rf94/perf-node-gather-daemonset-849pk" Jun 13 01:50:01.934886 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:50:01.934845 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7bc9d68775-q9qg4_52f97dad-f304-4275-8d30-e43bc0ff2025/nginx/0.log" Jun 13 01:50:02.522208 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:50:02.522176 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f7bcb9597-gdf68_e2abe744-c80c-441c-9878-c5db6ecba767/manager/0.log" Jun 13 01:50:02.545870 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:50:02.545841 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f7bcb9597-gdf68_e2abe744-c80c-441c-9878-c5db6ecba767/copy-manifests/0.log" Jun 13 01:50:02.734286 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:50:02.734254 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-8wdd6_416cbdcc-744f-4c42-b83e-f3ecadb88870/postgres/0.log" Jun 13 01:50:04.603356 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:50:04.603326 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8554b6f6b8-95d7p_033bf3f3-40be-49af-92ff-5b0eea32a27e/manager/0.log" Jun 13 01:50:08.206638 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:50:08.206609 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bctjvnn_85a9e38d-1d71-4ec8-afea-602588e665d8/istio-proxy/0.log" Jun 13 01:50:08.351299 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:50:08.351269 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-8tk7f_96b81e41-cc93-445d-86a5-fa69336708c4/istio-proxy/0.log" Jun 13 01:50:08.380534 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:50:08.380502 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-8tk7f_96b81e41-cc93-445d-86a5-fa69336708c4/istio-proxy/1.log" Jun 13 01:50:09.638557 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:50:09.638523 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bctjvnn_85a9e38d-1d71-4ec8-afea-602588e665d8/istio-proxy/0.log" Jun 13 01:50:09.787581 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:50:09.787536 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-8tk7f_96b81e41-cc93-445d-86a5-fa69336708c4/istio-proxy/0.log" Jun 13 01:50:09.820650 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:50:09.820621 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-8tk7f_96b81e41-cc93-445d-86a5-fa69336708c4/istio-proxy/1.log" Jun 13 01:50:11.632322 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:50:11.632294 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bctjvnn_85a9e38d-1d71-4ec8-afea-602588e665d8/istio-proxy/0.log" Jun 13 01:50:11.775303 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:50:11.775263 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-8tk7f_96b81e41-cc93-445d-86a5-fa69336708c4/istio-proxy/0.log" Jun 13 01:50:11.805907 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:50:11.805866 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-8tk7f_96b81e41-cc93-445d-86a5-fa69336708c4/istio-proxy/1.log" Jun 13 01:50:11.823197 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:50:11.823168 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wf2vg_927341bf-fe3e-40c1-a95c-061b6571c321/kube-multus-additional-cni-plugins/0.log" Jun 13 01:50:11.848488 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:50:11.848459 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wf2vg_927341bf-fe3e-40c1-a95c-061b6571c321/egress-router-binary-copy/0.log" Jun 13 01:50:11.869914 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:50:11.869885 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wf2vg_927341bf-fe3e-40c1-a95c-061b6571c321/cni-plugins/0.log" Jun 13 01:50:11.891765 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:50:11.891676 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wf2vg_927341bf-fe3e-40c1-a95c-061b6571c321/bond-cni-plugin/0.log" Jun 13 01:50:11.914534 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:50:11.914509 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wf2vg_927341bf-fe3e-40c1-a95c-061b6571c321/routeoverride-cni/0.log" Jun 13 01:50:11.939927 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:50:11.939901 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wf2vg_927341bf-fe3e-40c1-a95c-061b6571c321/whereabouts-cni-bincopy/0.log" Jun 13 01:50:11.960239 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:50:11.960210 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wf2vg_927341bf-fe3e-40c1-a95c-061b6571c321/whereabouts-cni/0.log" Jun 13 01:50:11.992147 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:50:11.992097 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ht6wg_8aa2e977-c7ef-4eb9-ac8c-1da1d3c6c3b9/kube-multus/0.log" Jun 13 01:50:12.132228 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:50:12.132190 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mthf7_4b218b9d-0f16-40fc-9753-0892624afc14/network-metrics-daemon/0.log" Jun 13 01:50:12.153224 ip-10-0-136-115 kubenswrapper[2563]: I0613 01:50:12.153105 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mthf7_4b218b9d-0f16-40fc-9753-0892624afc14/kube-rbac-proxy/0.log"