Jul 02 15:24:14.720765 ip-10-0-135-113 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 02 15:24:14.720796 ip-10-0-135-113 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 02 15:24:14.720806 ip-10-0-135-113 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 02 15:24:14.721049 ip-10-0-135-113 systemd[1]: Failed to start Kubernetes Kubelet. Jul 02 15:24:24.970112 ip-10-0-135-113 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 02 15:24:24.970130 ip-10-0-135-113 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 1c1b1c13273848d1a8defb16869f2142 -- Jul 02 15:26:27.245163 ip-10-0-135-113 systemd[1]: Starting Kubernetes Kubelet... Jul 02 15:26:28.662340 ip-10-0-135-113 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 15:26:28.662340 ip-10-0-135-113 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 15:26:28.662340 ip-10-0-135-113 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 15:26:28.662340 ip-10-0-135-113 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 15:26:28.662340 ip-10-0-135-113 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 15:26:28.662982 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.662404 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 15:26:28.667730 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667715 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:26:28.667730 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667729 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:26:28.667730 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667733 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:26:28.667819 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667736 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:26:28.667819 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667739 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:26:28.667819 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667742 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:26:28.667819 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667745 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:26:28.667819 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667747 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:26:28.667819 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667750 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:26:28.667819 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667752 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:26:28.667819 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667755 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:26:28.667819 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667758 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:26:28.667819 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667760 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:26:28.667819 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667763 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:26:28.667819 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667765 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:26:28.667819 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667768 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:26:28.667819 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667771 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:26:28.667819 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667773 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:26:28.667819 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667776 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:26:28.667819 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667779 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:26:28.667819 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667782 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:26:28.667819 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667784 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:26:28.668271 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667789 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:26:28.668271 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667792 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:26:28.668271 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667795 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:26:28.668271 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667798 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:26:28.668271 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667801 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:26:28.668271 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667804 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:26:28.668271 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667807 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:26:28.668271 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667810 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:26:28.668271 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667813 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:26:28.668271 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667815 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:26:28.668271 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667818 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:26:28.668271 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667820 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:26:28.668271 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667823 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:26:28.668271 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667826 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:26:28.668271 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667829 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:26:28.668271 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667831 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:26:28.668271 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667835 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:26:28.668271 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667839 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:26:28.668271 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667842 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:26:28.668760 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667844 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:26:28.668760 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667847 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:26:28.668760 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667850 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:26:28.668760 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667852 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:26:28.668760 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667856 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:26:28.668760 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667859 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:26:28.668760 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667862 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:26:28.668760 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667864 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:26:28.668760 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667867 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:26:28.668760 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667869 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:26:28.668760 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667872 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:26:28.668760 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667874 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:26:28.668760 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667876 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:26:28.668760 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667879 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:26:28.668760 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667882 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:26:28.668760 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667885 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:26:28.668760 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667888 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:26:28.668760 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667904 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:26:28.668760 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667907 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:26:28.668760 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667910 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:26:28.668760 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667912 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:26:28.669291 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667915 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:26:28.669291 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667917 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:26:28.669291 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667920 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:26:28.669291 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667922 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:26:28.669291 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667925 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:26:28.669291 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667927 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:26:28.669291 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667930 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:26:28.669291 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667933 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:26:28.669291 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667935 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:26:28.669291 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667938 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:26:28.669291 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667940 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:26:28.669291 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667945 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:26:28.669291 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667949 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:26:28.669291 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667952 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:26:28.669291 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667954 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:26:28.669291 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667957 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:26:28.669291 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667961 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:26:28.669291 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667964 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:26:28.669291 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667967 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:26:28.669735 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667970 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:26:28.669735 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667973 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:26:28.669735 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667976 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:26:28.669735 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667978 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:26:28.669735 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667981 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:26:28.669735 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667983 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:26:28.669735 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667987 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:26:28.669735 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667989 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:26:28.669735 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667992 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:26:28.669735 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667994 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:26:28.669735 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.667997 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:26:28.669735 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.668000 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:26:28.669735 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.668002 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:26:28.669735 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.668004 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:26:28.669735 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.668007 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:26:28.669735 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.668009 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:26:28.669735 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.668012 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:26:28.669735 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.668014 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:26:28.670155 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669770 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:26:28.670155 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669777 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:26:28.670155 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669780 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:26:28.670155 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669783 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:26:28.670155 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669786 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:26:28.670155 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669789 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:26:28.670155 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669792 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:26:28.670155 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669795 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:26:28.670155 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669797 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:26:28.670155 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669800 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:26:28.670155 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669802 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:26:28.670155 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669805 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:26:28.670155 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669808 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:26:28.670155 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669811 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:26:28.670155 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669813 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:26:28.670155 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669817 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:26:28.670155 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669821 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:26:28.670155 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669823 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:26:28.670155 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669826 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:26:28.670616 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669828 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:26:28.670616 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669831 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:26:28.670616 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669834 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:26:28.670616 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669836 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:26:28.670616 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669839 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:26:28.670616 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669841 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:26:28.670616 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669843 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:26:28.670616 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669846 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:26:28.670616 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669849 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:26:28.670616 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669851 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:26:28.670616 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669853 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:26:28.670616 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669856 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:26:28.670616 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669858 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:26:28.670616 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669860 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:26:28.670616 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669866 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:26:28.670616 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669868 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:26:28.670616 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669871 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:26:28.670616 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669873 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:26:28.670616 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669876 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:26:28.670616 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669878 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:26:28.671129 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669881 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:26:28.671129 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669883 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:26:28.671129 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669886 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:26:28.671129 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669889 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:26:28.671129 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669906 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:26:28.671129 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669910 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:26:28.671129 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669917 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:26:28.671129 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669920 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:26:28.671129 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669923 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:26:28.671129 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669925 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:26:28.671129 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669929 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:26:28.671129 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669933 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:26:28.671129 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669935 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:26:28.671129 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669938 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:26:28.671129 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669940 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:26:28.671129 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669943 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:26:28.671129 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669945 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:26:28.671129 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669948 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:26:28.671129 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669950 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:26:28.671587 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669953 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:26:28.671587 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669956 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:26:28.671587 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669958 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:26:28.671587 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669961 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:26:28.671587 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669964 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:26:28.671587 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669966 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:26:28.671587 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669969 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:26:28.671587 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669972 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:26:28.671587 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669975 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:26:28.671587 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669977 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:26:28.671587 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669980 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:26:28.671587 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669982 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:26:28.671587 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669985 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:26:28.671587 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669988 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:26:28.671587 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669991 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:26:28.671587 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669993 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:26:28.671587 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669996 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:26:28.671587 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.669998 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:26:28.671587 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670000 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:26:28.671587 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670004 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:26:28.672100 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670009 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:26:28.672100 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670012 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:26:28.672100 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670014 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:26:28.672100 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670016 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:26:28.672100 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670019 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:26:28.672100 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670021 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:26:28.672100 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670023 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:26:28.672100 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670026 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:26:28.672100 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670028 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:26:28.672100 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670031 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:26:28.672100 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670033 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:26:28.672100 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670036 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:26:28.672100 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670038 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:26:28.672100 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670041 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:26:28.672100 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670043 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:26:28.672100 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670046 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:26:28.672100 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670048 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:26:28.672100 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670050 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:26:28.672100 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670053 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:26:28.672100 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670057 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:26:28.672576 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670059 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:26:28.672576 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670921 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:26:28.672576 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670929 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:26:28.672576 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670932 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:26:28.672576 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670935 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:26:28.672576 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670938 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:26:28.672576 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670940 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:26:28.672576 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670943 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:26:28.672576 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670946 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:26:28.672576 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670949 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:26:28.672576 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670951 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:26:28.672576 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670954 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:26:28.672576 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670958 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:26:28.672576 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670960 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:26:28.672576 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670963 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:26:28.672576 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670965 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:26:28.672576 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670968 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:26:28.672576 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670972 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:26:28.672576 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670976 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:26:28.673038 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670979 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:26:28.673038 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670982 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:26:28.673038 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670984 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:26:28.673038 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670988 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:26:28.673038 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670990 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:26:28.673038 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670993 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:26:28.673038 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670995 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:26:28.673038 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.670998 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:26:28.673038 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671001 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:26:28.673038 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671003 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:26:28.673038 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671007 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:26:28.673038 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671011 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:26:28.673038 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671014 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:26:28.673038 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671017 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:26:28.673038 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671020 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:26:28.673038 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671023 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:26:28.673038 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671026 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:26:28.673038 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671031 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:26:28.673038 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671034 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:26:28.673488 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671038 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:26:28.673488 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671040 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:26:28.673488 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671043 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:26:28.673488 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671046 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:26:28.673488 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671048 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:26:28.673488 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671051 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:26:28.673488 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671054 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:26:28.673488 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671057 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:26:28.673488 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671060 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:26:28.673488 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671062 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:26:28.673488 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671065 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:26:28.673488 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671067 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:26:28.673488 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671070 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:26:28.673488 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671072 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:26:28.673488 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671075 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:26:28.673488 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671077 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:26:28.673488 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671080 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:26:28.673488 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671082 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:26:28.673488 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671085 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:26:28.673488 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671087 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:26:28.673969 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671090 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:26:28.673969 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671092 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:26:28.673969 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671095 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:26:28.673969 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671097 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:26:28.673969 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671099 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:26:28.673969 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671104 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:26:28.673969 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671107 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:26:28.673969 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671109 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:26:28.673969 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671112 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:26:28.673969 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671114 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:26:28.673969 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671117 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:26:28.673969 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671119 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:26:28.673969 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671122 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:26:28.673969 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671125 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:26:28.673969 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671128 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:26:28.673969 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671131 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:26:28.673969 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671133 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:26:28.673969 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671136 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:26:28.673969 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671138 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:26:28.673969 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671141 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:26:28.674439 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671144 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:26:28.674439 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671148 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:26:28.674439 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671151 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:26:28.674439 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671154 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:26:28.674439 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671157 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:26:28.674439 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671159 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:26:28.674439 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671161 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:26:28.674439 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671164 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:26:28.674439 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671166 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:26:28.674439 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671169 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:26:28.674439 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671171 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:26:28.674439 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671174 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:26:28.674439 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671177 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:26:28.674439 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671179 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:26:28.674439 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671181 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:26:28.674439 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671184 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:26:28.674439 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671186 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:26:28.674439 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671190 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:26:28.674439 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671193 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:26:28.674908 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671196 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:26:28.674908 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671198 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:26:28.674908 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671201 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:26:28.674908 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671265 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 15:26:28.674908 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671271 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 15:26:28.674908 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671276 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 15:26:28.674908 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671280 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 15:26:28.674908 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671285 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 15:26:28.674908 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671288 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 15:26:28.674908 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671292 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 15:26:28.674908 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671296 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 15:26:28.674908 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671299 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 15:26:28.674908 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671303 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 15:26:28.674908 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671306 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 15:26:28.674908 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671310 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 15:26:28.674908 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671313 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 15:26:28.674908 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671316 2578 flags.go:64] FLAG: --cgroup-root="" Jul 02 15:26:28.674908 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671319 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 15:26:28.674908 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671322 2578 flags.go:64] FLAG: --client-ca-file="" Jul 02 15:26:28.674908 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671324 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 02 15:26:28.674908 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671327 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 15:26:28.674908 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671331 2578 flags.go:64] FLAG: --cluster-domain="" Jul 02 15:26:28.674908 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671333 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 15:26:28.674908 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671337 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 15:26:28.675479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671340 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 15:26:28.675479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671343 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 15:26:28.675479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671347 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 15:26:28.675479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671350 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 15:26:28.675479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671353 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 15:26:28.675479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671356 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 15:26:28.675479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671361 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 02 15:26:28.675479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671364 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 15:26:28.675479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671367 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 15:26:28.675479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671370 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 15:26:28.675479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671373 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 15:26:28.675479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671377 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 15:26:28.675479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671380 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 15:26:28.675479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671382 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 15:26:28.675479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671385 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 15:26:28.675479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671388 2578 flags.go:64] FLAG: --enable-server="true" Jul 02 15:26:28.675479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671391 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 15:26:28.675479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671395 2578 flags.go:64] FLAG: --event-burst="100" Jul 02 15:26:28.675479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671398 2578 flags.go:64] FLAG: --event-qps="50" Jul 02 15:26:28.675479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671401 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 15:26:28.675479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671403 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 15:26:28.675479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671406 2578 flags.go:64] FLAG: --eviction-hard="" Jul 02 15:26:28.675479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671410 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 15:26:28.675479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671413 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 15:26:28.676119 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671416 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 15:26:28.676119 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671419 2578 flags.go:64] FLAG: --eviction-soft="" Jul 02 15:26:28.676119 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671422 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 15:26:28.676119 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671425 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 15:26:28.676119 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671427 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 15:26:28.676119 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671430 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 15:26:28.676119 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671433 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 15:26:28.676119 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671437 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 15:26:28.676119 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671440 2578 flags.go:64] FLAG: --feature-gates="" Jul 02 15:26:28.676119 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671444 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 15:26:28.676119 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671446 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 15:26:28.676119 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671449 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 15:26:28.676119 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671452 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 15:26:28.676119 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671455 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 02 15:26:28.676119 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671460 2578 flags.go:64] FLAG: --help="false" Jul 02 15:26:28.676119 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671463 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-135-113.ec2.internal" Jul 02 15:26:28.676119 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671466 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 15:26:28.676119 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671469 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 15:26:28.676119 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671472 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 15:26:28.676119 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671475 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 15:26:28.676119 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671478 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 15:26:28.676119 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671481 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 15:26:28.676119 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671484 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 15:26:28.676714 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671487 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 15:26:28.676714 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671489 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 15:26:28.676714 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671492 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 15:26:28.676714 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671496 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 15:26:28.676714 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671498 2578 flags.go:64] FLAG: --kube-reserved="" Jul 02 15:26:28.676714 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671501 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 15:26:28.676714 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671504 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 15:26:28.676714 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671507 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 15:26:28.676714 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671509 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 15:26:28.676714 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671513 2578 flags.go:64] FLAG: --lock-file="" Jul 02 15:26:28.676714 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671515 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 15:26:28.676714 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671518 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 15:26:28.676714 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671521 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 15:26:28.676714 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671526 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 15:26:28.676714 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671529 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 15:26:28.676714 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671531 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 15:26:28.676714 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671535 2578 flags.go:64] FLAG: --logging-format="text" Jul 02 15:26:28.676714 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671538 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 15:26:28.676714 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671541 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 15:26:28.676714 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671544 2578 flags.go:64] FLAG: --manifest-url="" Jul 02 15:26:28.676714 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671547 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 02 15:26:28.676714 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671551 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 15:26:28.676714 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671554 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 15:26:28.676714 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671559 2578 flags.go:64] FLAG: --max-pods="110" Jul 02 15:26:28.676714 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671562 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 15:26:28.677324 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671564 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 15:26:28.677324 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671567 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 15:26:28.677324 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671570 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 15:26:28.677324 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671573 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 15:26:28.677324 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671576 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 15:26:28.677324 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671579 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 15:26:28.677324 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671586 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 15:26:28.677324 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671589 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 15:26:28.677324 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671592 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 15:26:28.677324 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671596 2578 flags.go:64] FLAG: --pod-cidr="" Jul 02 15:26:28.677324 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671599 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 02 15:26:28.677324 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671612 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 15:26:28.677324 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671615 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 15:26:28.677324 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671618 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 02 15:26:28.677324 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671621 2578 flags.go:64] FLAG: --port="10250" Jul 02 15:26:28.677324 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671624 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 15:26:28.677324 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671626 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cdebb6dfdbd5e676" Jul 02 15:26:28.677324 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671630 2578 flags.go:64] FLAG: --qos-reserved="" Jul 02 15:26:28.677324 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671633 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 02 15:26:28.677324 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671636 2578 flags.go:64] FLAG: --register-node="true" Jul 02 15:26:28.677324 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671639 2578 flags.go:64] FLAG: --register-with-taints="" Jul 02 15:26:28.677324 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671642 2578 flags.go:64] FLAG: --registry-burst="10" Jul 02 15:26:28.677324 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671645 2578 flags.go:64] FLAG: --registry-qps="5" Jul 02 15:26:28.677324 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671648 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 02 15:26:28.677973 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671651 2578 flags.go:64] FLAG: --reserved-memory="" Jul 02 15:26:28.677973 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671654 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 15:26:28.677973 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671657 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 15:26:28.677973 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671660 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 15:26:28.677973 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671663 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 15:26:28.677973 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671665 2578 flags.go:64] FLAG: --runonce="false" Jul 02 15:26:28.677973 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671668 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 15:26:28.677973 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671672 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 15:26:28.677973 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671675 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 02 15:26:28.677973 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671678 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 15:26:28.677973 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671681 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 15:26:28.677973 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671683 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 15:26:28.677973 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671686 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 15:26:28.677973 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671689 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 15:26:28.677973 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671692 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 15:26:28.677973 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671695 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 15:26:28.677973 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671697 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 15:26:28.677973 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671700 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 15:26:28.677973 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671703 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 15:26:28.677973 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671705 2578 flags.go:64] FLAG: --system-cgroups="" Jul 02 15:26:28.677973 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671708 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 15:26:28.677973 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671713 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 15:26:28.677973 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671716 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 02 15:26:28.677973 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671719 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 15:26:28.677973 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671722 2578 flags.go:64] FLAG: --tls-min-version="" Jul 02 15:26:28.678621 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671725 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 15:26:28.678621 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671728 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 15:26:28.678621 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671731 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 15:26:28.678621 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671734 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 15:26:28.678621 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671736 2578 flags.go:64] FLAG: --v="2" Jul 02 15:26:28.678621 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671740 2578 flags.go:64] FLAG: --version="false" Jul 02 15:26:28.678621 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671744 2578 flags.go:64] FLAG: --vmodule="" Jul 02 15:26:28.678621 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671747 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 15:26:28.678621 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.671750 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 15:26:28.678621 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671866 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:26:28.678621 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671869 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:26:28.678621 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671872 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:26:28.678621 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671875 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:26:28.678621 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671877 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:26:28.678621 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671880 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:26:28.678621 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671882 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:26:28.678621 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671885 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:26:28.678621 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671887 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:26:28.678621 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671903 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:26:28.678621 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671906 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:26:28.678621 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671909 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:26:28.678621 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671911 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:26:28.679510 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671914 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:26:28.679510 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671916 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:26:28.679510 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671919 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:26:28.679510 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671922 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:26:28.679510 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671924 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:26:28.679510 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671926 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:26:28.679510 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671929 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:26:28.679510 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671932 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:26:28.679510 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671934 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:26:28.679510 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671937 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:26:28.679510 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671940 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:26:28.679510 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671942 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:26:28.679510 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671946 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:26:28.679510 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671949 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:26:28.679510 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671951 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:26:28.679510 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671954 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:26:28.679510 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671956 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:26:28.679510 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671959 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:26:28.679510 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671963 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:26:28.679510 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671966 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:26:28.680146 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671969 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:26:28.680146 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671972 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:26:28.680146 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671974 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:26:28.680146 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671977 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:26:28.680146 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671981 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:26:28.680146 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671983 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:26:28.680146 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671986 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:26:28.680146 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671988 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:26:28.680146 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671991 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:26:28.680146 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671993 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:26:28.680146 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671996 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:26:28.680146 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.671998 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:26:28.680146 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672001 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:26:28.680146 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672003 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:26:28.680146 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672006 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:26:28.680146 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672008 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:26:28.680146 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672010 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:26:28.680146 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672013 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:26:28.680146 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672015 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:26:28.680627 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672018 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:26:28.680627 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672020 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:26:28.680627 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672023 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:26:28.680627 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672025 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:26:28.680627 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672028 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:26:28.680627 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672032 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:26:28.680627 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672035 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:26:28.680627 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672038 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:26:28.680627 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672041 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:26:28.680627 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672044 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:26:28.680627 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672046 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:26:28.680627 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672050 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:26:28.680627 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672054 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:26:28.680627 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672056 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:26:28.680627 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672059 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:26:28.680627 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672061 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:26:28.680627 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672064 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:26:28.680627 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672066 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:26:28.680627 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672069 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:26:28.681110 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672071 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:26:28.681110 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672073 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:26:28.681110 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672076 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:26:28.681110 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672078 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:26:28.681110 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672081 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:26:28.681110 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672083 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:26:28.681110 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672086 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:26:28.681110 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672088 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:26:28.681110 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672091 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:26:28.681110 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672094 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:26:28.681110 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672096 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:26:28.681110 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672098 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:26:28.681110 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672101 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:26:28.681110 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672104 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:26:28.681110 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672106 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:26:28.681110 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672109 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:26:28.681110 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672111 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:26:28.681110 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672114 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:26:28.681110 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672117 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:26:28.681110 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672119 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:26:28.681588 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672122 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:26:28.681588 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672124 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:26:28.681588 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672129 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:26:28.681588 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672132 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:26:28.681588 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672135 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:26:28.681588 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672137 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:26:28.681588 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672139 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:26:28.681588 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.672142 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:26:28.681588 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.672768 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 15:26:28.681588 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.680832 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 15:26:28.681588 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.680845 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 15:26:28.681865 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.681783 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 15:26:28.681865 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.681795 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 15:26:28.681865 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681855 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:26:28.681865 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681860 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:26:28.681865 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681863 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:26:28.681865 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681866 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:26:28.682027 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681869 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:26:28.682027 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681872 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:26:28.682027 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681875 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:26:28.682027 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681877 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:26:28.682027 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681880 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:26:28.682027 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681882 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:26:28.682027 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681885 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:26:28.682027 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681887 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:26:28.682027 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681890 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:26:28.682027 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681904 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:26:28.682027 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681907 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:26:28.682027 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681909 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:26:28.682027 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681912 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:26:28.682027 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681914 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:26:28.682027 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681917 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:26:28.682027 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681920 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:26:28.682027 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681924 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:26:28.682027 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681926 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:26:28.682027 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681929 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:26:28.682027 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681931 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:26:28.682491 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681934 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:26:28.682491 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681937 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:26:28.682491 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681939 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:26:28.682491 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681941 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:26:28.682491 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681944 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:26:28.682491 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681946 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:26:28.682491 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681949 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:26:28.682491 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681951 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:26:28.682491 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681954 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:26:28.682491 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681956 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:26:28.682491 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681958 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:26:28.682491 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681961 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:26:28.682491 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681963 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:26:28.682491 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681967 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:26:28.682491 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681969 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:26:28.682491 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681972 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:26:28.682491 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681975 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:26:28.682491 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681977 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:26:28.682491 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681980 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:26:28.682960 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681982 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:26:28.682960 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681985 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:26:28.682960 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681987 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:26:28.682960 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681990 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:26:28.682960 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681992 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:26:28.682960 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681995 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:26:28.682960 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.681997 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:26:28.682960 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682000 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:26:28.682960 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682002 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:26:28.682960 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682005 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:26:28.682960 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682008 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:26:28.682960 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682010 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:26:28.682960 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682013 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:26:28.682960 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682016 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:26:28.682960 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682018 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:26:28.682960 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682021 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:26:28.682960 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682025 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:26:28.682960 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682028 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:26:28.682960 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682032 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:26:28.683402 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682036 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:26:28.683402 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682040 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:26:28.683402 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682043 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:26:28.683402 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682046 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:26:28.683402 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682049 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:26:28.683402 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682052 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:26:28.683402 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682054 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:26:28.683402 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682057 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:26:28.683402 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682060 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:26:28.683402 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682062 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:26:28.683402 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682065 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:26:28.683402 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682068 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:26:28.683402 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682070 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:26:28.683402 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682073 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:26:28.683402 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682075 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:26:28.683402 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682078 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:26:28.683402 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682080 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:26:28.683402 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682085 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:26:28.683402 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682089 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:26:28.683980 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682091 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:26:28.683980 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682094 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:26:28.683980 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682097 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:26:28.683980 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682099 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:26:28.683980 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682102 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:26:28.683980 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682104 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:26:28.683980 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682107 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:26:28.683980 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682109 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:26:28.683980 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682112 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:26:28.683980 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682115 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:26:28.683980 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682117 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:26:28.683980 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682120 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:26:28.683980 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682122 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:26:28.683980 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682124 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:26:28.683980 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682127 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:26:28.683980 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682129 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:26:28.683980 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682132 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:26:28.683980 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682135 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:26:28.684400 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.682139 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 15:26:28.684400 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682247 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:26:28.684400 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682253 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:26:28.684400 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682257 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:26:28.684400 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682260 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:26:28.684400 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682263 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:26:28.684400 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682266 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:26:28.684400 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682268 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:26:28.684400 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682271 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:26:28.684400 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682274 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:26:28.684400 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682276 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:26:28.684400 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682279 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:26:28.684400 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682281 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:26:28.684400 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682284 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:26:28.684400 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682287 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:26:28.684761 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682289 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:26:28.684761 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682292 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:26:28.684761 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682294 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:26:28.684761 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682297 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:26:28.684761 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682299 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:26:28.684761 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682302 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:26:28.684761 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682304 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:26:28.684761 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682306 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:26:28.684761 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682309 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:26:28.684761 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682311 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:26:28.684761 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682314 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:26:28.684761 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682317 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:26:28.684761 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682321 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:26:28.684761 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682324 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:26:28.684761 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682327 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:26:28.684761 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682330 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:26:28.684761 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682333 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:26:28.684761 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682335 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:26:28.684761 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682338 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:26:28.685214 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682341 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:26:28.685214 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682344 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:26:28.685214 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682346 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:26:28.685214 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682349 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:26:28.685214 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682351 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:26:28.685214 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682354 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:26:28.685214 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682356 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:26:28.685214 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682359 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:26:28.685214 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682362 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:26:28.685214 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682364 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:26:28.685214 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682366 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:26:28.685214 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682369 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:26:28.685214 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682372 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:26:28.685214 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682375 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:26:28.685214 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682377 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:26:28.685214 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682380 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:26:28.685214 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682382 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:26:28.685214 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682385 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:26:28.685214 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682387 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:26:28.685214 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682390 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:26:28.685678 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682392 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:26:28.685678 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682394 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:26:28.685678 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682397 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:26:28.685678 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682399 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:26:28.685678 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682402 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:26:28.685678 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682404 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:26:28.685678 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682406 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:26:28.685678 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682409 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:26:28.685678 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682411 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:26:28.685678 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682415 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:26:28.685678 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682418 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:26:28.685678 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682421 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:26:28.685678 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682425 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:26:28.685678 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682428 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:26:28.685678 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682431 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:26:28.685678 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682433 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:26:28.685678 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682436 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:26:28.685678 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682439 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:26:28.685678 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682441 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:26:28.686138 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682444 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:26:28.686138 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682446 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:26:28.686138 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682449 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:26:28.686138 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682451 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:26:28.686138 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682454 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:26:28.686138 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682456 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:26:28.686138 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682459 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:26:28.686138 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682462 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:26:28.686138 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682464 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:26:28.686138 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682467 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:26:28.686138 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682469 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:26:28.686138 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682471 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:26:28.686138 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682474 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:26:28.686138 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682476 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:26:28.686138 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682479 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:26:28.686138 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682481 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:26:28.686138 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682484 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:26:28.686138 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682486 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:26:28.686138 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682489 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:26:28.686587 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682491 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:26:28.686587 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682494 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:26:28.686587 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682496 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:26:28.686587 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682499 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:26:28.686587 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682501 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:26:28.686587 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682505 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:26:28.686587 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682509 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:26:28.686587 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:28.682511 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:26:28.686587 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.682516 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 15:26:28.686587 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.682621 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 15:26:28.686587 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.684631 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 15:26:28.686587 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.686017 2578 server.go:1019] "Starting client certificate rotation" Jul 02 15:26:28.686587 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.686117 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 15:26:28.686910 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.686150 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 15:26:28.689645 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.689631 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 15:26:28.690900 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.690879 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 15:26:28.706834 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.706817 2578 log.go:25] "Validated CRI v1 runtime API" Jul 02 15:26:28.710449 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.710435 2578 log.go:25] "Validated CRI v1 image API" Jul 02 15:26:28.711247 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.711219 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 15:26:28.713598 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.713576 2578 fs.go:135] Filesystem UUIDs: map[1843dd26-68e0-4a69-bca7-4b9e7d2e0d1c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 af98aba2-fb78-4280-bf82-bf9f86fabe04:/dev/nvme0n1p3] Jul 02 15:26:28.713666 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.713598 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 15:26:28.720481 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.720364 2578 manager.go:216] Machine: {Timestamp:2026-07-02 15:26:28.718733505 +0000 UTC m=+0.348694374 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3091763 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20eca3004a6eea081b14352adb856b SystemUUID:ec20eca3-004a-6eea-081b-14352adb856b BootID:1c1b1c13-2738-48d1-a8de-fb16869f2142 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:57:70:64:44:61 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:57:70:64:44:61 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:7c:e8:c9:8b:83 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 15:26:28.720481 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.720468 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 15:26:28.720627 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.720548 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 15:26:28.721645 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.721629 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 15:26:28.723373 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.723344 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 15:26:28.723502 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.723377 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-113.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 15:26:28.724103 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.724093 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 15:26:28.724144 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.724107 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 15:26:28.724144 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.724115 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 15:26:28.727745 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.727734 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 15:26:28.728541 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.728532 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 15:26:28.731181 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.731170 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 02 15:26:28.731294 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.731285 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 15:26:28.731323 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.731313 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 02 15:26:28.731350 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.731323 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 15:26:28.731350 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.731337 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 15:26:28.731350 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.731346 2578 kubelet.go:398] "Adding apiserver pod source" Jul 02 15:26:28.731448 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.731354 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 15:26:28.731716 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.731704 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 15:26:28.731767 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.731721 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 15:26:28.734003 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.733987 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 15:26:28.735678 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.735658 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 15:26:28.735752 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.735693 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 15:26:28.736278 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.736267 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 15:26:28.736326 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.736283 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 15:26:28.736326 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.736290 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 15:26:28.736326 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.736295 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 15:26:28.736326 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.736303 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 15:26:28.736326 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.736309 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 15:26:28.736616 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.736607 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 15:26:28.736616 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.736616 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 15:26:28.736679 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.736622 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 15:26:28.736679 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.736627 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 15:26:28.736679 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.736635 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 15:26:28.736679 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.736644 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 15:26:28.737416 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.737407 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 15:26:28.737416 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.737416 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 15:26:28.740642 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.740629 2578 server.go:1268] "Started kubelet" Jul 02 15:26:28.740760 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.740707 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 15:26:28.740865 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.740776 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 15:26:28.740865 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.740774 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 15:26:28.741369 ip-10-0-135-113 systemd[1]: Started Kubernetes Kubelet. Jul 02 15:26:28.742340 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.742262 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 15:26:28.742605 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.742588 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 02 15:26:28.744946 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:28.744909 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 15:26:28.745472 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.745425 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-113.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 15:26:28.745552 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:28.745477 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-113.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 15:26:28.745552 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:28.745535 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 15:26:28.747650 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.747636 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 15:26:28.747714 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.747653 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 15:26:28.747761 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:28.747726 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-113.ec2.internal\" not found" Jul 02 15:26:28.748289 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.748267 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 15:26:28.748289 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.748288 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 15:26:28.748447 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.748435 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 02 15:26:28.748447 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.748448 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 02 15:26:28.748541 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.748493 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 15:26:28.748780 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.748762 2578 factory.go:55] Registering systemd factory Jul 02 15:26:28.748780 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.748781 2578 factory.go:223] Registration of the systemd container factory successfully Jul 02 15:26:28.749066 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.749053 2578 factory.go:153] Registering CRI-O factory Jul 02 15:26:28.749115 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.749069 2578 factory.go:223] Registration of the crio container factory successfully Jul 02 15:26:28.749161 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.749117 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 15:26:28.749161 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.749156 2578 factory.go:103] Registering Raw factory Jul 02 15:26:28.749277 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.749170 2578 manager.go:1196] Started watching for new ooms in manager Jul 02 15:26:28.749569 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.749558 2578 manager.go:349] Starting recovery of all containers Jul 02 15:26:28.751057 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:28.751028 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-113.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 15:26:28.751134 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:28.751098 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 02 15:26:28.752358 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:28.751191 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-113.ec2.internal.18be827fff471fd0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-113.ec2.internal,UID:ip-10-0-135-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-113.ec2.internal,},FirstTimestamp:2026-07-02 15:26:28.740603856 +0000 UTC m=+0.370564707,LastTimestamp:2026-07-02 15:26:28.740603856 +0000 UTC m=+0.370564707,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-113.ec2.internal,}" Jul 02 15:26:28.754596 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.754572 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pc9qh" Jul 02 15:26:28.760262 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.760244 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pc9qh" Jul 02 15:26:28.761187 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.761172 2578 manager.go:354] Recovery completed Jul 02 15:26:28.766066 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.766052 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:26:28.767928 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.767911 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-113.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:26:28.768019 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.767946 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-113.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:26:28.768019 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.767964 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-113.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:26:28.768498 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.768483 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 15:26:28.768498 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.768491 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:26:28.768498 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.768497 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 15:26:28.768652 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.768512 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 02 15:26:28.769148 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.769130 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-113.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:26:28.769203 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.769165 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-113.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:26:28.769203 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.769180 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-113.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:26:28.769491 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.769477 2578 policy_none.go:49] "None policy: Start" Jul 02 15:26:28.769491 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.769493 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 15:26:28.769602 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.769503 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 15:26:28.769602 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:28.769468 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-113.ec2.internal.18be828000e80fe5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-113.ec2.internal,UID:ip-10-0-135-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-113.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-113.ec2.internal,},FirstTimestamp:2026-07-02 15:26:28.767928293 +0000 UTC m=+0.397889137,LastTimestamp:2026-07-02 15:26:28.767928293 +0000 UTC m=+0.397889137,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-113.ec2.internal,}" Jul 02 15:26:28.770509 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.770498 2578 policy_none.go:47] "Start" Jul 02 15:26:28.803497 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.803472 2578 manager.go:337] "Starting Device Plugin manager" Jul 02 15:26:28.826122 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:28.803518 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 15:26:28.826122 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.803546 2578 server.go:87] "Starting device plugin registration server" Jul 02 15:26:28.826122 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.803824 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 15:26:28.826122 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.803836 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 15:26:28.826122 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.803953 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 15:26:28.826122 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.804070 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 15:26:28.826122 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.804079 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 15:26:28.826122 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:28.804627 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 15:26:28.826122 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:28.804671 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-113.ec2.internal\" not found" Jul 02 15:26:28.826122 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.809427 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 15:26:28.826122 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.810645 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 15:26:28.826122 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.810691 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 15:26:28.826122 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.810717 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 15:26:28.826122 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:28.810759 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 15:26:28.826122 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.812882 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:26:28.904659 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.904624 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:26:28.905595 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.905579 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-113.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:26:28.905696 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.905608 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-113.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:26:28.905696 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.905618 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-113.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:26:28.905696 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.905641 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-113.ec2.internal" Jul 02 15:26:28.911491 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.911472 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-113.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-113.ec2.internal"] Jul 02 15:26:28.911564 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.911536 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:26:28.912320 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.912302 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-113.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:26:28.912374 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.912328 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-113.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:26:28.912374 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.912337 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-113.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:26:28.913550 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.913538 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:26:28.913690 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.913675 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-113.ec2.internal" Jul 02 15:26:28.913755 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.913744 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:26:28.914218 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.914204 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-113.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:26:28.914290 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.914230 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-113.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:26:28.914290 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.914245 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-113.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:26:28.914365 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.914245 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-113.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:26:28.914397 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.914364 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-113.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:26:28.914397 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.914379 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-113.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:26:28.914610 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.914598 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-113.ec2.internal" Jul 02 15:26:28.914668 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:28.914617 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-113.ec2.internal\": node \"ip-10-0-135-113.ec2.internal\" not found" Jul 02 15:26:28.915425 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.915408 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-113.ec2.internal" Jul 02 15:26:28.915518 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.915437 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:26:28.916526 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.916511 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-113.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:26:28.916614 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.916539 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-113.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:26:28.916614 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.916552 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-113.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:26:28.932206 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:28.932189 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-113.ec2.internal\" not found" Jul 02 15:26:28.945511 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:28.945486 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-113.ec2.internal\" not found" node="ip-10-0-135-113.ec2.internal" Jul 02 15:26:28.949847 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.949830 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6dfe551c5f5beaf25438e21f19169d54-config\") pod \"kube-apiserver-proxy-ip-10-0-135-113.ec2.internal\" (UID: \"6dfe551c5f5beaf25438e21f19169d54\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-113.ec2.internal" Jul 02 15:26:28.949955 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.949858 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0d79fcf6aab83ff3e91b7984ecf86f04-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-113.ec2.internal\" (UID: \"0d79fcf6aab83ff3e91b7984ecf86f04\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-113.ec2.internal" Jul 02 15:26:28.949955 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:28.949875 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-113.ec2.internal\" not found" node="ip-10-0-135-113.ec2.internal" Jul 02 15:26:28.949955 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:28.949912 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d79fcf6aab83ff3e91b7984ecf86f04-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-113.ec2.internal\" (UID: \"0d79fcf6aab83ff3e91b7984ecf86f04\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-113.ec2.internal" Jul 02 15:26:29.032600 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:29.032567 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-113.ec2.internal\" not found" Jul 02 15:26:29.050802 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:29.050726 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6dfe551c5f5beaf25438e21f19169d54-config\") pod \"kube-apiserver-proxy-ip-10-0-135-113.ec2.internal\" (UID: \"6dfe551c5f5beaf25438e21f19169d54\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-113.ec2.internal" Jul 02 15:26:29.050802 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:29.050754 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0d79fcf6aab83ff3e91b7984ecf86f04-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-113.ec2.internal\" (UID: \"0d79fcf6aab83ff3e91b7984ecf86f04\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-113.ec2.internal" Jul 02 15:26:29.050802 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:29.050771 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d79fcf6aab83ff3e91b7984ecf86f04-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-113.ec2.internal\" (UID: \"0d79fcf6aab83ff3e91b7984ecf86f04\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-113.ec2.internal" Jul 02 15:26:29.050802 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:29.050798 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d79fcf6aab83ff3e91b7984ecf86f04-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-113.ec2.internal\" (UID: \"0d79fcf6aab83ff3e91b7984ecf86f04\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-113.ec2.internal" Jul 02 15:26:29.051052 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:29.050817 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6dfe551c5f5beaf25438e21f19169d54-config\") pod \"kube-apiserver-proxy-ip-10-0-135-113.ec2.internal\" (UID: \"6dfe551c5f5beaf25438e21f19169d54\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-113.ec2.internal" Jul 02 15:26:29.051052 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:29.050842 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0d79fcf6aab83ff3e91b7984ecf86f04-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-113.ec2.internal\" (UID: \"0d79fcf6aab83ff3e91b7984ecf86f04\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-113.ec2.internal" Jul 02 15:26:29.132878 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:29.132850 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-113.ec2.internal\" not found" Jul 02 15:26:29.233631 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:29.233591 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-113.ec2.internal\" not found" Jul 02 15:26:29.248778 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:29.248759 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-113.ec2.internal" Jul 02 15:26:29.252873 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:29.252858 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-113.ec2.internal" Jul 02 15:26:29.334610 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:29.334531 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-113.ec2.internal\" not found" Jul 02 15:26:29.435032 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:29.435000 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-113.ec2.internal\" not found" Jul 02 15:26:29.535620 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:29.535577 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-113.ec2.internal\" not found" Jul 02 15:26:29.636080 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:29.636046 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-113.ec2.internal\" not found" Jul 02 15:26:29.665960 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:29.665935 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:26:29.684961 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:29.684937 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 15:26:29.685057 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:29.685042 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 15:26:29.685125 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:29.685099 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 15:26:29.733481 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:29.733457 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:26:29.748509 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:29.748483 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-113.ec2.internal" Jul 02 15:26:29.748615 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:29.748511 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 15:26:29.759218 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:29.759198 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 15:26:29.764945 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:29.764919 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 15:21:28 +0000 UTC" deadline="2028-01-24 16:15:10.914512559 +0000 UTC" Jul 02 15:26:29.764945 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:29.764941 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13704h48m41.149574401s" Jul 02 15:26:29.768742 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:29.768730 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 15:26:29.769765 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:29.769754 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-113.ec2.internal" Jul 02 15:26:29.779214 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:29.779199 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 15:26:29.784597 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:29.784583 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rgzkq" Jul 02 15:26:29.792804 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:29.792787 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rgzkq" Jul 02 15:26:29.908824 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:29.908774 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d79fcf6aab83ff3e91b7984ecf86f04.slice/crio-f09bb2dd5c091144c5de8b4659b810bc6feaa980bc26a622d83c6b75340ed50f WatchSource:0}: Error finding container f09bb2dd5c091144c5de8b4659b810bc6feaa980bc26a622d83c6b75340ed50f: Status 404 returned error can't find the container with id f09bb2dd5c091144c5de8b4659b810bc6feaa980bc26a622d83c6b75340ed50f Jul 02 15:26:29.913636 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:29.913615 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 15:26:29.932370 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:29.932345 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dfe551c5f5beaf25438e21f19169d54.slice/crio-71dbcc79490242cf99dc19ec3f9bc01bd65ed2089c985d284277b7cf25775780 WatchSource:0}: Error finding container 71dbcc79490242cf99dc19ec3f9bc01bd65ed2089c985d284277b7cf25775780: Status 404 returned error can't find the container with id 71dbcc79490242cf99dc19ec3f9bc01bd65ed2089c985d284277b7cf25775780 Jul 02 15:26:30.346193 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.346110 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:26:30.731769 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.731741 2578 apiserver.go:52] "Watching apiserver" Jul 02 15:26:30.740518 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.740308 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 15:26:30.743853 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.743820 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-w55cq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-113.ec2.internal","openshift-multus/network-metrics-daemon-jm5ld","openshift-network-diagnostics/network-check-target-w528n","openshift-network-operator/iptables-alerter-gp8zn","kube-system/global-pull-secret-syncer-7z5mp","kube-system/kube-apiserver-proxy-ip-10-0-135-113.ec2.internal","openshift-image-registry/node-ca-htbq4","openshift-multus/multus-additional-cni-plugins-pxskq","openshift-multus/multus-klcnm","openshift-ovn-kubernetes/ovnkube-node-2pztp","kube-system/konnectivity-agent-97w5x","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t","openshift-cluster-node-tuning-operator/tuned-lxcrb"] Jul 02 15:26:30.745288 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.745268 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:26:30.745380 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:30.745360 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w528n" podUID="f85b2e6b-f8cc-4efd-87d3-6d85423e64a4" Jul 02 15:26:30.746468 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.746445 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gp8zn" Jul 02 15:26:30.747596 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.747502 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:26:30.747596 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:30.747562 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm5ld" podUID="be11a647-3b83-4a29-8f80-29cab689e649" Jul 02 15:26:30.748754 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.748222 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6kpgz\"" Jul 02 15:26:30.748754 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.748516 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 15:26:30.748754 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.748656 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 15:26:30.748754 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.748713 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 15:26:30.748995 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.748964 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:26:30.749050 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:30.749020 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7z5mp" podUID="ac822a5a-c97b-4159-ac19-0000a2b4abfb" Jul 02 15:26:30.751332 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.751311 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w55cq" Jul 02 15:26:30.752502 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.752481 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-htbq4" Jul 02 15:26:30.753147 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.753129 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 15:26:30.753988 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.753736 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pxskq" Jul 02 15:26:30.753988 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.753864 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ns8xc\"" Jul 02 15:26:30.754119 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.754084 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 15:26:30.755048 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.754340 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 15:26:30.755048 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.754647 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sgthj\"" Jul 02 15:26:30.755048 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.754863 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 15:26:30.755306 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.755291 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 15:26:30.755866 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.755518 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.757015 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.756201 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 15:26:30.757015 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.756315 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 15:26:30.757015 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.756595 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 15:26:30.757015 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.756730 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nm5jb\"" Jul 02 15:26:30.757015 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.757000 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 15:26:30.757506 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.757155 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.758032 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.757719 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 15:26:30.759363 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.758432 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be11a647-3b83-4a29-8f80-29cab689e649-metrics-certs\") pod \"network-metrics-daemon-jm5ld\" (UID: \"be11a647-3b83-4a29-8f80-29cab689e649\") " pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:26:30.759363 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.758463 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6ab9c6a-2d0b-44aa-bffe-dde4a008d96b-tmp-dir\") pod \"node-resolver-w55cq\" (UID: \"c6ab9c6a-2d0b-44aa-bffe-dde4a008d96b\") " pod="openshift-dns/node-resolver-w55cq" Jul 02 15:26:30.759363 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.758486 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g59nm\" (UniqueName: \"kubernetes.io/projected/c6ab9c6a-2d0b-44aa-bffe-dde4a008d96b-kube-api-access-g59nm\") pod \"node-resolver-w55cq\" (UID: \"c6ab9c6a-2d0b-44aa-bffe-dde4a008d96b\") " pod="openshift-dns/node-resolver-w55cq" Jul 02 15:26:30.759363 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.758512 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lm4c\" (UniqueName: \"kubernetes.io/projected/be11a647-3b83-4a29-8f80-29cab689e649-kube-api-access-6lm4c\") pod \"network-metrics-daemon-jm5ld\" (UID: \"be11a647-3b83-4a29-8f80-29cab689e649\") " pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:26:30.759363 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.758535 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c6ab9c6a-2d0b-44aa-bffe-dde4a008d96b-hosts-file\") pod \"node-resolver-w55cq\" (UID: \"c6ab9c6a-2d0b-44aa-bffe-dde4a008d96b\") " pod="openshift-dns/node-resolver-w55cq" Jul 02 15:26:30.759363 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.758559 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d1c4a839-8c2d-43f5-ac6e-4bc4c531bf7f-iptables-alerter-script\") pod \"iptables-alerter-gp8zn\" (UID: \"d1c4a839-8c2d-43f5-ac6e-4bc4c531bf7f\") " pod="openshift-network-operator/iptables-alerter-gp8zn" Jul 02 15:26:30.759363 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.758583 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ac822a5a-c97b-4159-ac19-0000a2b4abfb-dbus\") pod \"global-pull-secret-syncer-7z5mp\" (UID: \"ac822a5a-c97b-4159-ac19-0000a2b4abfb\") " pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:26:30.759363 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.758604 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac822a5a-c97b-4159-ac19-0000a2b4abfb-original-pull-secret\") pod \"global-pull-secret-syncer-7z5mp\" (UID: \"ac822a5a-c97b-4159-ac19-0000a2b4abfb\") " pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:26:30.759363 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.758628 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw5wd\" (UniqueName: \"kubernetes.io/projected/f85b2e6b-f8cc-4efd-87d3-6d85423e64a4-kube-api-access-hw5wd\") pod \"network-check-target-w528n\" (UID: \"f85b2e6b-f8cc-4efd-87d3-6d85423e64a4\") " pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:26:30.759363 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.758673 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d1c4a839-8c2d-43f5-ac6e-4bc4c531bf7f-host-slash\") pod \"iptables-alerter-gp8zn\" (UID: \"d1c4a839-8c2d-43f5-ac6e-4bc4c531bf7f\") " pod="openshift-network-operator/iptables-alerter-gp8zn" Jul 02 15:26:30.759363 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.758709 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d84q2\" (UniqueName: \"kubernetes.io/projected/d1c4a839-8c2d-43f5-ac6e-4bc4c531bf7f-kube-api-access-d84q2\") pod \"iptables-alerter-gp8zn\" (UID: \"d1c4a839-8c2d-43f5-ac6e-4bc4c531bf7f\") " pod="openshift-network-operator/iptables-alerter-gp8zn" Jul 02 15:26:30.759363 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.758734 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ac822a5a-c97b-4159-ac19-0000a2b4abfb-kubelet-config\") pod \"global-pull-secret-syncer-7z5mp\" (UID: \"ac822a5a-c97b-4159-ac19-0000a2b4abfb\") " pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:26:30.759363 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.759054 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-97w5x" Jul 02 15:26:30.760034 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.759526 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t" Jul 02 15:26:30.761258 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.761020 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 15:26:30.761258 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.761083 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6mz5w\"" Jul 02 15:26:30.761258 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.761176 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.772101 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.771185 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 15:26:30.772101 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.771269 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 15:26:30.772101 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.771325 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 15:26:30.772101 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.771381 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 15:26:30.772101 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.771427 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 15:26:30.772101 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.771614 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 15:26:30.772101 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.771696 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 15:26:30.772101 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.771803 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-thpds\"" Jul 02 15:26:30.772101 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.771965 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 15:26:30.772574 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.772264 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 15:26:30.772574 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.772274 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m8rmg\"" Jul 02 15:26:30.772574 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.772440 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 15:26:30.772574 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.772478 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 15:26:30.772756 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.772699 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vgt8q\"" Jul 02 15:26:30.772802 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.772756 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xd6rj\"" Jul 02 15:26:30.772802 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.772786 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 15:26:30.772935 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.772919 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 15:26:30.794632 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.794610 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 15:21:29 +0000 UTC" deadline="2028-04-16 12:33:10.546435304 +0000 UTC" Jul 02 15:26:30.794719 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.794633 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15693h6m39.751806691s" Jul 02 15:26:30.815907 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.815844 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-113.ec2.internal" event={"ID":"6dfe551c5f5beaf25438e21f19169d54","Type":"ContainerStarted","Data":"71dbcc79490242cf99dc19ec3f9bc01bd65ed2089c985d284277b7cf25775780"} Jul 02 15:26:30.818924 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.818883 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-113.ec2.internal" event={"ID":"0d79fcf6aab83ff3e91b7984ecf86f04","Type":"ContainerStarted","Data":"f09bb2dd5c091144c5de8b4659b810bc6feaa980bc26a622d83c6b75340ed50f"} Jul 02 15:26:30.849789 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.849757 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 15:26:30.859387 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.859361 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be11a647-3b83-4a29-8f80-29cab689e649-metrics-certs\") pod \"network-metrics-daemon-jm5ld\" (UID: \"be11a647-3b83-4a29-8f80-29cab689e649\") " pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:26:30.859493 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.859397 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6ab9c6a-2d0b-44aa-bffe-dde4a008d96b-tmp-dir\") pod \"node-resolver-w55cq\" (UID: \"c6ab9c6a-2d0b-44aa-bffe-dde4a008d96b\") " pod="openshift-dns/node-resolver-w55cq" Jul 02 15:26:30.859493 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.859427 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-var-lib-kubelet\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.859493 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.859454 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/41acdf42-e5fb-4f2c-8316-1c2f1cd993ff-serviceca\") pod \"node-ca-htbq4\" (UID: \"41acdf42-e5fb-4f2c-8316-1c2f1cd993ff\") " pod="openshift-image-registry/node-ca-htbq4" Jul 02 15:26:30.859493 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.859489 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df4w4\" (UniqueName: \"kubernetes.io/projected/41acdf42-e5fb-4f2c-8316-1c2f1cd993ff-kube-api-access-df4w4\") pod \"node-ca-htbq4\" (UID: \"41acdf42-e5fb-4f2c-8316-1c2f1cd993ff\") " pod="openshift-image-registry/node-ca-htbq4" Jul 02 15:26:30.859707 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.859516 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-host-var-lib-cni-multus\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.859707 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.859538 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-log-socket\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.859707 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.859567 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lm4c\" (UniqueName: \"kubernetes.io/projected/be11a647-3b83-4a29-8f80-29cab689e649-kube-api-access-6lm4c\") pod \"network-metrics-daemon-jm5ld\" (UID: \"be11a647-3b83-4a29-8f80-29cab689e649\") " pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:26:30.859707 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.859589 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-etc-kubernetes\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.859707 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.859619 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-multus-socket-dir-parent\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.859707 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.859642 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k879\" (UniqueName: \"kubernetes.io/projected/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-kube-api-access-2k879\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.859707 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.859668 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a6630c1b-3984-4d1b-829f-aaa435022076-registration-dir\") pod \"aws-ebs-csi-driver-node-lhc8t\" (UID: \"a6630c1b-3984-4d1b-829f-aaa435022076\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t" Jul 02 15:26:30.860038 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.859714 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-host\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.860038 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.859733 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ef605e3-b6e6-4783-9012-0d29145c81d3-system-cni-dir\") pod \"multus-additional-cni-plugins-pxskq\" (UID: \"7ef605e3-b6e6-4783-9012-0d29145c81d3\") " pod="openshift-multus/multus-additional-cni-plugins-pxskq" Jul 02 15:26:30.860038 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.859747 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ef605e3-b6e6-4783-9012-0d29145c81d3-cnibin\") pod \"multus-additional-cni-plugins-pxskq\" (UID: \"7ef605e3-b6e6-4783-9012-0d29145c81d3\") " pod="openshift-multus/multus-additional-cni-plugins-pxskq" Jul 02 15:26:30.860038 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.859763 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-run-ovn\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.860038 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.859799 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-host-cni-netd\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.860038 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.859802 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6ab9c6a-2d0b-44aa-bffe-dde4a008d96b-tmp-dir\") pod \"node-resolver-w55cq\" (UID: \"c6ab9c6a-2d0b-44aa-bffe-dde4a008d96b\") " pod="openshift-dns/node-resolver-w55cq" Jul 02 15:26:30.860038 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.859831 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-env-overrides\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.860038 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.859849 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22e80d47-13ae-4515-9425-aa1aa42aa2e1-tmp\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.860038 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.859867 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-host-run-netns\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.860038 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.859918 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-run-systemd\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.860038 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.859949 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g59nm\" (UniqueName: \"kubernetes.io/projected/c6ab9c6a-2d0b-44aa-bffe-dde4a008d96b-kube-api-access-g59nm\") pod \"node-resolver-w55cq\" (UID: \"c6ab9c6a-2d0b-44aa-bffe-dde4a008d96b\") " pod="openshift-dns/node-resolver-w55cq" Jul 02 15:26:30.860038 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.859974 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-host-run-k8s-cni-cncf-io\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.860038 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.859998 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-hostroot\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.860038 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860023 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h8lw\" (UniqueName: \"kubernetes.io/projected/71562d14-f2e6-4ebd-8e73-d1335355bda0-kube-api-access-2h8lw\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.860038 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:30.860033 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:26:30.860725 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860045 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-host-run-netns\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.860725 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860097 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.860725 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:30.860116 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be11a647-3b83-4a29-8f80-29cab689e649-metrics-certs podName:be11a647-3b83-4a29-8f80-29cab689e649 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:31.360090379 +0000 UTC m=+2.990051226 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be11a647-3b83-4a29-8f80-29cab689e649-metrics-certs") pod "network-metrics-daemon-jm5ld" (UID: "be11a647-3b83-4a29-8f80-29cab689e649") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:26:30.860725 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860162 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7ef605e3-b6e6-4783-9012-0d29145c81d3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pxskq\" (UID: \"7ef605e3-b6e6-4783-9012-0d29145c81d3\") " pod="openshift-multus/multus-additional-cni-plugins-pxskq" Jul 02 15:26:30.860725 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860193 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-ovn-node-metrics-cert\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.860725 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860232 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac822a5a-c97b-4159-ac19-0000a2b4abfb-original-pull-secret\") pod \"global-pull-secret-syncer-7z5mp\" (UID: \"ac822a5a-c97b-4159-ac19-0000a2b4abfb\") " pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:26:30.860725 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860271 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-etc-sysconfig\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.860725 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860299 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ef605e3-b6e6-4783-9012-0d29145c81d3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pxskq\" (UID: \"7ef605e3-b6e6-4783-9012-0d29145c81d3\") " pod="openshift-multus/multus-additional-cni-plugins-pxskq" Jul 02 15:26:30.860725 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:30.860312 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:26:30.860725 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860327 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcp7d\" (UniqueName: \"kubernetes.io/projected/7ef605e3-b6e6-4783-9012-0d29145c81d3-kube-api-access-wcp7d\") pod \"multus-additional-cni-plugins-pxskq\" (UID: \"7ef605e3-b6e6-4783-9012-0d29145c81d3\") " pod="openshift-multus/multus-additional-cni-plugins-pxskq" Jul 02 15:26:30.860725 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:30.860359 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac822a5a-c97b-4159-ac19-0000a2b4abfb-original-pull-secret podName:ac822a5a-c97b-4159-ac19-0000a2b4abfb nodeName:}" failed. No retries permitted until 2026-07-02 15:26:31.360342717 +0000 UTC m=+2.990303560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ac822a5a-c97b-4159-ac19-0000a2b4abfb-original-pull-secret") pod "global-pull-secret-syncer-7z5mp" (UID: "ac822a5a-c97b-4159-ac19-0000a2b4abfb") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:26:30.860725 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860377 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-systemd-units\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.860725 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860411 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a6630c1b-3984-4d1b-829f-aaa435022076-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lhc8t\" (UID: \"a6630c1b-3984-4d1b-829f-aaa435022076\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t" Jul 02 15:26:30.860725 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860436 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a6630c1b-3984-4d1b-829f-aaa435022076-sys-fs\") pod \"aws-ebs-csi-driver-node-lhc8t\" (UID: \"a6630c1b-3984-4d1b-829f-aaa435022076\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t" Jul 02 15:26:30.860725 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860462 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw5wd\" (UniqueName: \"kubernetes.io/projected/f85b2e6b-f8cc-4efd-87d3-6d85423e64a4-kube-api-access-hw5wd\") pod \"network-check-target-w528n\" (UID: \"f85b2e6b-f8cc-4efd-87d3-6d85423e64a4\") " pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:26:30.861449 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860501 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d1c4a839-8c2d-43f5-ac6e-4bc4c531bf7f-host-slash\") pod \"iptables-alerter-gp8zn\" (UID: \"d1c4a839-8c2d-43f5-ac6e-4bc4c531bf7f\") " pod="openshift-network-operator/iptables-alerter-gp8zn" Jul 02 15:26:30.861449 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860524 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-sys\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.861449 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860545 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/22e80d47-13ae-4515-9425-aa1aa42aa2e1-etc-tuned\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.861449 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860571 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-etc-openvswitch\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.861449 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860624 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-etc-kubernetes\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.861449 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860662 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-host-slash\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.861449 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860702 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-var-lib-openvswitch\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.861449 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860732 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a6630c1b-3984-4d1b-829f-aaa435022076-device-dir\") pod \"aws-ebs-csi-driver-node-lhc8t\" (UID: \"a6630c1b-3984-4d1b-829f-aaa435022076\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t" Jul 02 15:26:30.861449 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860779 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42vg6\" (UniqueName: \"kubernetes.io/projected/a6630c1b-3984-4d1b-829f-aaa435022076-kube-api-access-42vg6\") pod \"aws-ebs-csi-driver-node-lhc8t\" (UID: \"a6630c1b-3984-4d1b-829f-aaa435022076\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t" Jul 02 15:26:30.861449 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860805 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-host-run-multus-certs\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.861449 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860837 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c6ab9c6a-2d0b-44aa-bffe-dde4a008d96b-hosts-file\") pod \"node-resolver-w55cq\" (UID: \"c6ab9c6a-2d0b-44aa-bffe-dde4a008d96b\") " pod="openshift-dns/node-resolver-w55cq" Jul 02 15:26:30.861449 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860863 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-lib-modules\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.861449 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860887 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ef605e3-b6e6-4783-9012-0d29145c81d3-os-release\") pod \"multus-additional-cni-plugins-pxskq\" (UID: \"7ef605e3-b6e6-4783-9012-0d29145c81d3\") " pod="openshift-multus/multus-additional-cni-plugins-pxskq" Jul 02 15:26:30.861449 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860931 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-host-var-lib-cni-bin\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.861449 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860943 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c6ab9c6a-2d0b-44aa-bffe-dde4a008d96b-hosts-file\") pod \"node-resolver-w55cq\" (UID: \"c6ab9c6a-2d0b-44aa-bffe-dde4a008d96b\") " pod="openshift-dns/node-resolver-w55cq" Jul 02 15:26:30.861449 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860958 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-run-openvswitch\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.861449 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.860984 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-host-run-ovn-kubernetes\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.862291 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861012 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d1c4a839-8c2d-43f5-ac6e-4bc4c531bf7f-iptables-alerter-script\") pod \"iptables-alerter-gp8zn\" (UID: \"d1c4a839-8c2d-43f5-ac6e-4bc4c531bf7f\") " pod="openshift-network-operator/iptables-alerter-gp8zn" Jul 02 15:26:30.862291 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861038 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-etc-sysctl-d\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.862291 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861063 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7ef605e3-b6e6-4783-9012-0d29145c81d3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pxskq\" (UID: \"7ef605e3-b6e6-4783-9012-0d29145c81d3\") " pod="openshift-multus/multus-additional-cni-plugins-pxskq" Jul 02 15:26:30.862291 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861089 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-cnibin\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.862291 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861113 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-multus-conf-dir\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.862291 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861139 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-ovnkube-script-lib\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.862291 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861165 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a6630c1b-3984-4d1b-829f-aaa435022076-etc-selinux\") pod \"aws-ebs-csi-driver-node-lhc8t\" (UID: \"a6630c1b-3984-4d1b-829f-aaa435022076\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t" Jul 02 15:26:30.862291 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861212 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d84q2\" (UniqueName: \"kubernetes.io/projected/d1c4a839-8c2d-43f5-ac6e-4bc4c531bf7f-kube-api-access-d84q2\") pod \"iptables-alerter-gp8zn\" (UID: \"d1c4a839-8c2d-43f5-ac6e-4bc4c531bf7f\") " pod="openshift-network-operator/iptables-alerter-gp8zn" Jul 02 15:26:30.862291 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861237 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bqcz\" (UniqueName: \"kubernetes.io/projected/22e80d47-13ae-4515-9425-aa1aa42aa2e1-kube-api-access-2bqcz\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.862291 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861263 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-system-cni-dir\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.862291 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861320 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-host-var-lib-kubelet\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.862291 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861349 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2e46981c-18a5-46c3-b9d9-994de1e6fb32-agent-certs\") pod \"konnectivity-agent-97w5x\" (UID: \"2e46981c-18a5-46c3-b9d9-994de1e6fb32\") " pod="kube-system/konnectivity-agent-97w5x" Jul 02 15:26:30.862291 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861374 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-etc-systemd\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.862291 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861403 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ef605e3-b6e6-4783-9012-0d29145c81d3-cni-binary-copy\") pod \"multus-additional-cni-plugins-pxskq\" (UID: \"7ef605e3-b6e6-4783-9012-0d29145c81d3\") " pod="openshift-multus/multus-additional-cni-plugins-pxskq" Jul 02 15:26:30.862291 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861428 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-node-log\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.862291 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861451 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2e46981c-18a5-46c3-b9d9-994de1e6fb32-konnectivity-ca\") pod \"konnectivity-agent-97w5x\" (UID: \"2e46981c-18a5-46c3-b9d9-994de1e6fb32\") " pod="kube-system/konnectivity-agent-97w5x" Jul 02 15:26:30.862915 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861473 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a6630c1b-3984-4d1b-829f-aaa435022076-socket-dir\") pod \"aws-ebs-csi-driver-node-lhc8t\" (UID: \"a6630c1b-3984-4d1b-829f-aaa435022076\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t" Jul 02 15:26:30.862915 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861499 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-etc-sysctl-conf\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.862915 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861521 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-run\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.862915 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861544 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41acdf42-e5fb-4f2c-8316-1c2f1cd993ff-host\") pod \"node-ca-htbq4\" (UID: \"41acdf42-e5fb-4f2c-8316-1c2f1cd993ff\") " pod="openshift-image-registry/node-ca-htbq4" Jul 02 15:26:30.862915 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861568 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-os-release\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.862915 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861605 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71562d14-f2e6-4ebd-8e73-d1335355bda0-cni-binary-copy\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.862915 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861643 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ac822a5a-c97b-4159-ac19-0000a2b4abfb-dbus\") pod \"global-pull-secret-syncer-7z5mp\" (UID: \"ac822a5a-c97b-4159-ac19-0000a2b4abfb\") " pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:26:30.862915 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861673 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-etc-modprobe-d\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.862915 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861684 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d1c4a839-8c2d-43f5-ac6e-4bc4c531bf7f-host-slash\") pod \"iptables-alerter-gp8zn\" (UID: \"d1c4a839-8c2d-43f5-ac6e-4bc4c531bf7f\") " pod="openshift-network-operator/iptables-alerter-gp8zn" Jul 02 15:26:30.862915 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861703 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-multus-cni-dir\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.862915 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861731 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/71562d14-f2e6-4ebd-8e73-d1335355bda0-multus-daemon-config\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.862915 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861755 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-host-cni-bin\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.862915 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861776 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ac822a5a-c97b-4159-ac19-0000a2b4abfb-kubelet-config\") pod \"global-pull-secret-syncer-7z5mp\" (UID: \"ac822a5a-c97b-4159-ac19-0000a2b4abfb\") " pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:26:30.862915 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861800 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-host-kubelet\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.862915 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861820 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-ovnkube-config\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.862915 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861882 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ac822a5a-c97b-4159-ac19-0000a2b4abfb-dbus\") pod \"global-pull-secret-syncer-7z5mp\" (UID: \"ac822a5a-c97b-4159-ac19-0000a2b4abfb\") " pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:26:30.862915 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.861964 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ac822a5a-c97b-4159-ac19-0000a2b4abfb-kubelet-config\") pod \"global-pull-secret-syncer-7z5mp\" (UID: \"ac822a5a-c97b-4159-ac19-0000a2b4abfb\") " pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:26:30.863735 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.862045 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d1c4a839-8c2d-43f5-ac6e-4bc4c531bf7f-iptables-alerter-script\") pod \"iptables-alerter-gp8zn\" (UID: \"d1c4a839-8c2d-43f5-ac6e-4bc4c531bf7f\") " pod="openshift-network-operator/iptables-alerter-gp8zn" Jul 02 15:26:30.865837 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:30.865817 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:26:30.865943 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:30.865844 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:26:30.865943 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:30.865858 2578 projected.go:196] Error preparing data for projected volume kube-api-access-hw5wd for pod openshift-network-diagnostics/network-check-target-w528n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:26:30.865943 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.865850 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 15:26:30.865943 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:30.865922 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f85b2e6b-f8cc-4efd-87d3-6d85423e64a4-kube-api-access-hw5wd podName:f85b2e6b-f8cc-4efd-87d3-6d85423e64a4 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:31.365906641 +0000 UTC m=+2.995867491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hw5wd" (UniqueName: "kubernetes.io/projected/f85b2e6b-f8cc-4efd-87d3-6d85423e64a4-kube-api-access-hw5wd") pod "network-check-target-w528n" (UID: "f85b2e6b-f8cc-4efd-87d3-6d85423e64a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:26:30.869881 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.869861 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d84q2\" (UniqueName: \"kubernetes.io/projected/d1c4a839-8c2d-43f5-ac6e-4bc4c531bf7f-kube-api-access-d84q2\") pod \"iptables-alerter-gp8zn\" (UID: \"d1c4a839-8c2d-43f5-ac6e-4bc4c531bf7f\") " pod="openshift-network-operator/iptables-alerter-gp8zn" Jul 02 15:26:30.870016 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.869885 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lm4c\" (UniqueName: \"kubernetes.io/projected/be11a647-3b83-4a29-8f80-29cab689e649-kube-api-access-6lm4c\") pod \"network-metrics-daemon-jm5ld\" (UID: \"be11a647-3b83-4a29-8f80-29cab689e649\") " pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:26:30.870016 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.869860 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g59nm\" (UniqueName: \"kubernetes.io/projected/c6ab9c6a-2d0b-44aa-bffe-dde4a008d96b-kube-api-access-g59nm\") pod \"node-resolver-w55cq\" (UID: \"c6ab9c6a-2d0b-44aa-bffe-dde4a008d96b\") " pod="openshift-dns/node-resolver-w55cq" Jul 02 15:26:30.962219 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962158 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-sys\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.962219 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962198 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/22e80d47-13ae-4515-9425-aa1aa42aa2e1-etc-tuned\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.962482 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962245 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-etc-openvswitch\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.962482 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962282 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-etc-kubernetes\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.962482 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962307 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-host-slash\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.962482 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962332 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-var-lib-openvswitch\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.962482 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962331 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-sys\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.962482 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962359 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-etc-kubernetes\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.962482 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962374 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-host-slash\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.962482 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962363 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-etc-openvswitch\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.962482 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962395 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-var-lib-openvswitch\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.962482 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962406 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a6630c1b-3984-4d1b-829f-aaa435022076-device-dir\") pod \"aws-ebs-csi-driver-node-lhc8t\" (UID: \"a6630c1b-3984-4d1b-829f-aaa435022076\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t" Jul 02 15:26:30.962482 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962434 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42vg6\" (UniqueName: \"kubernetes.io/projected/a6630c1b-3984-4d1b-829f-aaa435022076-kube-api-access-42vg6\") pod \"aws-ebs-csi-driver-node-lhc8t\" (UID: \"a6630c1b-3984-4d1b-829f-aaa435022076\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t" Jul 02 15:26:30.962482 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962457 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-host-run-multus-certs\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.962482 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962482 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a6630c1b-3984-4d1b-829f-aaa435022076-device-dir\") pod \"aws-ebs-csi-driver-node-lhc8t\" (UID: \"a6630c1b-3984-4d1b-829f-aaa435022076\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t" Jul 02 15:26:30.963110 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962501 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-host-run-multus-certs\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.963110 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962602 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-lib-modules\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.963110 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962636 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ef605e3-b6e6-4783-9012-0d29145c81d3-os-release\") pod \"multus-additional-cni-plugins-pxskq\" (UID: \"7ef605e3-b6e6-4783-9012-0d29145c81d3\") " pod="openshift-multus/multus-additional-cni-plugins-pxskq" Jul 02 15:26:30.963110 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962661 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-host-var-lib-cni-bin\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.963110 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962702 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-run-openvswitch\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.963110 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962727 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-host-run-ovn-kubernetes\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.963110 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962744 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ef605e3-b6e6-4783-9012-0d29145c81d3-os-release\") pod \"multus-additional-cni-plugins-pxskq\" (UID: \"7ef605e3-b6e6-4783-9012-0d29145c81d3\") " pod="openshift-multus/multus-additional-cni-plugins-pxskq" Jul 02 15:26:30.963110 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962757 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-etc-sysctl-d\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.963110 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962782 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7ef605e3-b6e6-4783-9012-0d29145c81d3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pxskq\" (UID: \"7ef605e3-b6e6-4783-9012-0d29145c81d3\") " pod="openshift-multus/multus-additional-cni-plugins-pxskq" Jul 02 15:26:30.963110 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962785 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-run-openvswitch\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.963110 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962792 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-lib-modules\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.963110 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962794 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-host-var-lib-cni-bin\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.963110 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962810 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-cnibin\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.963110 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962834 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-host-run-ovn-kubernetes\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.963110 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962846 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-multus-conf-dir\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.963110 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962882 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-multus-conf-dir\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.963110 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962888 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-etc-sysctl-d\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.963990 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962884 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-ovnkube-script-lib\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.963990 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962932 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-cnibin\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.963990 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.962972 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a6630c1b-3984-4d1b-829f-aaa435022076-etc-selinux\") pod \"aws-ebs-csi-driver-node-lhc8t\" (UID: \"a6630c1b-3984-4d1b-829f-aaa435022076\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t" Jul 02 15:26:30.963990 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963002 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bqcz\" (UniqueName: \"kubernetes.io/projected/22e80d47-13ae-4515-9425-aa1aa42aa2e1-kube-api-access-2bqcz\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.963990 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963029 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-system-cni-dir\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.963990 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963055 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-host-var-lib-kubelet\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.963990 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963082 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2e46981c-18a5-46c3-b9d9-994de1e6fb32-agent-certs\") pod \"konnectivity-agent-97w5x\" (UID: \"2e46981c-18a5-46c3-b9d9-994de1e6fb32\") " pod="kube-system/konnectivity-agent-97w5x" Jul 02 15:26:30.963990 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963080 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a6630c1b-3984-4d1b-829f-aaa435022076-etc-selinux\") pod \"aws-ebs-csi-driver-node-lhc8t\" (UID: \"a6630c1b-3984-4d1b-829f-aaa435022076\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t" Jul 02 15:26:30.963990 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963121 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-etc-systemd\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.963990 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963149 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ef605e3-b6e6-4783-9012-0d29145c81d3-cni-binary-copy\") pod \"multus-additional-cni-plugins-pxskq\" (UID: \"7ef605e3-b6e6-4783-9012-0d29145c81d3\") " pod="openshift-multus/multus-additional-cni-plugins-pxskq" Jul 02 15:26:30.963990 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963174 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-node-log\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.963990 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963198 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2e46981c-18a5-46c3-b9d9-994de1e6fb32-konnectivity-ca\") pod \"konnectivity-agent-97w5x\" (UID: \"2e46981c-18a5-46c3-b9d9-994de1e6fb32\") " pod="kube-system/konnectivity-agent-97w5x" Jul 02 15:26:30.963990 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963221 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a6630c1b-3984-4d1b-829f-aaa435022076-socket-dir\") pod \"aws-ebs-csi-driver-node-lhc8t\" (UID: \"a6630c1b-3984-4d1b-829f-aaa435022076\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t" Jul 02 15:26:30.963990 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963243 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-system-cni-dir\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.963990 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963244 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-etc-sysctl-conf\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.963990 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963275 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-run\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.963990 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963294 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41acdf42-e5fb-4f2c-8316-1c2f1cd993ff-host\") pod \"node-ca-htbq4\" (UID: \"41acdf42-e5fb-4f2c-8316-1c2f1cd993ff\") " pod="openshift-image-registry/node-ca-htbq4" Jul 02 15:26:30.963990 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963314 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-os-release\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.964916 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963332 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-etc-sysctl-conf\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.964916 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963337 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71562d14-f2e6-4ebd-8e73-d1335355bda0-cni-binary-copy\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.964916 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963386 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-etc-systemd\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.964916 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963463 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7ef605e3-b6e6-4783-9012-0d29145c81d3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pxskq\" (UID: \"7ef605e3-b6e6-4783-9012-0d29145c81d3\") " pod="openshift-multus/multus-additional-cni-plugins-pxskq" Jul 02 15:26:30.964916 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963521 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-host-var-lib-kubelet\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.964916 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963535 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-ovnkube-script-lib\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.964916 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963566 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41acdf42-e5fb-4f2c-8316-1c2f1cd993ff-host\") pod \"node-ca-htbq4\" (UID: \"41acdf42-e5fb-4f2c-8316-1c2f1cd993ff\") " pod="openshift-image-registry/node-ca-htbq4" Jul 02 15:26:30.964916 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963580 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-os-release\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.964916 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963611 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-run\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.964916 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963638 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-node-log\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.964916 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963709 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-etc-modprobe-d\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.964916 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963711 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a6630c1b-3984-4d1b-829f-aaa435022076-socket-dir\") pod \"aws-ebs-csi-driver-node-lhc8t\" (UID: \"a6630c1b-3984-4d1b-829f-aaa435022076\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t" Jul 02 15:26:30.964916 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963736 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-multus-cni-dir\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.964916 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963761 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/71562d14-f2e6-4ebd-8e73-d1335355bda0-multus-daemon-config\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.964916 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963785 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-host-cni-bin\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.964916 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963811 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-host-kubelet\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.964916 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963791 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-etc-modprobe-d\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.964916 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963836 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-ovnkube-config\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.965832 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963854 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71562d14-f2e6-4ebd-8e73-d1335355bda0-cni-binary-copy\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.965832 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963854 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ef605e3-b6e6-4783-9012-0d29145c81d3-cni-binary-copy\") pod \"multus-additional-cni-plugins-pxskq\" (UID: \"7ef605e3-b6e6-4783-9012-0d29145c81d3\") " pod="openshift-multus/multus-additional-cni-plugins-pxskq" Jul 02 15:26:30.965832 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963876 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-var-lib-kubelet\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.965832 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963921 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-host-cni-bin\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.965832 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963959 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-host-kubelet\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.965832 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963984 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-var-lib-kubelet\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.965832 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.963989 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/41acdf42-e5fb-4f2c-8316-1c2f1cd993ff-serviceca\") pod \"node-ca-htbq4\" (UID: \"41acdf42-e5fb-4f2c-8316-1c2f1cd993ff\") " pod="openshift-image-registry/node-ca-htbq4" Jul 02 15:26:30.965832 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964015 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df4w4\" (UniqueName: \"kubernetes.io/projected/41acdf42-e5fb-4f2c-8316-1c2f1cd993ff-kube-api-access-df4w4\") pod \"node-ca-htbq4\" (UID: \"41acdf42-e5fb-4f2c-8316-1c2f1cd993ff\") " pod="openshift-image-registry/node-ca-htbq4" Jul 02 15:26:30.965832 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964059 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-host-var-lib-cni-multus\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.965832 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964082 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-log-socket\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.965832 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964108 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-etc-kubernetes\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.965832 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964145 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-multus-socket-dir-parent\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.965832 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964168 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k879\" (UniqueName: \"kubernetes.io/projected/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-kube-api-access-2k879\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.965832 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964192 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a6630c1b-3984-4d1b-829f-aaa435022076-registration-dir\") pod \"aws-ebs-csi-driver-node-lhc8t\" (UID: \"a6630c1b-3984-4d1b-829f-aaa435022076\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t" Jul 02 15:26:30.965832 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964215 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-host\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.965832 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964218 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2e46981c-18a5-46c3-b9d9-994de1e6fb32-konnectivity-ca\") pod \"konnectivity-agent-97w5x\" (UID: \"2e46981c-18a5-46c3-b9d9-994de1e6fb32\") " pod="kube-system/konnectivity-agent-97w5x" Jul 02 15:26:30.965832 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964239 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ef605e3-b6e6-4783-9012-0d29145c81d3-system-cni-dir\") pod \"multus-additional-cni-plugins-pxskq\" (UID: \"7ef605e3-b6e6-4783-9012-0d29145c81d3\") " pod="openshift-multus/multus-additional-cni-plugins-pxskq" Jul 02 15:26:30.966668 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964266 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ef605e3-b6e6-4783-9012-0d29145c81d3-cnibin\") pod \"multus-additional-cni-plugins-pxskq\" (UID: \"7ef605e3-b6e6-4783-9012-0d29145c81d3\") " pod="openshift-multus/multus-additional-cni-plugins-pxskq" Jul 02 15:26:30.966668 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964276 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-host-var-lib-cni-multus\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.966668 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964298 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/71562d14-f2e6-4ebd-8e73-d1335355bda0-multus-daemon-config\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.966668 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964316 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-run-ovn\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.966668 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964327 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a6630c1b-3984-4d1b-829f-aaa435022076-registration-dir\") pod \"aws-ebs-csi-driver-node-lhc8t\" (UID: \"a6630c1b-3984-4d1b-829f-aaa435022076\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t" Jul 02 15:26:30.966668 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964341 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-host-cni-netd\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.966668 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964361 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-multus-socket-dir-parent\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.966668 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964366 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-env-overrides\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.966668 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964372 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-etc-kubernetes\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.966668 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964395 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ef605e3-b6e6-4783-9012-0d29145c81d3-cnibin\") pod \"multus-additional-cni-plugins-pxskq\" (UID: \"7ef605e3-b6e6-4783-9012-0d29145c81d3\") " pod="openshift-multus/multus-additional-cni-plugins-pxskq" Jul 02 15:26:30.966668 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964391 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22e80d47-13ae-4515-9425-aa1aa42aa2e1-tmp\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.966668 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964413 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-ovnkube-config\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.966668 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964425 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-log-socket\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.966668 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964432 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-host-run-netns\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.966668 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964458 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-run-ovn\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.966668 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964515 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-host-run-netns\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.966668 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964517 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-multus-cni-dir\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.966668 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964553 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-host\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.967509 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964584 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ef605e3-b6e6-4783-9012-0d29145c81d3-system-cni-dir\") pod \"multus-additional-cni-plugins-pxskq\" (UID: \"7ef605e3-b6e6-4783-9012-0d29145c81d3\") " pod="openshift-multus/multus-additional-cni-plugins-pxskq" Jul 02 15:26:30.967509 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964604 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-run-systemd\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.967509 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964619 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-host-cni-netd\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.967509 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964655 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-host-run-k8s-cni-cncf-io\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.967509 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964684 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-hostroot\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.967509 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964710 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h8lw\" (UniqueName: \"kubernetes.io/projected/71562d14-f2e6-4ebd-8e73-d1335355bda0-kube-api-access-2h8lw\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.967509 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964716 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-host-run-k8s-cni-cncf-io\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.967509 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964747 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-host-run-netns\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.967509 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964759 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-run-systemd\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.967509 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964770 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/71562d14-f2e6-4ebd-8e73-d1335355bda0-hostroot\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.967509 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964772 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.967509 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964805 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.967509 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964825 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7ef605e3-b6e6-4783-9012-0d29145c81d3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pxskq\" (UID: \"7ef605e3-b6e6-4783-9012-0d29145c81d3\") " pod="openshift-multus/multus-additional-cni-plugins-pxskq" Jul 02 15:26:30.967509 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964853 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-host-run-netns\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.967509 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964887 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-ovn-node-metrics-cert\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.967509 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964940 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/41acdf42-e5fb-4f2c-8316-1c2f1cd993ff-serviceca\") pod \"node-ca-htbq4\" (UID: \"41acdf42-e5fb-4f2c-8316-1c2f1cd993ff\") " pod="openshift-image-registry/node-ca-htbq4" Jul 02 15:26:30.967509 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964962 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-env-overrides\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.968285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964984 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/22e80d47-13ae-4515-9425-aa1aa42aa2e1-etc-tuned\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.968285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.964991 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-etc-sysconfig\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.968285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.965017 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ef605e3-b6e6-4783-9012-0d29145c81d3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pxskq\" (UID: \"7ef605e3-b6e6-4783-9012-0d29145c81d3\") " pod="openshift-multus/multus-additional-cni-plugins-pxskq" Jul 02 15:26:30.968285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.965089 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/22e80d47-13ae-4515-9425-aa1aa42aa2e1-etc-sysconfig\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.968285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.965093 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcp7d\" (UniqueName: \"kubernetes.io/projected/7ef605e3-b6e6-4783-9012-0d29145c81d3-kube-api-access-wcp7d\") pod \"multus-additional-cni-plugins-pxskq\" (UID: \"7ef605e3-b6e6-4783-9012-0d29145c81d3\") " pod="openshift-multus/multus-additional-cni-plugins-pxskq" Jul 02 15:26:30.968285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.965126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-systemd-units\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.968285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.965188 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ef605e3-b6e6-4783-9012-0d29145c81d3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pxskq\" (UID: \"7ef605e3-b6e6-4783-9012-0d29145c81d3\") " pod="openshift-multus/multus-additional-cni-plugins-pxskq" Jul 02 15:26:30.968285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.965226 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a6630c1b-3984-4d1b-829f-aaa435022076-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lhc8t\" (UID: \"a6630c1b-3984-4d1b-829f-aaa435022076\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t" Jul 02 15:26:30.968285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.965269 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-systemd-units\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.968285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.965317 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a6630c1b-3984-4d1b-829f-aaa435022076-sys-fs\") pod \"aws-ebs-csi-driver-node-lhc8t\" (UID: \"a6630c1b-3984-4d1b-829f-aaa435022076\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t" Jul 02 15:26:30.968285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.965338 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a6630c1b-3984-4d1b-829f-aaa435022076-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lhc8t\" (UID: \"a6630c1b-3984-4d1b-829f-aaa435022076\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t" Jul 02 15:26:30.968285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.965343 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7ef605e3-b6e6-4783-9012-0d29145c81d3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pxskq\" (UID: \"7ef605e3-b6e6-4783-9012-0d29145c81d3\") " pod="openshift-multus/multus-additional-cni-plugins-pxskq" Jul 02 15:26:30.968285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.965402 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a6630c1b-3984-4d1b-829f-aaa435022076-sys-fs\") pod \"aws-ebs-csi-driver-node-lhc8t\" (UID: \"a6630c1b-3984-4d1b-829f-aaa435022076\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t" Jul 02 15:26:30.968285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.967522 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2e46981c-18a5-46c3-b9d9-994de1e6fb32-agent-certs\") pod \"konnectivity-agent-97w5x\" (UID: \"2e46981c-18a5-46c3-b9d9-994de1e6fb32\") " pod="kube-system/konnectivity-agent-97w5x" Jul 02 15:26:30.968285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.967670 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22e80d47-13ae-4515-9425-aa1aa42aa2e1-tmp\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.969008 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.968768 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-ovn-node-metrics-cert\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.971094 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.971071 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bqcz\" (UniqueName: \"kubernetes.io/projected/22e80d47-13ae-4515-9425-aa1aa42aa2e1-kube-api-access-2bqcz\") pod \"tuned-lxcrb\" (UID: \"22e80d47-13ae-4515-9425-aa1aa42aa2e1\") " pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:30.971526 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.971489 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42vg6\" (UniqueName: \"kubernetes.io/projected/a6630c1b-3984-4d1b-829f-aaa435022076-kube-api-access-42vg6\") pod \"aws-ebs-csi-driver-node-lhc8t\" (UID: \"a6630c1b-3984-4d1b-829f-aaa435022076\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t" Jul 02 15:26:30.973084 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.973060 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h8lw\" (UniqueName: \"kubernetes.io/projected/71562d14-f2e6-4ebd-8e73-d1335355bda0-kube-api-access-2h8lw\") pod \"multus-klcnm\" (UID: \"71562d14-f2e6-4ebd-8e73-d1335355bda0\") " pod="openshift-multus/multus-klcnm" Jul 02 15:26:30.973273 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.973251 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k879\" (UniqueName: \"kubernetes.io/projected/9a21b8b7-cc97-4782-aa1f-1ebd124c2987-kube-api-access-2k879\") pod \"ovnkube-node-2pztp\" (UID: \"9a21b8b7-cc97-4782-aa1f-1ebd124c2987\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:30.974474 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.974450 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-df4w4\" (UniqueName: \"kubernetes.io/projected/41acdf42-e5fb-4f2c-8316-1c2f1cd993ff-kube-api-access-df4w4\") pod \"node-ca-htbq4\" (UID: \"41acdf42-e5fb-4f2c-8316-1c2f1cd993ff\") " pod="openshift-image-registry/node-ca-htbq4" Jul 02 15:26:30.975153 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:30.975130 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcp7d\" (UniqueName: \"kubernetes.io/projected/7ef605e3-b6e6-4783-9012-0d29145c81d3-kube-api-access-wcp7d\") pod \"multus-additional-cni-plugins-pxskq\" (UID: \"7ef605e3-b6e6-4783-9012-0d29145c81d3\") " pod="openshift-multus/multus-additional-cni-plugins-pxskq" Jul 02 15:26:31.062173 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:31.062099 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gp8zn" Jul 02 15:26:31.079671 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:31.079648 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w55cq" Jul 02 15:26:31.088225 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:31.088206 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-htbq4" Jul 02 15:26:31.094768 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:31.094747 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pxskq" Jul 02 15:26:31.100443 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:31.100421 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-klcnm" Jul 02 15:26:31.106114 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:31.106094 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:31.116751 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:31.116726 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-97w5x" Jul 02 15:26:31.124598 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:31.124577 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t" Jul 02 15:26:31.129360 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:31.129340 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" Jul 02 15:26:31.276601 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:31.276570 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:26:31.368857 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:31.368825 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be11a647-3b83-4a29-8f80-29cab689e649-metrics-certs\") pod \"network-metrics-daemon-jm5ld\" (UID: \"be11a647-3b83-4a29-8f80-29cab689e649\") " pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:26:31.369046 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:31.368883 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac822a5a-c97b-4159-ac19-0000a2b4abfb-original-pull-secret\") pod \"global-pull-secret-syncer-7z5mp\" (UID: \"ac822a5a-c97b-4159-ac19-0000a2b4abfb\") " pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:26:31.369046 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:31.368996 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:26:31.369046 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:31.369022 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw5wd\" (UniqueName: \"kubernetes.io/projected/f85b2e6b-f8cc-4efd-87d3-6d85423e64a4-kube-api-access-hw5wd\") pod \"network-check-target-w528n\" (UID: \"f85b2e6b-f8cc-4efd-87d3-6d85423e64a4\") " pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:26:31.369046 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:31.368996 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:26:31.369254 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:31.369051 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac822a5a-c97b-4159-ac19-0000a2b4abfb-original-pull-secret podName:ac822a5a-c97b-4159-ac19-0000a2b4abfb nodeName:}" failed. No retries permitted until 2026-07-02 15:26:32.369034056 +0000 UTC m=+3.998994900 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ac822a5a-c97b-4159-ac19-0000a2b4abfb-original-pull-secret") pod "global-pull-secret-syncer-7z5mp" (UID: "ac822a5a-c97b-4159-ac19-0000a2b4abfb") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:26:31.369254 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:31.369106 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be11a647-3b83-4a29-8f80-29cab689e649-metrics-certs podName:be11a647-3b83-4a29-8f80-29cab689e649 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:32.369067284 +0000 UTC m=+3.999028119 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be11a647-3b83-4a29-8f80-29cab689e649-metrics-certs") pod "network-metrics-daemon-jm5ld" (UID: "be11a647-3b83-4a29-8f80-29cab689e649") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:26:31.369254 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:31.369137 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:26:31.369254 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:31.369161 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:26:31.369254 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:31.369178 2578 projected.go:196] Error preparing data for projected volume kube-api-access-hw5wd for pod openshift-network-diagnostics/network-check-target-w528n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:26:31.369254 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:31.369223 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f85b2e6b-f8cc-4efd-87d3-6d85423e64a4-kube-api-access-hw5wd podName:f85b2e6b-f8cc-4efd-87d3-6d85423e64a4 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:32.36921332 +0000 UTC m=+3.999174162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hw5wd" (UniqueName: "kubernetes.io/projected/f85b2e6b-f8cc-4efd-87d3-6d85423e64a4-kube-api-access-hw5wd") pod "network-check-target-w528n" (UID: "f85b2e6b-f8cc-4efd-87d3-6d85423e64a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:26:31.795005 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:31.794954 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 15:21:29 +0000 UTC" deadline="2028-02-27 15:49:44.603533169 +0000 UTC" Jul 02 15:26:31.795005 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:31.795002 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14520h23m12.80853472s" Jul 02 15:26:31.811548 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:31.811362 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:26:31.811548 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:31.811518 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm5ld" podUID="be11a647-3b83-4a29-8f80-29cab689e649" Jul 02 15:26:31.817803 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:31.817780 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a21b8b7_cc97_4782_aa1f_1ebd124c2987.slice/crio-dc0f72279316c68262d1decdfd6801840a6d8d6dfd245cfb314c1eb4898b87f3 WatchSource:0}: Error finding container dc0f72279316c68262d1decdfd6801840a6d8d6dfd245cfb314c1eb4898b87f3: Status 404 returned error can't find the container with id dc0f72279316c68262d1decdfd6801840a6d8d6dfd245cfb314c1eb4898b87f3 Jul 02 15:26:31.818970 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:31.818943 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6630c1b_3984_4d1b_829f_aaa435022076.slice/crio-78d973a9066f14fa6c51c0bad1bae87ee1cc89c3e0b2b570351be5c20d669ec0 WatchSource:0}: Error finding container 78d973a9066f14fa6c51c0bad1bae87ee1cc89c3e0b2b570351be5c20d669ec0: Status 404 returned error can't find the container with id 78d973a9066f14fa6c51c0bad1bae87ee1cc89c3e0b2b570351be5c20d669ec0 Jul 02 15:26:31.820022 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:31.819804 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e46981c_18a5_46c3_b9d9_994de1e6fb32.slice/crio-57a7a7b1027398d5a801b2037cd3dfb1ba727f8a06f7f14adb95abad6f3512bb WatchSource:0}: Error finding container 57a7a7b1027398d5a801b2037cd3dfb1ba727f8a06f7f14adb95abad6f3512bb: Status 404 returned error can't find the container with id 57a7a7b1027398d5a801b2037cd3dfb1ba727f8a06f7f14adb95abad6f3512bb Jul 02 15:26:31.820674 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:31.820280 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ef605e3_b6e6_4783_9012_0d29145c81d3.slice/crio-292d2b410a134e9f2fb467b78f63bd4a62214bc44eb784bb1db9c81923605c8e WatchSource:0}: Error finding container 292d2b410a134e9f2fb467b78f63bd4a62214bc44eb784bb1db9c81923605c8e: Status 404 returned error can't find the container with id 292d2b410a134e9f2fb467b78f63bd4a62214bc44eb784bb1db9c81923605c8e Jul 02 15:26:31.822343 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:31.822241 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" event={"ID":"9a21b8b7-cc97-4782-aa1f-1ebd124c2987","Type":"ContainerStarted","Data":"dc0f72279316c68262d1decdfd6801840a6d8d6dfd245cfb314c1eb4898b87f3"} Jul 02 15:26:31.825292 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:31.825269 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22e80d47_13ae_4515_9425_aa1aa42aa2e1.slice/crio-9510c5634ffc3a906d0024bd3378fbc8ae54b6a4dea80a9e7ac0a39e3e6a9972 WatchSource:0}: Error finding container 9510c5634ffc3a906d0024bd3378fbc8ae54b6a4dea80a9e7ac0a39e3e6a9972: Status 404 returned error can't find the container with id 9510c5634ffc3a906d0024bd3378fbc8ae54b6a4dea80a9e7ac0a39e3e6a9972 Jul 02 15:26:31.827011 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:31.826820 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1c4a839_8c2d_43f5_ac6e_4bc4c531bf7f.slice/crio-05645326d7458d4759632ee15f76b195082c88e650e7d4adb06be8e6bc05df2e WatchSource:0}: Error finding container 05645326d7458d4759632ee15f76b195082c88e650e7d4adb06be8e6bc05df2e: Status 404 returned error can't find the container with id 05645326d7458d4759632ee15f76b195082c88e650e7d4adb06be8e6bc05df2e Jul 02 15:26:31.827305 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:26:31.827238 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41acdf42_e5fb_4f2c_8316_1c2f1cd993ff.slice/crio-c788123741ed5dd26d7d46820951f13ce9a9c17c536fd7904a4732189a767834 WatchSource:0}: Error finding container c788123741ed5dd26d7d46820951f13ce9a9c17c536fd7904a4732189a767834: Status 404 returned error can't find the container with id c788123741ed5dd26d7d46820951f13ce9a9c17c536fd7904a4732189a767834 Jul 02 15:26:32.294566 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:32.294322 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:26:32.376010 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:32.375971 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac822a5a-c97b-4159-ac19-0000a2b4abfb-original-pull-secret\") pod \"global-pull-secret-syncer-7z5mp\" (UID: \"ac822a5a-c97b-4159-ac19-0000a2b4abfb\") " pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:26:32.376212 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:32.376026 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw5wd\" (UniqueName: \"kubernetes.io/projected/f85b2e6b-f8cc-4efd-87d3-6d85423e64a4-kube-api-access-hw5wd\") pod \"network-check-target-w528n\" (UID: \"f85b2e6b-f8cc-4efd-87d3-6d85423e64a4\") " pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:26:32.376212 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:32.376082 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be11a647-3b83-4a29-8f80-29cab689e649-metrics-certs\") pod \"network-metrics-daemon-jm5ld\" (UID: \"be11a647-3b83-4a29-8f80-29cab689e649\") " pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:26:32.376330 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:32.376220 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:26:32.376330 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:32.376276 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be11a647-3b83-4a29-8f80-29cab689e649-metrics-certs podName:be11a647-3b83-4a29-8f80-29cab689e649 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:34.376262603 +0000 UTC m=+6.006223434 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be11a647-3b83-4a29-8f80-29cab689e649-metrics-certs") pod "network-metrics-daemon-jm5ld" (UID: "be11a647-3b83-4a29-8f80-29cab689e649") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:26:32.376584 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:32.376568 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:26:32.376661 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:32.376608 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac822a5a-c97b-4159-ac19-0000a2b4abfb-original-pull-secret podName:ac822a5a-c97b-4159-ac19-0000a2b4abfb nodeName:}" failed. No retries permitted until 2026-07-02 15:26:34.376598315 +0000 UTC m=+6.006559147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ac822a5a-c97b-4159-ac19-0000a2b4abfb-original-pull-secret") pod "global-pull-secret-syncer-7z5mp" (UID: "ac822a5a-c97b-4159-ac19-0000a2b4abfb") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:26:32.376722 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:32.376660 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:26:32.376722 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:32.376671 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:26:32.376722 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:32.376679 2578 projected.go:196] Error preparing data for projected volume kube-api-access-hw5wd for pod openshift-network-diagnostics/network-check-target-w528n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:26:32.376722 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:32.376700 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f85b2e6b-f8cc-4efd-87d3-6d85423e64a4-kube-api-access-hw5wd podName:f85b2e6b-f8cc-4efd-87d3-6d85423e64a4 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:34.376693776 +0000 UTC m=+6.006654605 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hw5wd" (UniqueName: "kubernetes.io/projected/f85b2e6b-f8cc-4efd-87d3-6d85423e64a4-kube-api-access-hw5wd") pod "network-check-target-w528n" (UID: "f85b2e6b-f8cc-4efd-87d3-6d85423e64a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:26:32.813683 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:32.813665 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:26:32.814154 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:32.813784 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w528n" podUID="f85b2e6b-f8cc-4efd-87d3-6d85423e64a4" Jul 02 15:26:32.814267 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:32.814249 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:26:32.814395 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:32.814349 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7z5mp" podUID="ac822a5a-c97b-4159-ac19-0000a2b4abfb" Jul 02 15:26:32.834819 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:32.834566 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxskq" event={"ID":"7ef605e3-b6e6-4783-9012-0d29145c81d3","Type":"ContainerStarted","Data":"292d2b410a134e9f2fb467b78f63bd4a62214bc44eb784bb1db9c81923605c8e"} Jul 02 15:26:32.846836 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:32.846768 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-97w5x" event={"ID":"2e46981c-18a5-46c3-b9d9-994de1e6fb32","Type":"ContainerStarted","Data":"57a7a7b1027398d5a801b2037cd3dfb1ba727f8a06f7f14adb95abad6f3512bb"} Jul 02 15:26:32.852653 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:32.852589 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w55cq" event={"ID":"c6ab9c6a-2d0b-44aa-bffe-dde4a008d96b","Type":"ContainerStarted","Data":"cd2e7e312eb4dc56a992987690db45e49f7a3602f174b9655c70b87baa1360f0"} Jul 02 15:26:32.867952 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:32.867928 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-klcnm" event={"ID":"71562d14-f2e6-4ebd-8e73-d1335355bda0","Type":"ContainerStarted","Data":"a78505f1d5df46d5069e834fab580db55844d33f293ee63cb82b76ffac79eaf8"} Jul 02 15:26:32.873881 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:32.873856 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-htbq4" event={"ID":"41acdf42-e5fb-4f2c-8316-1c2f1cd993ff","Type":"ContainerStarted","Data":"c788123741ed5dd26d7d46820951f13ce9a9c17c536fd7904a4732189a767834"} Jul 02 15:26:32.880564 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:32.880518 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" event={"ID":"22e80d47-13ae-4515-9425-aa1aa42aa2e1","Type":"ContainerStarted","Data":"9510c5634ffc3a906d0024bd3378fbc8ae54b6a4dea80a9e7ac0a39e3e6a9972"} Jul 02 15:26:32.882525 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:32.882432 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t" event={"ID":"a6630c1b-3984-4d1b-829f-aaa435022076","Type":"ContainerStarted","Data":"78d973a9066f14fa6c51c0bad1bae87ee1cc89c3e0b2b570351be5c20d669ec0"} Jul 02 15:26:32.888206 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:32.888172 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-113.ec2.internal" event={"ID":"6dfe551c5f5beaf25438e21f19169d54","Type":"ContainerStarted","Data":"aa9fc2538e87d988ceecc8be3fba49e505420df0bffc1bb862bae4ba2cf6b422"} Jul 02 15:26:32.894907 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:32.894873 2578 generic.go:356] "Generic (PLEG): container finished" podID="0d79fcf6aab83ff3e91b7984ecf86f04" containerID="fd0a2e92886516f834c5b4e815a27b9935abe447e95a7354f9b58945d408cd8c" exitCode=0 Jul 02 15:26:32.895768 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:32.895065 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-113.ec2.internal" event={"ID":"0d79fcf6aab83ff3e91b7984ecf86f04","Type":"ContainerDied","Data":"fd0a2e92886516f834c5b4e815a27b9935abe447e95a7354f9b58945d408cd8c"} Jul 02 15:26:32.918635 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:32.918577 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gp8zn" event={"ID":"d1c4a839-8c2d-43f5-ac6e-4bc4c531bf7f","Type":"ContainerStarted","Data":"05645326d7458d4759632ee15f76b195082c88e650e7d4adb06be8e6bc05df2e"} Jul 02 15:26:32.924588 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:32.924540 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-113.ec2.internal" podStartSLOduration=3.924522736 podStartE2EDuration="3.924522736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:26:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:32.908233498 +0000 UTC m=+4.538194367" watchObservedRunningTime="2026-07-02 15:26:32.924522736 +0000 UTC m=+4.554483588" Jul 02 15:26:33.812389 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:33.811911 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:26:33.812389 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:33.812052 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm5ld" podUID="be11a647-3b83-4a29-8f80-29cab689e649" Jul 02 15:26:33.938562 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:33.938523 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-113.ec2.internal" event={"ID":"0d79fcf6aab83ff3e91b7984ecf86f04","Type":"ContainerStarted","Data":"9952a34a060aa40a79eb3de6685988b8041a3117c07b19acf439a355c1543640"} Jul 02 15:26:34.395527 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:34.395488 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw5wd\" (UniqueName: \"kubernetes.io/projected/f85b2e6b-f8cc-4efd-87d3-6d85423e64a4-kube-api-access-hw5wd\") pod \"network-check-target-w528n\" (UID: \"f85b2e6b-f8cc-4efd-87d3-6d85423e64a4\") " pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:26:34.395708 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:34.395569 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be11a647-3b83-4a29-8f80-29cab689e649-metrics-certs\") pod \"network-metrics-daemon-jm5ld\" (UID: \"be11a647-3b83-4a29-8f80-29cab689e649\") " pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:26:34.395708 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:34.395618 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac822a5a-c97b-4159-ac19-0000a2b4abfb-original-pull-secret\") pod \"global-pull-secret-syncer-7z5mp\" (UID: \"ac822a5a-c97b-4159-ac19-0000a2b4abfb\") " pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:26:34.395827 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:34.395760 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:26:34.395827 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:34.395824 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac822a5a-c97b-4159-ac19-0000a2b4abfb-original-pull-secret podName:ac822a5a-c97b-4159-ac19-0000a2b4abfb nodeName:}" failed. No retries permitted until 2026-07-02 15:26:38.395806316 +0000 UTC m=+10.025767159 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ac822a5a-c97b-4159-ac19-0000a2b4abfb-original-pull-secret") pod "global-pull-secret-syncer-7z5mp" (UID: "ac822a5a-c97b-4159-ac19-0000a2b4abfb") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:26:34.396304 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:34.396281 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:26:34.396304 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:34.396304 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:26:34.396458 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:34.396317 2578 projected.go:196] Error preparing data for projected volume kube-api-access-hw5wd for pod openshift-network-diagnostics/network-check-target-w528n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:26:34.396458 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:34.396384 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f85b2e6b-f8cc-4efd-87d3-6d85423e64a4-kube-api-access-hw5wd podName:f85b2e6b-f8cc-4efd-87d3-6d85423e64a4 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:38.396368797 +0000 UTC m=+10.026329641 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hw5wd" (UniqueName: "kubernetes.io/projected/f85b2e6b-f8cc-4efd-87d3-6d85423e64a4-kube-api-access-hw5wd") pod "network-check-target-w528n" (UID: "f85b2e6b-f8cc-4efd-87d3-6d85423e64a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:26:34.396458 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:34.396455 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:26:34.396668 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:34.396491 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be11a647-3b83-4a29-8f80-29cab689e649-metrics-certs podName:be11a647-3b83-4a29-8f80-29cab689e649 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:38.396479445 +0000 UTC m=+10.026440290 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be11a647-3b83-4a29-8f80-29cab689e649-metrics-certs") pod "network-metrics-daemon-jm5ld" (UID: "be11a647-3b83-4a29-8f80-29cab689e649") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:26:34.813665 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:34.813589 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:26:34.813818 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:34.813713 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w528n" podUID="f85b2e6b-f8cc-4efd-87d3-6d85423e64a4" Jul 02 15:26:34.814123 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:34.814102 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:26:34.814224 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:34.814191 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7z5mp" podUID="ac822a5a-c97b-4159-ac19-0000a2b4abfb" Jul 02 15:26:35.811097 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:35.811057 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:26:35.811557 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:35.811201 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm5ld" podUID="be11a647-3b83-4a29-8f80-29cab689e649" Jul 02 15:26:36.811266 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:36.811187 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:26:36.811718 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:36.811322 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7z5mp" podUID="ac822a5a-c97b-4159-ac19-0000a2b4abfb" Jul 02 15:26:36.811718 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:36.811378 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:26:36.811718 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:36.811479 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w528n" podUID="f85b2e6b-f8cc-4efd-87d3-6d85423e64a4" Jul 02 15:26:37.811631 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:37.811590 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:26:37.812124 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:37.811746 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm5ld" podUID="be11a647-3b83-4a29-8f80-29cab689e649" Jul 02 15:26:38.430312 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:38.429989 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be11a647-3b83-4a29-8f80-29cab689e649-metrics-certs\") pod \"network-metrics-daemon-jm5ld\" (UID: \"be11a647-3b83-4a29-8f80-29cab689e649\") " pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:26:38.430312 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:38.430055 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac822a5a-c97b-4159-ac19-0000a2b4abfb-original-pull-secret\") pod \"global-pull-secret-syncer-7z5mp\" (UID: \"ac822a5a-c97b-4159-ac19-0000a2b4abfb\") " pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:26:38.430312 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:38.430092 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw5wd\" (UniqueName: \"kubernetes.io/projected/f85b2e6b-f8cc-4efd-87d3-6d85423e64a4-kube-api-access-hw5wd\") pod \"network-check-target-w528n\" (UID: \"f85b2e6b-f8cc-4efd-87d3-6d85423e64a4\") " pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:26:38.430312 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:38.430110 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:26:38.430312 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:38.430176 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be11a647-3b83-4a29-8f80-29cab689e649-metrics-certs podName:be11a647-3b83-4a29-8f80-29cab689e649 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:46.430157377 +0000 UTC m=+18.060118221 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be11a647-3b83-4a29-8f80-29cab689e649-metrics-certs") pod "network-metrics-daemon-jm5ld" (UID: "be11a647-3b83-4a29-8f80-29cab689e649") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:26:38.430312 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:38.430213 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:26:38.430312 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:38.430228 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:26:38.430312 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:38.430241 2578 projected.go:196] Error preparing data for projected volume kube-api-access-hw5wd for pod openshift-network-diagnostics/network-check-target-w528n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:26:38.430312 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:38.430285 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f85b2e6b-f8cc-4efd-87d3-6d85423e64a4-kube-api-access-hw5wd podName:f85b2e6b-f8cc-4efd-87d3-6d85423e64a4 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:46.430271999 +0000 UTC m=+18.060232834 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hw5wd" (UniqueName: "kubernetes.io/projected/f85b2e6b-f8cc-4efd-87d3-6d85423e64a4-kube-api-access-hw5wd") pod "network-check-target-w528n" (UID: "f85b2e6b-f8cc-4efd-87d3-6d85423e64a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:26:38.430312 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:38.430315 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:26:38.430964 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:38.430367 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac822a5a-c97b-4159-ac19-0000a2b4abfb-original-pull-secret podName:ac822a5a-c97b-4159-ac19-0000a2b4abfb nodeName:}" failed. No retries permitted until 2026-07-02 15:26:46.430354651 +0000 UTC m=+18.060315480 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ac822a5a-c97b-4159-ac19-0000a2b4abfb-original-pull-secret") pod "global-pull-secret-syncer-7z5mp" (UID: "ac822a5a-c97b-4159-ac19-0000a2b4abfb") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:26:38.813424 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:38.813347 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:26:38.813855 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:38.813595 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w528n" podUID="f85b2e6b-f8cc-4efd-87d3-6d85423e64a4" Jul 02 15:26:38.813932 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:38.813886 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:26:38.814050 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:38.814010 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7z5mp" podUID="ac822a5a-c97b-4159-ac19-0000a2b4abfb" Jul 02 15:26:39.811462 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:39.811424 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:26:39.811646 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:39.811618 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm5ld" podUID="be11a647-3b83-4a29-8f80-29cab689e649" Jul 02 15:26:40.811534 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:40.811496 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:26:40.812012 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:40.811631 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w528n" podUID="f85b2e6b-f8cc-4efd-87d3-6d85423e64a4" Jul 02 15:26:40.812123 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:40.812101 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:26:40.812225 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:40.812201 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7z5mp" podUID="ac822a5a-c97b-4159-ac19-0000a2b4abfb" Jul 02 15:26:41.811871 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:41.811834 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:26:41.812279 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:41.811993 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm5ld" podUID="be11a647-3b83-4a29-8f80-29cab689e649" Jul 02 15:26:42.811869 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:42.811779 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:26:42.812037 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:42.811779 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:26:42.812037 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:42.811924 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7z5mp" podUID="ac822a5a-c97b-4159-ac19-0000a2b4abfb" Jul 02 15:26:42.812037 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:42.812002 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w528n" podUID="f85b2e6b-f8cc-4efd-87d3-6d85423e64a4" Jul 02 15:26:43.810951 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:43.810920 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:26:43.811148 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:43.811065 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm5ld" podUID="be11a647-3b83-4a29-8f80-29cab689e649" Jul 02 15:26:44.811746 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:44.811710 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:26:44.811746 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:44.811746 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:26:44.812322 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:44.811828 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w528n" podUID="f85b2e6b-f8cc-4efd-87d3-6d85423e64a4" Jul 02 15:26:44.812322 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:44.811988 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7z5mp" podUID="ac822a5a-c97b-4159-ac19-0000a2b4abfb" Jul 02 15:26:45.811656 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:45.811617 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:26:45.811840 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:45.811770 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm5ld" podUID="be11a647-3b83-4a29-8f80-29cab689e649" Jul 02 15:26:46.491190 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:46.491151 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac822a5a-c97b-4159-ac19-0000a2b4abfb-original-pull-secret\") pod \"global-pull-secret-syncer-7z5mp\" (UID: \"ac822a5a-c97b-4159-ac19-0000a2b4abfb\") " pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:26:46.491190 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:46.491197 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw5wd\" (UniqueName: \"kubernetes.io/projected/f85b2e6b-f8cc-4efd-87d3-6d85423e64a4-kube-api-access-hw5wd\") pod \"network-check-target-w528n\" (UID: \"f85b2e6b-f8cc-4efd-87d3-6d85423e64a4\") " pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:26:46.491418 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:46.491251 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be11a647-3b83-4a29-8f80-29cab689e649-metrics-certs\") pod \"network-metrics-daemon-jm5ld\" (UID: \"be11a647-3b83-4a29-8f80-29cab689e649\") " pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:26:46.491418 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:46.491349 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:26:46.491418 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:46.491417 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be11a647-3b83-4a29-8f80-29cab689e649-metrics-certs podName:be11a647-3b83-4a29-8f80-29cab689e649 nodeName:}" failed. No retries permitted until 2026-07-02 15:27:02.491397432 +0000 UTC m=+34.121358279 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be11a647-3b83-4a29-8f80-29cab689e649-metrics-certs") pod "network-metrics-daemon-jm5ld" (UID: "be11a647-3b83-4a29-8f80-29cab689e649") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:26:46.491577 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:46.491426 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:26:46.491577 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:46.491445 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:26:46.491577 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:46.491457 2578 projected.go:196] Error preparing data for projected volume kube-api-access-hw5wd for pod openshift-network-diagnostics/network-check-target-w528n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:26:46.491577 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:46.491495 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f85b2e6b-f8cc-4efd-87d3-6d85423e64a4-kube-api-access-hw5wd podName:f85b2e6b-f8cc-4efd-87d3-6d85423e64a4 nodeName:}" failed. No retries permitted until 2026-07-02 15:27:02.491483043 +0000 UTC m=+34.121443892 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hw5wd" (UniqueName: "kubernetes.io/projected/f85b2e6b-f8cc-4efd-87d3-6d85423e64a4-kube-api-access-hw5wd") pod "network-check-target-w528n" (UID: "f85b2e6b-f8cc-4efd-87d3-6d85423e64a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:26:46.491577 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:46.491349 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:26:46.491577 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:46.491534 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac822a5a-c97b-4159-ac19-0000a2b4abfb-original-pull-secret podName:ac822a5a-c97b-4159-ac19-0000a2b4abfb nodeName:}" failed. No retries permitted until 2026-07-02 15:27:02.491521485 +0000 UTC m=+34.121482332 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ac822a5a-c97b-4159-ac19-0000a2b4abfb-original-pull-secret") pod "global-pull-secret-syncer-7z5mp" (UID: "ac822a5a-c97b-4159-ac19-0000a2b4abfb") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:26:46.811782 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:46.811707 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:26:46.811782 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:46.811715 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:26:46.812331 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:46.811862 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w528n" podUID="f85b2e6b-f8cc-4efd-87d3-6d85423e64a4" Jul 02 15:26:46.812331 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:46.811927 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7z5mp" podUID="ac822a5a-c97b-4159-ac19-0000a2b4abfb" Jul 02 15:26:47.811569 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:47.811535 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:26:47.811769 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:47.811691 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm5ld" podUID="be11a647-3b83-4a29-8f80-29cab689e649" Jul 02 15:26:48.812397 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:48.812362 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:26:48.812873 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:48.812469 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w528n" podUID="f85b2e6b-f8cc-4efd-87d3-6d85423e64a4" Jul 02 15:26:48.812873 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:48.812537 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:26:48.812873 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:48.812637 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7z5mp" podUID="ac822a5a-c97b-4159-ac19-0000a2b4abfb" Jul 02 15:26:49.811442 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:49.811407 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:26:49.811625 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:49.811531 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm5ld" podUID="be11a647-3b83-4a29-8f80-29cab689e649" Jul 02 15:26:50.812641 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:50.812006 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:26:50.812641 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:50.812126 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w528n" podUID="f85b2e6b-f8cc-4efd-87d3-6d85423e64a4" Jul 02 15:26:50.812641 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:50.812511 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:26:50.812641 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:50.812602 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7z5mp" podUID="ac822a5a-c97b-4159-ac19-0000a2b4abfb" Jul 02 15:26:50.971270 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:50.971086 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t" event={"ID":"a6630c1b-3984-4d1b-829f-aaa435022076","Type":"ContainerStarted","Data":"4edd67ec59d2a821ceeca047c4b6c7bd642727bc2b5227bdf01b12d039a7a617"} Jul 02 15:26:50.972931 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:50.972869 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxskq" event={"ID":"7ef605e3-b6e6-4783-9012-0d29145c81d3","Type":"ContainerStarted","Data":"506958178e323e4ae12c0240b11838cb77b6d66b45b7b3e0c461b75abc17d127"} Jul 02 15:26:50.974844 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:50.974816 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-97w5x" event={"ID":"2e46981c-18a5-46c3-b9d9-994de1e6fb32","Type":"ContainerStarted","Data":"fc31b3ec731aa6af204d5da3895ce1e4f19c59c03333f4610335daea7355574e"} Jul 02 15:26:50.977225 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:50.977200 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" event={"ID":"9a21b8b7-cc97-4782-aa1f-1ebd124c2987","Type":"ContainerStarted","Data":"2f6fad53b8c0b78735236ea5f6f02ab414593bc3912964bbffb6e2da6402a2c5"} Jul 02 15:26:50.979227 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:50.979202 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w55cq" event={"ID":"c6ab9c6a-2d0b-44aa-bffe-dde4a008d96b","Type":"ContainerStarted","Data":"387ed1c9133260eb1ffbff399de9122adc10581b3b1896dfde1d893c16cfdf49"} Jul 02 15:26:50.981207 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:50.981167 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-htbq4" event={"ID":"41acdf42-e5fb-4f2c-8316-1c2f1cd993ff","Type":"ContainerStarted","Data":"9a3ddfcd82a0b61847e307205469f908af863917466ba4b38cfab92328af4045"} Jul 02 15:26:50.982600 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:50.982577 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" event={"ID":"22e80d47-13ae-4515-9425-aa1aa42aa2e1","Type":"ContainerStarted","Data":"193be0d9d7d48c5f1e7ea67384ae01f72e88ed47e90f1659fc473551c1c48bb8"} Jul 02 15:26:51.005634 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:51.005596 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-113.ec2.internal" podStartSLOduration=22.005583402 podStartE2EDuration="22.005583402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:26:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:33.953804031 +0000 UTC m=+5.583764883" watchObservedRunningTime="2026-07-02 15:26:51.005583402 +0000 UTC m=+22.635544253" Jul 02 15:26:51.023062 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:51.023012 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-w55cq" podStartSLOduration=3.169738274 podStartE2EDuration="22.023000401s" totalImagesPullingTime="18.853262127s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:26:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:51.022464525 +0000 UTC m=+22.652425375" watchObservedRunningTime="2026-07-02 15:26:51.023000401 +0000 UTC m=+22.652961251" Jul 02 15:26:51.037961 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:51.037915 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-htbq4" podStartSLOduration=3.201194651 podStartE2EDuration="22.037885969s" totalImagesPullingTime="18.836691318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:26:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:51.03783456 +0000 UTC m=+22.667795413" watchObservedRunningTime="2026-07-02 15:26:51.037885969 +0000 UTC m=+22.667846823" Jul 02 15:26:51.054046 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:51.054009 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-97w5x" podStartSLOduration=3.190318704 podStartE2EDuration="22.053994238s" totalImagesPullingTime="18.863675534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:26:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:51.053639544 +0000 UTC m=+22.683600395" watchObservedRunningTime="2026-07-02 15:26:51.053994238 +0000 UTC m=+22.683955086" Jul 02 15:26:51.070916 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:51.070851 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lxcrb" podStartSLOduration=3.213933105 podStartE2EDuration="22.070831125s" totalImagesPullingTime="18.85689802s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:26:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:51.07013728 +0000 UTC m=+22.700098145" watchObservedRunningTime="2026-07-02 15:26:51.070831125 +0000 UTC m=+22.700791977" Jul 02 15:26:51.431429 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:51.431178 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:51.632767 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:51.632729 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:51.811788 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:51.811713 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:26:51.811956 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:51.811825 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm5ld" podUID="be11a647-3b83-4a29-8f80-29cab689e649" Jul 02 15:26:51.985932 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:51.985877 2578 generic.go:356] "Generic (PLEG): container finished" podID="7ef605e3-b6e6-4783-9012-0d29145c81d3" containerID="506958178e323e4ae12c0240b11838cb77b6d66b45b7b3e0c461b75abc17d127" exitCode=0 Jul 02 15:26:51.986665 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:51.985963 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxskq" event={"ID":"7ef605e3-b6e6-4783-9012-0d29145c81d3","Type":"ContainerDied","Data":"506958178e323e4ae12c0240b11838cb77b6d66b45b7b3e0c461b75abc17d127"} Jul 02 15:26:51.992377 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:51.992340 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2pztp_9a21b8b7-cc97-4782-aa1f-1ebd124c2987/ovn-acl-logging/0.log" Jul 02 15:26:51.993064 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:51.993040 2578 generic.go:356] "Generic (PLEG): container finished" podID="9a21b8b7-cc97-4782-aa1f-1ebd124c2987" containerID="b9564dc9b98f3e747ddd184b1f7f234745b35362637db84f55ec6bd5d6a17c8b" exitCode=1 Jul 02 15:26:51.993172 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:51.993114 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" event={"ID":"9a21b8b7-cc97-4782-aa1f-1ebd124c2987","Type":"ContainerStarted","Data":"f9cace1b417e21774092166ce18eab763c79ac5f7da021f09d5a3a8984f69e4c"} Jul 02 15:26:51.993254 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:51.993230 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" event={"ID":"9a21b8b7-cc97-4782-aa1f-1ebd124c2987","Type":"ContainerStarted","Data":"06272f20dc8afdb98c161b45b37f8d0dbe1ab4746ff669b2d0fa7ad3c4d0e006"} Jul 02 15:26:51.993436 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:51.993289 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" event={"ID":"9a21b8b7-cc97-4782-aa1f-1ebd124c2987","Type":"ContainerStarted","Data":"fc1ad40c5450b2df32cf40f56cab42696db915ee71a5e3df9629280a990a1029"} Jul 02 15:26:51.993436 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:51.993337 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" event={"ID":"9a21b8b7-cc97-4782-aa1f-1ebd124c2987","Type":"ContainerStarted","Data":"8fc9f002ea219cd6e8056677cb32b6e0c4fe6efc45e95b0eedb24222842896c5"} Jul 02 15:26:51.993436 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:51.993382 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" event={"ID":"9a21b8b7-cc97-4782-aa1f-1ebd124c2987","Type":"ContainerDied","Data":"b9564dc9b98f3e747ddd184b1f7f234745b35362637db84f55ec6bd5d6a17c8b"} Jul 02 15:26:51.994585 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:51.994560 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-klcnm" event={"ID":"71562d14-f2e6-4ebd-8e73-d1335355bda0","Type":"ContainerStarted","Data":"ae9956e4a196b2568421ef52ab1147b2d7d500dd672945fc29c4eae5c4569b70"} Jul 02 15:26:52.054828 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:52.054784 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-klcnm" podStartSLOduration=3.610172703 podStartE2EDuration="23.054769675s" totalImagesPullingTime="19.444596972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:26:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:52.054488984 +0000 UTC m=+23.684449834" watchObservedRunningTime="2026-07-02 15:26:52.054769675 +0000 UTC m=+23.684730525" Jul 02 15:26:52.078819 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:52.078761 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:52.173712 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:52.173686 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:52.396888 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:52.396856 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 15:26:52.649360 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:52.649325 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:52.811864 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:52.811831 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:26:52.812103 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:52.811971 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w528n" podUID="f85b2e6b-f8cc-4efd-87d3-6d85423e64a4" Jul 02 15:26:52.812103 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:52.812034 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:26:52.812229 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:52.812183 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7z5mp" podUID="ac822a5a-c97b-4159-ac19-0000a2b4abfb" Jul 02 15:26:52.812824 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:52.812734 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T15:26:52.396883756Z","UUID":"0ec9a9e7-003e-4642-a1a5-0147db105dca","Handler":null,"Name":"","Endpoint":""} Jul 02 15:26:52.814564 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:52.814542 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 15:26:52.814673 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:52.814585 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 15:26:52.852263 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:52.852224 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:52.952228 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:52.952103 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:52.999932 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:52.999863 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t" event={"ID":"a6630c1b-3984-4d1b-829f-aaa435022076","Type":"ContainerStarted","Data":"563c04f3a6e1f31a614576afb813302865f330b51d59afa9e2a9615cf8a2b2d8"} Jul 02 15:26:53.002002 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:53.001959 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gp8zn" event={"ID":"d1c4a839-8c2d-43f5-ac6e-4bc4c531bf7f","Type":"ContainerStarted","Data":"716edc75702ea56ba80fd3bd01bbfd9ea46a212219b77d7150dfcb9af0fa4ac3"} Jul 02 15:26:53.024617 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:53.024554 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gp8zn" podStartSLOduration=6.161679916 podStartE2EDuration="25.02453196s" totalImagesPullingTime="18.862852044s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:26:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:53.023683421 +0000 UTC m=+24.653644297" watchObservedRunningTime="2026-07-02 15:26:53.02453196 +0000 UTC m=+24.654492813" Jul 02 15:26:53.055826 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:53.055792 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:53.257774 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:53.257668 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:53.457562 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:53.457519 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:53.683148 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:53.683121 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:53.785644 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:53.785574 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:53.811514 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:53.811479 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:26:53.811673 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:53.811610 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm5ld" podUID="be11a647-3b83-4a29-8f80-29cab689e649" Jul 02 15:26:54.007695 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:54.007618 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2pztp_9a21b8b7-cc97-4782-aa1f-1ebd124c2987/ovn-acl-logging/0.log" Jul 02 15:26:54.008155 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:54.008060 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" event={"ID":"9a21b8b7-cc97-4782-aa1f-1ebd124c2987","Type":"ContainerStarted","Data":"465e9538759ea52fb9474e3288aaccfa337a80926ece4ca78fba88d935947fcb"} Jul 02 15:26:54.010450 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:54.010418 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t" event={"ID":"a6630c1b-3984-4d1b-829f-aaa435022076","Type":"ContainerStarted","Data":"2706c3e9a6b0169d884be196c33dd1dcf459f5ed50c028036a5059e0e949ed73"} Jul 02 15:26:54.031753 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:54.031661 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lhc8t" podStartSLOduration=3.627656984 podStartE2EDuration="25.031641974s" totalImagesPullingTime="21.40398499s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:26:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:54.031124441 +0000 UTC m=+25.661085294" watchObservedRunningTime="2026-07-02 15:26:54.031641974 +0000 UTC m=+25.661602830" Jul 02 15:26:54.058323 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:54.058280 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:54.623920 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:54.623714 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-97w5x" Jul 02 15:26:54.624326 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:54.624299 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-97w5x" Jul 02 15:26:54.643564 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:54.643528 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:54.811772 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:54.811734 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:26:54.811956 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:54.811869 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w528n" podUID="f85b2e6b-f8cc-4efd-87d3-6d85423e64a4" Jul 02 15:26:54.811956 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:54.811948 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:26:54.812096 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:54.812069 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7z5mp" podUID="ac822a5a-c97b-4159-ac19-0000a2b4abfb" Jul 02 15:26:55.013717 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:55.013623 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-97w5x" Jul 02 15:26:55.014195 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:55.014047 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-97w5x" Jul 02 15:26:55.054906 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:55.054862 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:55.233488 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:55.233458 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:55.334197 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:55.334119 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:55.635351 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:55.635319 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:55.811682 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:55.811642 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:26:55.811859 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:55.811759 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm5ld" podUID="be11a647-3b83-4a29-8f80-29cab689e649" Jul 02 15:26:56.230398 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:56.230375 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:56.633751 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:56.633571 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:56.812844 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:56.812724 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:26:56.812844 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:56.812764 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:26:56.813049 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:56.812850 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w528n" podUID="f85b2e6b-f8cc-4efd-87d3-6d85423e64a4" Jul 02 15:26:56.813049 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:56.812987 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7z5mp" podUID="ac822a5a-c97b-4159-ac19-0000a2b4abfb" Jul 02 15:26:57.019442 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:57.019409 2578 generic.go:356] "Generic (PLEG): container finished" podID="7ef605e3-b6e6-4783-9012-0d29145c81d3" containerID="eca44872e21db8e1e2f611b1232f133fd2274da467135c652aef427e0b63af59" exitCode=0 Jul 02 15:26:57.019630 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:57.019491 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxskq" event={"ID":"7ef605e3-b6e6-4783-9012-0d29145c81d3","Type":"ContainerDied","Data":"eca44872e21db8e1e2f611b1232f133fd2274da467135c652aef427e0b63af59"} Jul 02 15:26:57.023144 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:57.023117 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2pztp_9a21b8b7-cc97-4782-aa1f-1ebd124c2987/ovn-acl-logging/0.log" Jul 02 15:26:57.023610 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:57.023577 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" event={"ID":"9a21b8b7-cc97-4782-aa1f-1ebd124c2987","Type":"ContainerStarted","Data":"4449ed8dde7dd5d81da167d11ad4fcc8a773154e33c8f630d6a8f118b765e1cd"} Jul 02 15:26:57.023776 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:57.023755 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:57.023975 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:57.023961 2578 scope.go:117] "RemoveContainer" containerID="b9564dc9b98f3e747ddd184b1f7f234745b35362637db84f55ec6bd5d6a17c8b" Jul 02 15:26:57.088266 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:57.088238 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:57.235787 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:57.235750 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:57.633999 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:57.633970 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:57.810984 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:57.810956 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:26:57.811199 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:57.811078 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm5ld" podUID="be11a647-3b83-4a29-8f80-29cab689e649" Jul 02 15:26:58.029453 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:58.029376 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2pztp_9a21b8b7-cc97-4782-aa1f-1ebd124c2987/ovn-acl-logging/0.log" Jul 02 15:26:58.029772 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:58.029747 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" event={"ID":"9a21b8b7-cc97-4782-aa1f-1ebd124c2987","Type":"ContainerStarted","Data":"d986f0ee2b441bd13abd58c9bace5606a289749ce522b85bda2d5eb6d46a153f"} Jul 02 15:26:58.029948 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:58.029920 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:58.030076 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:58.029990 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:58.044786 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:58.044762 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:58.044982 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:58.044859 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:26:58.058043 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:58.058000 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" podStartSLOduration=10.189377817 podStartE2EDuration="29.057984949s" totalImagesPullingTime="18.868607132s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:26:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:58.056726966 +0000 UTC m=+29.686687817" watchObservedRunningTime="2026-07-02 15:26:58.057984949 +0000 UTC m=+29.687945800" Jul 02 15:26:58.431438 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:58.431410 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:58.811904 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:58.811801 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:26:58.811904 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:58.811876 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:26:58.812158 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:58.811912 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w528n" podUID="f85b2e6b-f8cc-4efd-87d3-6d85423e64a4" Jul 02 15:26:58.812158 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:58.812004 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7z5mp" podUID="ac822a5a-c97b-4159-ac19-0000a2b4abfb" Jul 02 15:26:58.831448 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:58.831423 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:59.030639 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:59.030592 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:59.033579 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:59.033557 2578 generic.go:356] "Generic (PLEG): container finished" podID="7ef605e3-b6e6-4783-9012-0d29145c81d3" containerID="0c78e1e3de8c7ad9f42676bd69a924f71f42ae90457806bfbbbd679b65dc8ac9" exitCode=0 Jul 02 15:26:59.033704 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:59.033647 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxskq" event={"ID":"7ef605e3-b6e6-4783-9012-0d29145c81d3","Type":"ContainerDied","Data":"0c78e1e3de8c7ad9f42676bd69a924f71f42ae90457806bfbbbd679b65dc8ac9"} Jul 02 15:26:59.228685 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:59.228653 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:59.430388 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:59.430360 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:59.811200 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:59.810978 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:26:59.811200 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:26:59.811158 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm5ld" podUID="be11a647-3b83-4a29-8f80-29cab689e649" Jul 02 15:26:59.857129 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:26:59.857098 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:00.037913 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:00.037867 2578 generic.go:356] "Generic (PLEG): container finished" podID="7ef605e3-b6e6-4783-9012-0d29145c81d3" containerID="813fea9d10faf6f2f0ee0b69576bcc5ee5273c27f38c739168ce8323844457ee" exitCode=0 Jul 02 15:27:00.038457 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:00.037923 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxskq" event={"ID":"7ef605e3-b6e6-4783-9012-0d29145c81d3","Type":"ContainerDied","Data":"813fea9d10faf6f2f0ee0b69576bcc5ee5273c27f38c739168ce8323844457ee"} Jul 02 15:27:00.100061 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:00.099981 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:00.815132 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:00.815097 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:27:00.815132 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:00.815127 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:27:00.815638 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:00.815207 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w528n" podUID="f85b2e6b-f8cc-4efd-87d3-6d85423e64a4" Jul 02 15:27:00.815638 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:00.815341 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7z5mp" podUID="ac822a5a-c97b-4159-ac19-0000a2b4abfb" Jul 02 15:27:01.811405 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:01.811364 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:27:01.811606 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:01.811490 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm5ld" podUID="be11a647-3b83-4a29-8f80-29cab689e649" Jul 02 15:27:02.505726 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:02.505688 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac822a5a-c97b-4159-ac19-0000a2b4abfb-original-pull-secret\") pod \"global-pull-secret-syncer-7z5mp\" (UID: \"ac822a5a-c97b-4159-ac19-0000a2b4abfb\") " pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:27:02.505726 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:02.505739 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw5wd\" (UniqueName: \"kubernetes.io/projected/f85b2e6b-f8cc-4efd-87d3-6d85423e64a4-kube-api-access-hw5wd\") pod \"network-check-target-w528n\" (UID: \"f85b2e6b-f8cc-4efd-87d3-6d85423e64a4\") " pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:27:02.506223 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:02.505794 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be11a647-3b83-4a29-8f80-29cab689e649-metrics-certs\") pod \"network-metrics-daemon-jm5ld\" (UID: \"be11a647-3b83-4a29-8f80-29cab689e649\") " pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:27:02.506223 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:02.505843 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:02.506223 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:02.505890 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:27:02.506223 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:02.505915 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:02.506223 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:02.505925 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:27:02.506223 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:02.505936 2578 projected.go:196] Error preparing data for projected volume kube-api-access-hw5wd for pod openshift-network-diagnostics/network-check-target-w528n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:02.506223 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:02.505925 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac822a5a-c97b-4159-ac19-0000a2b4abfb-original-pull-secret podName:ac822a5a-c97b-4159-ac19-0000a2b4abfb nodeName:}" failed. No retries permitted until 2026-07-02 15:27:34.505890331 +0000 UTC m=+66.135851174 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ac822a5a-c97b-4159-ac19-0000a2b4abfb-original-pull-secret") pod "global-pull-secret-syncer-7z5mp" (UID: "ac822a5a-c97b-4159-ac19-0000a2b4abfb") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:27:02.506223 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:02.506013 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be11a647-3b83-4a29-8f80-29cab689e649-metrics-certs podName:be11a647-3b83-4a29-8f80-29cab689e649 nodeName:}" failed. No retries permitted until 2026-07-02 15:27:34.505977569 +0000 UTC m=+66.135938415 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be11a647-3b83-4a29-8f80-29cab689e649-metrics-certs") pod "network-metrics-daemon-jm5ld" (UID: "be11a647-3b83-4a29-8f80-29cab689e649") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:27:02.506223 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:02.506035 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f85b2e6b-f8cc-4efd-87d3-6d85423e64a4-kube-api-access-hw5wd podName:f85b2e6b-f8cc-4efd-87d3-6d85423e64a4 nodeName:}" failed. No retries permitted until 2026-07-02 15:27:34.506022485 +0000 UTC m=+66.135983327 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hw5wd" (UniqueName: "kubernetes.io/projected/f85b2e6b-f8cc-4efd-87d3-6d85423e64a4-kube-api-access-hw5wd") pod "network-check-target-w528n" (UID: "f85b2e6b-f8cc-4efd-87d3-6d85423e64a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:27:02.815850 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:02.815601 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:27:02.815850 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:02.815740 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7z5mp" podUID="ac822a5a-c97b-4159-ac19-0000a2b4abfb" Jul 02 15:27:02.815850 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:02.815800 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:27:02.816118 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:02.815956 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w528n" podUID="f85b2e6b-f8cc-4efd-87d3-6d85423e64a4" Jul 02 15:27:03.670987 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:03.670954 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:03.771465 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:03.771427 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:03.811862 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:03.811833 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:27:03.812061 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:03.811967 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm5ld" podUID="be11a647-3b83-4a29-8f80-29cab689e649" Jul 02 15:27:03.871262 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:03.871227 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:03.969292 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:03.969220 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:04.161645 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:04.161608 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:04.547579 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:04.547552 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:04.649133 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:04.649100 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:04.777820 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:04.777784 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:04.814421 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:04.814365 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:27:04.814521 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:04.814471 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7z5mp" podUID="ac822a5a-c97b-4159-ac19-0000a2b4abfb" Jul 02 15:27:04.814560 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:04.814551 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:27:04.814652 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:04.814635 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w528n" podUID="f85b2e6b-f8cc-4efd-87d3-6d85423e64a4" Jul 02 15:27:04.877959 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:04.877933 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:05.052454 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:05.052420 2578 generic.go:356] "Generic (PLEG): container finished" podID="7ef605e3-b6e6-4783-9012-0d29145c81d3" containerID="b3fe93b0107a6d100138c220b2d1b7a30a68732da210a5a60f2de39ff4c691de" exitCode=0 Jul 02 15:27:05.052614 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:05.052476 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxskq" event={"ID":"7ef605e3-b6e6-4783-9012-0d29145c81d3","Type":"ContainerDied","Data":"b3fe93b0107a6d100138c220b2d1b7a30a68732da210a5a60f2de39ff4c691de"} Jul 02 15:27:05.350791 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:05.350722 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:05.754700 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:05.754665 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:05.811842 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:05.811817 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:27:05.812198 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:05.811940 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm5ld" podUID="be11a647-3b83-4a29-8f80-29cab689e649" Jul 02 15:27:05.855120 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:05.855090 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:06.060299 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:06.060217 2578 generic.go:356] "Generic (PLEG): container finished" podID="7ef605e3-b6e6-4783-9012-0d29145c81d3" containerID="3ec2bad4d23af8c4471f1d9c8880fdbe50e1659f67171bf2ebc5fc420d4413c2" exitCode=0 Jul 02 15:27:06.060299 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:06.060275 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxskq" event={"ID":"7ef605e3-b6e6-4783-9012-0d29145c81d3","Type":"ContainerDied","Data":"3ec2bad4d23af8c4471f1d9c8880fdbe50e1659f67171bf2ebc5fc420d4413c2"} Jul 02 15:27:06.572449 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:06.572418 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:06.672718 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:06.672685 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:06.811470 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:06.811438 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:27:06.811470 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:06.811469 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:27:06.811723 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:06.811546 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w528n" podUID="f85b2e6b-f8cc-4efd-87d3-6d85423e64a4" Jul 02 15:27:06.811723 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:06.811623 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7z5mp" podUID="ac822a5a-c97b-4159-ac19-0000a2b4abfb" Jul 02 15:27:07.066063 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:07.066028 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxskq" event={"ID":"7ef605e3-b6e6-4783-9012-0d29145c81d3","Type":"ContainerStarted","Data":"757d555f25ef4c6742af76b6e5db4a321dd5d7f37d642c8d62a52b15b824994c"} Jul 02 15:27:07.090216 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:07.090172 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pxskq" podStartSLOduration=8.106454953 podStartE2EDuration="38.090159185s" totalImagesPullingTime="29.983704232s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:26:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:07.090082253 +0000 UTC m=+38.720043104" watchObservedRunningTime="2026-07-02 15:27:07.090159185 +0000 UTC m=+38.720120036" Jul 02 15:27:07.811204 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:07.811173 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:27:07.811378 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:07.811278 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm5ld" podUID="be11a647-3b83-4a29-8f80-29cab689e649" Jul 02 15:27:07.884222 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:07.884183 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:07.943533 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:07.943504 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:08.811730 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:08.811703 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:27:08.812193 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:08.811789 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:27:08.812193 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:08.811882 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7z5mp" podUID="ac822a5a-c97b-4159-ac19-0000a2b4abfb" Jul 02 15:27:08.812193 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:08.811787 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w528n" podUID="f85b2e6b-f8cc-4efd-87d3-6d85423e64a4" Jul 02 15:27:09.391737 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:09.391562 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:09.461520 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:09.461496 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:09.811411 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:09.811322 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:27:09.811560 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:09.811432 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm5ld" podUID="be11a647-3b83-4a29-8f80-29cab689e649" Jul 02 15:27:10.811250 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:10.811213 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:27:10.811628 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:10.811340 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w528n" podUID="f85b2e6b-f8cc-4efd-87d3-6d85423e64a4" Jul 02 15:27:10.811628 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:10.811388 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:27:10.811628 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:10.811473 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7z5mp" podUID="ac822a5a-c97b-4159-ac19-0000a2b4abfb" Jul 02 15:27:10.962071 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:10.962037 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:11.096786 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:11.096682 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:11.186353 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:11.186321 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:11.289219 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:11.289190 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:11.390905 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:11.390857 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:11.502977 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:11.502944 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:11.811403 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:11.811341 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:27:11.811765 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:11.811444 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm5ld" podUID="be11a647-3b83-4a29-8f80-29cab689e649" Jul 02 15:27:12.038913 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:12.038861 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:12.127277 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:12.127246 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:12.254694 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:12.254668 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w528n"] Jul 02 15:27:12.254844 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:12.254757 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:27:12.254884 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:12.254840 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w528n" podUID="f85b2e6b-f8cc-4efd-87d3-6d85423e64a4" Jul 02 15:27:12.257999 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:12.257972 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7z5mp"] Jul 02 15:27:12.258116 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:12.258067 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:27:12.258188 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:12.258169 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7z5mp" podUID="ac822a5a-c97b-4159-ac19-0000a2b4abfb" Jul 02 15:27:12.258549 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:12.258526 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jm5ld"] Jul 02 15:27:12.258658 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:12.258619 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:27:12.258730 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:12.258712 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm5ld" podUID="be11a647-3b83-4a29-8f80-29cab689e649" Jul 02 15:27:12.318113 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:12.318027 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:12.414138 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:12.414112 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:13.391505 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:13.391479 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:13.462542 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:13.462506 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:13.811285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:13.811200 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:27:13.811285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:13.811228 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:27:13.811285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:13.811247 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:27:13.811507 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:13.811337 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm5ld" podUID="be11a647-3b83-4a29-8f80-29cab689e649" Jul 02 15:27:13.811507 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:13.811368 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w528n" podUID="f85b2e6b-f8cc-4efd-87d3-6d85423e64a4" Jul 02 15:27:13.811507 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:13.811428 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7z5mp" podUID="ac822a5a-c97b-4159-ac19-0000a2b4abfb" Jul 02 15:27:15.789070 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:15.789039 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:15.811209 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:15.811183 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:27:15.811209 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:15.811210 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:27:15.811381 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:15.811213 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:27:15.811381 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:15.811296 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm5ld" podUID="be11a647-3b83-4a29-8f80-29cab689e649" Jul 02 15:27:15.811381 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:15.811345 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7z5mp" podUID="ac822a5a-c97b-4159-ac19-0000a2b4abfb" Jul 02 15:27:15.811484 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:15.811429 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w528n" podUID="f85b2e6b-f8cc-4efd-87d3-6d85423e64a4" Jul 02 15:27:15.889176 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:15.889142 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:16.174020 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.173991 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-113.ec2.internal" event="NodeReady" Jul 02 15:27:16.174187 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.174117 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 15:27:16.219071 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.219044 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2w56m"] Jul 02 15:27:16.241577 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.241551 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-krdd9"] Jul 02 15:27:16.241761 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.241742 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2w56m" Jul 02 15:27:16.243659 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.243637 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-248dl\"" Jul 02 15:27:16.243770 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.243637 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 15:27:16.243942 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.243926 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 15:27:16.244065 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.244048 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 15:27:16.259568 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.259547 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2w56m"] Jul 02 15:27:16.259681 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.259590 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-krdd9"] Jul 02 15:27:16.259681 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.259625 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nd9r4"] Jul 02 15:27:16.259681 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.259663 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-krdd9" Jul 02 15:27:16.261578 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.261560 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 15:27:16.261578 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.261577 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kxmrv\"" Jul 02 15:27:16.261755 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.261592 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 15:27:16.261755 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.261637 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 15:27:16.261755 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.261685 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 15:27:16.283649 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.283631 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nd9r4"] Jul 02 15:27:16.283735 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.283715 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nd9r4" Jul 02 15:27:16.285712 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.285695 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 15:27:16.285812 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.285765 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kt6gc\"" Jul 02 15:27:16.285887 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.285856 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 15:27:16.413091 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.413060 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0de4f1e9-d2ea-443f-b4f2-27c40d5a889c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-krdd9\" (UID: \"0de4f1e9-d2ea-443f-b4f2-27c40d5a889c\") " pod="openshift-insights/insights-runtime-extractor-krdd9" Jul 02 15:27:16.413091 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.413091 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw9bw\" (UniqueName: \"kubernetes.io/projected/0de4f1e9-d2ea-443f-b4f2-27c40d5a889c-kube-api-access-fw9bw\") pod \"insights-runtime-extractor-krdd9\" (UID: \"0de4f1e9-d2ea-443f-b4f2-27c40d5a889c\") " pod="openshift-insights/insights-runtime-extractor-krdd9" Jul 02 15:27:16.413281 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.413111 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/329a2f36-230c-4b1e-a91b-edad15b028ca-cert\") pod \"ingress-canary-2w56m\" (UID: \"329a2f36-230c-4b1e-a91b-edad15b028ca\") " pod="openshift-ingress-canary/ingress-canary-2w56m" Jul 02 15:27:16.413281 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.413137 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0de4f1e9-d2ea-443f-b4f2-27c40d5a889c-crio-socket\") pod \"insights-runtime-extractor-krdd9\" (UID: \"0de4f1e9-d2ea-443f-b4f2-27c40d5a889c\") " pod="openshift-insights/insights-runtime-extractor-krdd9" Jul 02 15:27:16.413281 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.413208 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/55bdc49f-63bf-41e4-bd85-c8cbdaa114e2-config-volume\") pod \"dns-default-nd9r4\" (UID: \"55bdc49f-63bf-41e4-bd85-c8cbdaa114e2\") " pod="openshift-dns/dns-default-nd9r4" Jul 02 15:27:16.413281 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.413225 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55bdc49f-63bf-41e4-bd85-c8cbdaa114e2-tmp-dir\") pod \"dns-default-nd9r4\" (UID: \"55bdc49f-63bf-41e4-bd85-c8cbdaa114e2\") " pod="openshift-dns/dns-default-nd9r4" Jul 02 15:27:16.413281 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.413254 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96srj\" (UniqueName: \"kubernetes.io/projected/55bdc49f-63bf-41e4-bd85-c8cbdaa114e2-kube-api-access-96srj\") pod \"dns-default-nd9r4\" (UID: \"55bdc49f-63bf-41e4-bd85-c8cbdaa114e2\") " pod="openshift-dns/dns-default-nd9r4" Jul 02 15:27:16.413427 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.413296 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/55bdc49f-63bf-41e4-bd85-c8cbdaa114e2-metrics-tls\") pod \"dns-default-nd9r4\" (UID: \"55bdc49f-63bf-41e4-bd85-c8cbdaa114e2\") " pod="openshift-dns/dns-default-nd9r4" Jul 02 15:27:16.413427 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.413326 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-885dd\" (UniqueName: \"kubernetes.io/projected/329a2f36-230c-4b1e-a91b-edad15b028ca-kube-api-access-885dd\") pod \"ingress-canary-2w56m\" (UID: \"329a2f36-230c-4b1e-a91b-edad15b028ca\") " pod="openshift-ingress-canary/ingress-canary-2w56m" Jul 02 15:27:16.413427 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.413366 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0de4f1e9-d2ea-443f-b4f2-27c40d5a889c-data-volume\") pod \"insights-runtime-extractor-krdd9\" (UID: \"0de4f1e9-d2ea-443f-b4f2-27c40d5a889c\") " pod="openshift-insights/insights-runtime-extractor-krdd9" Jul 02 15:27:16.413427 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.413386 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0de4f1e9-d2ea-443f-b4f2-27c40d5a889c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-krdd9\" (UID: \"0de4f1e9-d2ea-443f-b4f2-27c40d5a889c\") " pod="openshift-insights/insights-runtime-extractor-krdd9" Jul 02 15:27:16.425587 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.425527 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:16.514632 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.514600 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0de4f1e9-d2ea-443f-b4f2-27c40d5a889c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-krdd9\" (UID: \"0de4f1e9-d2ea-443f-b4f2-27c40d5a889c\") " pod="openshift-insights/insights-runtime-extractor-krdd9" Jul 02 15:27:16.514804 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.514636 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw9bw\" (UniqueName: \"kubernetes.io/projected/0de4f1e9-d2ea-443f-b4f2-27c40d5a889c-kube-api-access-fw9bw\") pod \"insights-runtime-extractor-krdd9\" (UID: \"0de4f1e9-d2ea-443f-b4f2-27c40d5a889c\") " pod="openshift-insights/insights-runtime-extractor-krdd9" Jul 02 15:27:16.514804 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.514653 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/329a2f36-230c-4b1e-a91b-edad15b028ca-cert\") pod \"ingress-canary-2w56m\" (UID: \"329a2f36-230c-4b1e-a91b-edad15b028ca\") " pod="openshift-ingress-canary/ingress-canary-2w56m" Jul 02 15:27:16.514804 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.514679 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0de4f1e9-d2ea-443f-b4f2-27c40d5a889c-crio-socket\") pod \"insights-runtime-extractor-krdd9\" (UID: \"0de4f1e9-d2ea-443f-b4f2-27c40d5a889c\") " pod="openshift-insights/insights-runtime-extractor-krdd9" Jul 02 15:27:16.514804 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.514740 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/55bdc49f-63bf-41e4-bd85-c8cbdaa114e2-config-volume\") pod \"dns-default-nd9r4\" (UID: \"55bdc49f-63bf-41e4-bd85-c8cbdaa114e2\") " pod="openshift-dns/dns-default-nd9r4" Jul 02 15:27:16.514804 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.514763 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55bdc49f-63bf-41e4-bd85-c8cbdaa114e2-tmp-dir\") pod \"dns-default-nd9r4\" (UID: \"55bdc49f-63bf-41e4-bd85-c8cbdaa114e2\") " pod="openshift-dns/dns-default-nd9r4" Jul 02 15:27:16.514804 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.514796 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96srj\" (UniqueName: \"kubernetes.io/projected/55bdc49f-63bf-41e4-bd85-c8cbdaa114e2-kube-api-access-96srj\") pod \"dns-default-nd9r4\" (UID: \"55bdc49f-63bf-41e4-bd85-c8cbdaa114e2\") " pod="openshift-dns/dns-default-nd9r4" Jul 02 15:27:16.515109 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.514824 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/55bdc49f-63bf-41e4-bd85-c8cbdaa114e2-metrics-tls\") pod \"dns-default-nd9r4\" (UID: \"55bdc49f-63bf-41e4-bd85-c8cbdaa114e2\") " pod="openshift-dns/dns-default-nd9r4" Jul 02 15:27:16.515109 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.514848 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-885dd\" (UniqueName: \"kubernetes.io/projected/329a2f36-230c-4b1e-a91b-edad15b028ca-kube-api-access-885dd\") pod \"ingress-canary-2w56m\" (UID: \"329a2f36-230c-4b1e-a91b-edad15b028ca\") " pod="openshift-ingress-canary/ingress-canary-2w56m" Jul 02 15:27:16.515109 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.514925 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0de4f1e9-d2ea-443f-b4f2-27c40d5a889c-data-volume\") pod \"insights-runtime-extractor-krdd9\" (UID: \"0de4f1e9-d2ea-443f-b4f2-27c40d5a889c\") " pod="openshift-insights/insights-runtime-extractor-krdd9" Jul 02 15:27:16.515109 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.514956 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0de4f1e9-d2ea-443f-b4f2-27c40d5a889c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-krdd9\" (UID: \"0de4f1e9-d2ea-443f-b4f2-27c40d5a889c\") " pod="openshift-insights/insights-runtime-extractor-krdd9" Jul 02 15:27:16.515109 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.514974 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0de4f1e9-d2ea-443f-b4f2-27c40d5a889c-crio-socket\") pod \"insights-runtime-extractor-krdd9\" (UID: \"0de4f1e9-d2ea-443f-b4f2-27c40d5a889c\") " pod="openshift-insights/insights-runtime-extractor-krdd9" Jul 02 15:27:16.515345 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.515250 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55bdc49f-63bf-41e4-bd85-c8cbdaa114e2-tmp-dir\") pod \"dns-default-nd9r4\" (UID: \"55bdc49f-63bf-41e4-bd85-c8cbdaa114e2\") " pod="openshift-dns/dns-default-nd9r4" Jul 02 15:27:16.515412 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.515354 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0de4f1e9-d2ea-443f-b4f2-27c40d5a889c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-krdd9\" (UID: \"0de4f1e9-d2ea-443f-b4f2-27c40d5a889c\") " pod="openshift-insights/insights-runtime-extractor-krdd9" Jul 02 15:27:16.515412 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.515402 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0de4f1e9-d2ea-443f-b4f2-27c40d5a889c-data-volume\") pod \"insights-runtime-extractor-krdd9\" (UID: \"0de4f1e9-d2ea-443f-b4f2-27c40d5a889c\") " pod="openshift-insights/insights-runtime-extractor-krdd9" Jul 02 15:27:16.515523 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.515410 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/55bdc49f-63bf-41e4-bd85-c8cbdaa114e2-config-volume\") pod \"dns-default-nd9r4\" (UID: \"55bdc49f-63bf-41e4-bd85-c8cbdaa114e2\") " pod="openshift-dns/dns-default-nd9r4" Jul 02 15:27:16.518320 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.518192 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:16.518873 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.518844 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0de4f1e9-d2ea-443f-b4f2-27c40d5a889c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-krdd9\" (UID: \"0de4f1e9-d2ea-443f-b4f2-27c40d5a889c\") " pod="openshift-insights/insights-runtime-extractor-krdd9" Jul 02 15:27:16.519001 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.518854 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/55bdc49f-63bf-41e4-bd85-c8cbdaa114e2-metrics-tls\") pod \"dns-default-nd9r4\" (UID: \"55bdc49f-63bf-41e4-bd85-c8cbdaa114e2\") " pod="openshift-dns/dns-default-nd9r4" Jul 02 15:27:16.519001 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.518883 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/329a2f36-230c-4b1e-a91b-edad15b028ca-cert\") pod \"ingress-canary-2w56m\" (UID: \"329a2f36-230c-4b1e-a91b-edad15b028ca\") " pod="openshift-ingress-canary/ingress-canary-2w56m" Jul 02 15:27:16.522028 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.522009 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-885dd\" (UniqueName: \"kubernetes.io/projected/329a2f36-230c-4b1e-a91b-edad15b028ca-kube-api-access-885dd\") pod \"ingress-canary-2w56m\" (UID: \"329a2f36-230c-4b1e-a91b-edad15b028ca\") " pod="openshift-ingress-canary/ingress-canary-2w56m" Jul 02 15:27:16.522126 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.522111 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw9bw\" (UniqueName: \"kubernetes.io/projected/0de4f1e9-d2ea-443f-b4f2-27c40d5a889c-kube-api-access-fw9bw\") pod \"insights-runtime-extractor-krdd9\" (UID: \"0de4f1e9-d2ea-443f-b4f2-27c40d5a889c\") " pod="openshift-insights/insights-runtime-extractor-krdd9" Jul 02 15:27:16.522256 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.522241 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96srj\" (UniqueName: \"kubernetes.io/projected/55bdc49f-63bf-41e4-bd85-c8cbdaa114e2-kube-api-access-96srj\") pod \"dns-default-nd9r4\" (UID: \"55bdc49f-63bf-41e4-bd85-c8cbdaa114e2\") " pod="openshift-dns/dns-default-nd9r4" Jul 02 15:27:16.551214 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.551180 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2w56m" Jul 02 15:27:16.567316 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.567289 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-krdd9" Jul 02 15:27:16.591440 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.591425 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nd9r4" Jul 02 15:27:16.797858 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.797816 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2w56m"] Jul 02 15:27:16.803039 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:27:16.803013 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod329a2f36_230c_4b1e_a91b_edad15b028ca.slice/crio-ff3c1da5bc246f8c9855203d2e0991cb27ff95d6bbf7719a9a9ed1e22b2b8a97 WatchSource:0}: Error finding container ff3c1da5bc246f8c9855203d2e0991cb27ff95d6bbf7719a9a9ed1e22b2b8a97: Status 404 returned error can't find the container with id ff3c1da5bc246f8c9855203d2e0991cb27ff95d6bbf7719a9a9ed1e22b2b8a97 Jul 02 15:27:16.808313 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.808290 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nd9r4"] Jul 02 15:27:16.810950 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:27:16.810930 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55bdc49f_63bf_41e4_bd85_c8cbdaa114e2.slice/crio-a7e54d322510ddfcdfc7d9408ed4dbf4ced57002eec861d53b6adba46502c9f6 WatchSource:0}: Error finding container a7e54d322510ddfcdfc7d9408ed4dbf4ced57002eec861d53b6adba46502c9f6: Status 404 returned error can't find the container with id a7e54d322510ddfcdfc7d9408ed4dbf4ced57002eec861d53b6adba46502c9f6 Jul 02 15:27:16.825446 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:16.825421 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-krdd9"] Jul 02 15:27:16.828785 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:27:16.828762 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0de4f1e9_d2ea_443f_b4f2_27c40d5a889c.slice/crio-3a54fd7cee88c48b625aeb1f114dd3fc1f113cd621ca61cc0a52a999b708967c WatchSource:0}: Error finding container 3a54fd7cee88c48b625aeb1f114dd3fc1f113cd621ca61cc0a52a999b708967c: Status 404 returned error can't find the container with id 3a54fd7cee88c48b625aeb1f114dd3fc1f113cd621ca61cc0a52a999b708967c Jul 02 15:27:17.091344 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:17.091248 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nd9r4" event={"ID":"55bdc49f-63bf-41e4-bd85-c8cbdaa114e2","Type":"ContainerStarted","Data":"a7e54d322510ddfcdfc7d9408ed4dbf4ced57002eec861d53b6adba46502c9f6"} Jul 02 15:27:17.092398 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:17.092369 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-krdd9" event={"ID":"0de4f1e9-d2ea-443f-b4f2-27c40d5a889c","Type":"ContainerStarted","Data":"3a54fd7cee88c48b625aeb1f114dd3fc1f113cd621ca61cc0a52a999b708967c"} Jul 02 15:27:17.093386 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:17.093365 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2w56m" event={"ID":"329a2f36-230c-4b1e-a91b-edad15b028ca","Type":"ContainerStarted","Data":"ff3c1da5bc246f8c9855203d2e0991cb27ff95d6bbf7719a9a9ed1e22b2b8a97"} Jul 02 15:27:17.811514 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:17.811482 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:27:17.811514 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:17.811523 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:27:17.812073 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:17.811479 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:27:17.815015 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:17.814427 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 15:27:17.815015 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:17.814630 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 15:27:17.815015 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:17.814832 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 15:27:17.815015 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:17.814859 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pj7tx\"" Jul 02 15:27:17.815306 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:17.815028 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 15:27:17.815306 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:17.815110 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ffxgv\"" Jul 02 15:27:19.784164 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.784120 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c988677bc-76gtr"] Jul 02 15:27:19.784935 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.784888 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:19.822796 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.822759 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c988677bc-76gtr"] Jul 02 15:27:19.822982 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.822915 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c988677bc-76gtr" Jul 02 15:27:19.829433 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.829406 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 02 15:27:19.829570 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.829489 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 02 15:27:19.829660 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.829632 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 02 15:27:19.829767 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.829416 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 15:27:19.830025 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.829406 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 15:27:19.830025 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.829866 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 02 15:27:19.830025 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.829945 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 02 15:27:19.830956 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.830339 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4pbgk\"" Jul 02 15:27:19.833547 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.833528 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 02 15:27:19.845340 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.845317 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8vx2\" (UniqueName: \"kubernetes.io/projected/abb0dc5d-edd4-4d13-97f2-367a36dab886-kube-api-access-x8vx2\") pod \"console-6c988677bc-76gtr\" (UID: \"abb0dc5d-edd4-4d13-97f2-367a36dab886\") " pod="openshift-console/console-6c988677bc-76gtr" Jul 02 15:27:19.845444 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.845352 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/abb0dc5d-edd4-4d13-97f2-367a36dab886-console-oauth-config\") pod \"console-6c988677bc-76gtr\" (UID: \"abb0dc5d-edd4-4d13-97f2-367a36dab886\") " pod="openshift-console/console-6c988677bc-76gtr" Jul 02 15:27:19.845444 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.845370 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abb0dc5d-edd4-4d13-97f2-367a36dab886-trusted-ca-bundle\") pod \"console-6c988677bc-76gtr\" (UID: \"abb0dc5d-edd4-4d13-97f2-367a36dab886\") " pod="openshift-console/console-6c988677bc-76gtr" Jul 02 15:27:19.845523 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.845436 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/abb0dc5d-edd4-4d13-97f2-367a36dab886-service-ca\") pod \"console-6c988677bc-76gtr\" (UID: \"abb0dc5d-edd4-4d13-97f2-367a36dab886\") " pod="openshift-console/console-6c988677bc-76gtr" Jul 02 15:27:19.845523 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.845513 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/abb0dc5d-edd4-4d13-97f2-367a36dab886-console-serving-cert\") pod \"console-6c988677bc-76gtr\" (UID: \"abb0dc5d-edd4-4d13-97f2-367a36dab886\") " pod="openshift-console/console-6c988677bc-76gtr" Jul 02 15:27:19.845611 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.845551 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/abb0dc5d-edd4-4d13-97f2-367a36dab886-oauth-serving-cert\") pod \"console-6c988677bc-76gtr\" (UID: \"abb0dc5d-edd4-4d13-97f2-367a36dab886\") " pod="openshift-console/console-6c988677bc-76gtr" Jul 02 15:27:19.845655 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.845609 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/abb0dc5d-edd4-4d13-97f2-367a36dab886-console-config\") pod \"console-6c988677bc-76gtr\" (UID: \"abb0dc5d-edd4-4d13-97f2-367a36dab886\") " pod="openshift-console/console-6c988677bc-76gtr" Jul 02 15:27:19.878145 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.878111 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:19.946576 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.946532 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/abb0dc5d-edd4-4d13-97f2-367a36dab886-service-ca\") pod \"console-6c988677bc-76gtr\" (UID: \"abb0dc5d-edd4-4d13-97f2-367a36dab886\") " pod="openshift-console/console-6c988677bc-76gtr" Jul 02 15:27:19.946729 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.946609 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/abb0dc5d-edd4-4d13-97f2-367a36dab886-console-serving-cert\") pod \"console-6c988677bc-76gtr\" (UID: \"abb0dc5d-edd4-4d13-97f2-367a36dab886\") " pod="openshift-console/console-6c988677bc-76gtr" Jul 02 15:27:19.946909 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.946870 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/abb0dc5d-edd4-4d13-97f2-367a36dab886-oauth-serving-cert\") pod \"console-6c988677bc-76gtr\" (UID: \"abb0dc5d-edd4-4d13-97f2-367a36dab886\") " pod="openshift-console/console-6c988677bc-76gtr" Jul 02 15:27:19.947050 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.946967 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/abb0dc5d-edd4-4d13-97f2-367a36dab886-console-config\") pod \"console-6c988677bc-76gtr\" (UID: \"abb0dc5d-edd4-4d13-97f2-367a36dab886\") " pod="openshift-console/console-6c988677bc-76gtr" Jul 02 15:27:19.947123 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.947073 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8vx2\" (UniqueName: \"kubernetes.io/projected/abb0dc5d-edd4-4d13-97f2-367a36dab886-kube-api-access-x8vx2\") pod \"console-6c988677bc-76gtr\" (UID: \"abb0dc5d-edd4-4d13-97f2-367a36dab886\") " pod="openshift-console/console-6c988677bc-76gtr" Jul 02 15:27:19.947176 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.947124 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/abb0dc5d-edd4-4d13-97f2-367a36dab886-console-oauth-config\") pod \"console-6c988677bc-76gtr\" (UID: \"abb0dc5d-edd4-4d13-97f2-367a36dab886\") " pod="openshift-console/console-6c988677bc-76gtr" Jul 02 15:27:19.947176 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.947149 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abb0dc5d-edd4-4d13-97f2-367a36dab886-trusted-ca-bundle\") pod \"console-6c988677bc-76gtr\" (UID: \"abb0dc5d-edd4-4d13-97f2-367a36dab886\") " pod="openshift-console/console-6c988677bc-76gtr" Jul 02 15:27:19.948833 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.948451 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/abb0dc5d-edd4-4d13-97f2-367a36dab886-oauth-serving-cert\") pod \"console-6c988677bc-76gtr\" (UID: \"abb0dc5d-edd4-4d13-97f2-367a36dab886\") " pod="openshift-console/console-6c988677bc-76gtr" Jul 02 15:27:19.948833 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.948552 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/abb0dc5d-edd4-4d13-97f2-367a36dab886-service-ca\") pod \"console-6c988677bc-76gtr\" (UID: \"abb0dc5d-edd4-4d13-97f2-367a36dab886\") " pod="openshift-console/console-6c988677bc-76gtr" Jul 02 15:27:19.948833 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.948783 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/abb0dc5d-edd4-4d13-97f2-367a36dab886-console-config\") pod \"console-6c988677bc-76gtr\" (UID: \"abb0dc5d-edd4-4d13-97f2-367a36dab886\") " pod="openshift-console/console-6c988677bc-76gtr" Jul 02 15:27:19.949886 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.949800 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abb0dc5d-edd4-4d13-97f2-367a36dab886-trusted-ca-bundle\") pod \"console-6c988677bc-76gtr\" (UID: \"abb0dc5d-edd4-4d13-97f2-367a36dab886\") " pod="openshift-console/console-6c988677bc-76gtr" Jul 02 15:27:19.952168 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.951828 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/abb0dc5d-edd4-4d13-97f2-367a36dab886-console-serving-cert\") pod \"console-6c988677bc-76gtr\" (UID: \"abb0dc5d-edd4-4d13-97f2-367a36dab886\") " pod="openshift-console/console-6c988677bc-76gtr" Jul 02 15:27:19.954838 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.954695 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/abb0dc5d-edd4-4d13-97f2-367a36dab886-console-oauth-config\") pod \"console-6c988677bc-76gtr\" (UID: \"abb0dc5d-edd4-4d13-97f2-367a36dab886\") " pod="openshift-console/console-6c988677bc-76gtr" Jul 02 15:27:19.956169 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:19.956150 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8vx2\" (UniqueName: \"kubernetes.io/projected/abb0dc5d-edd4-4d13-97f2-367a36dab886-kube-api-access-x8vx2\") pod \"console-6c988677bc-76gtr\" (UID: \"abb0dc5d-edd4-4d13-97f2-367a36dab886\") " pod="openshift-console/console-6c988677bc-76gtr" Jul 02 15:27:20.135910 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:20.135864 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c988677bc-76gtr" Jul 02 15:27:21.397330 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:21.397300 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:21.442049 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:21.442020 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-jpcp9"] Jul 02 15:27:21.457091 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:21.457050 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-jpcp9"] Jul 02 15:27:21.457244 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:21.457178 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-jpcp9" Jul 02 15:27:21.459723 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:21.459702 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 02 15:27:21.459723 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:21.459706 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 02 15:27:21.460111 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:21.459830 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 15:27:21.460111 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:21.459854 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 15:27:21.460111 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:21.459826 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7n96d\"" Jul 02 15:27:21.460111 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:21.459832 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 15:27:21.465185 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:21.465160 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:21.558590 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:21.558550 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18b267e0-3560-449a-a588-66886974070a-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-jpcp9\" (UID: \"18b267e0-3560-449a-a588-66886974070a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-jpcp9" Jul 02 15:27:21.558765 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:21.558644 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/18b267e0-3560-449a-a588-66886974070a-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-jpcp9\" (UID: \"18b267e0-3560-449a-a588-66886974070a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-jpcp9" Jul 02 15:27:21.558765 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:21.558673 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhcrt\" (UniqueName: \"kubernetes.io/projected/18b267e0-3560-449a-a588-66886974070a-kube-api-access-nhcrt\") pod \"prometheus-operator-7b7d896497-jpcp9\" (UID: \"18b267e0-3560-449a-a588-66886974070a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-jpcp9" Jul 02 15:27:21.558765 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:21.558738 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18b267e0-3560-449a-a588-66886974070a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-jpcp9\" (UID: \"18b267e0-3560-449a-a588-66886974070a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-jpcp9" Jul 02 15:27:21.660193 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:21.660102 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18b267e0-3560-449a-a588-66886974070a-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-jpcp9\" (UID: \"18b267e0-3560-449a-a588-66886974070a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-jpcp9" Jul 02 15:27:21.660359 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:21.660252 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/18b267e0-3560-449a-a588-66886974070a-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-jpcp9\" (UID: \"18b267e0-3560-449a-a588-66886974070a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-jpcp9" Jul 02 15:27:21.660359 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:21.660284 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhcrt\" (UniqueName: \"kubernetes.io/projected/18b267e0-3560-449a-a588-66886974070a-kube-api-access-nhcrt\") pod \"prometheus-operator-7b7d896497-jpcp9\" (UID: \"18b267e0-3560-449a-a588-66886974070a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-jpcp9" Jul 02 15:27:21.660359 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:21.660345 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18b267e0-3560-449a-a588-66886974070a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-jpcp9\" (UID: \"18b267e0-3560-449a-a588-66886974070a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-jpcp9" Jul 02 15:27:21.660940 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:21.660913 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18b267e0-3560-449a-a588-66886974070a-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-jpcp9\" (UID: \"18b267e0-3560-449a-a588-66886974070a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-jpcp9" Jul 02 15:27:21.663479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:21.663444 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18b267e0-3560-449a-a588-66886974070a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-jpcp9\" (UID: \"18b267e0-3560-449a-a588-66886974070a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-jpcp9" Jul 02 15:27:21.663631 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:21.663607 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/18b267e0-3560-449a-a588-66886974070a-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-jpcp9\" (UID: \"18b267e0-3560-449a-a588-66886974070a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-jpcp9" Jul 02 15:27:21.668752 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:21.668727 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhcrt\" (UniqueName: \"kubernetes.io/projected/18b267e0-3560-449a-a588-66886974070a-kube-api-access-nhcrt\") pod \"prometheus-operator-7b7d896497-jpcp9\" (UID: \"18b267e0-3560-449a-a588-66886974070a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-jpcp9" Jul 02 15:27:21.686499 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:21.686474 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:21.766164 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:21.766129 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-jpcp9" Jul 02 15:27:22.815721 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:22.815535 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c988677bc-76gtr"] Jul 02 15:27:22.818611 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:22.818456 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-jpcp9"] Jul 02 15:27:22.854947 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:27:22.854853 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb0dc5d_edd4_4d13_97f2_367a36dab886.slice/crio-0f235e5d321fd4c49cfd59130d60e1ba71a4290d9910b53ca94a89bc11e84ade WatchSource:0}: Error finding container 0f235e5d321fd4c49cfd59130d60e1ba71a4290d9910b53ca94a89bc11e84ade: Status 404 returned error can't find the container with id 0f235e5d321fd4c49cfd59130d60e1ba71a4290d9910b53ca94a89bc11e84ade Jul 02 15:27:22.855520 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:27:22.855356 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18b267e0_3560_449a_a588_66886974070a.slice/crio-9652ed637116f61014697911f9d0b36152519b01ed553fbb7be6078f7d21ac44 WatchSource:0}: Error finding container 9652ed637116f61014697911f9d0b36152519b01ed553fbb7be6078f7d21ac44: Status 404 returned error can't find the container with id 9652ed637116f61014697911f9d0b36152519b01ed553fbb7be6078f7d21ac44 Jul 02 15:27:23.111341 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:23.111304 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nd9r4" event={"ID":"55bdc49f-63bf-41e4-bd85-c8cbdaa114e2","Type":"ContainerStarted","Data":"0b74e4f98fa1de6f440acc15a3699eff28d4dd33904d864e2fb047392fb1ec9e"} Jul 02 15:27:23.111555 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:23.111356 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nd9r4" event={"ID":"55bdc49f-63bf-41e4-bd85-c8cbdaa114e2","Type":"ContainerStarted","Data":"42b3fe0592cb2c19e49297a19bf34f3c8cb3d5f5172fa24199137293222d5b91"} Jul 02 15:27:23.111555 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:23.111453 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nd9r4" Jul 02 15:27:23.112922 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:23.112886 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-krdd9" event={"ID":"0de4f1e9-d2ea-443f-b4f2-27c40d5a889c","Type":"ContainerStarted","Data":"bbfefafdfbc36575e99cd179276c42a0253759672ab409e833d9b08870dc2f51"} Jul 02 15:27:23.117700 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:23.114718 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c988677bc-76gtr" event={"ID":"abb0dc5d-edd4-4d13-97f2-367a36dab886","Type":"ContainerStarted","Data":"0f235e5d321fd4c49cfd59130d60e1ba71a4290d9910b53ca94a89bc11e84ade"} Jul 02 15:27:23.118164 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:23.118135 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2w56m" event={"ID":"329a2f36-230c-4b1e-a91b-edad15b028ca","Type":"ContainerStarted","Data":"727334d9eba51003736da3e874602c5011d1b2c6e94c05350ca7d457286335eb"} Jul 02 15:27:23.119360 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:23.119340 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-jpcp9" event={"ID":"18b267e0-3560-449a-a588-66886974070a","Type":"ContainerStarted","Data":"9652ed637116f61014697911f9d0b36152519b01ed553fbb7be6078f7d21ac44"} Jul 02 15:27:23.130070 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:23.130029 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nd9r4" podStartSLOduration=1.295747015 podStartE2EDuration="7.130016023s" totalImagesPullingTime="5.834269008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:27:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:23.129485918 +0000 UTC m=+54.759446788" watchObservedRunningTime="2026-07-02 15:27:23.130016023 +0000 UTC m=+54.759976851" Jul 02 15:27:23.143606 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:23.143565 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2w56m" podStartSLOduration=1.26996567 podStartE2EDuration="7.14355376s" totalImagesPullingTime="5.87358809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:27:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:23.143034309 +0000 UTC m=+54.772995173" watchObservedRunningTime="2026-07-02 15:27:23.14355376 +0000 UTC m=+54.773514611" Jul 02 15:27:24.127824 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:24.127783 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-krdd9" event={"ID":"0de4f1e9-d2ea-443f-b4f2-27c40d5a889c","Type":"ContainerStarted","Data":"fee450ed48e7e741ba7fbdb2f1a2b3fdc2112c01abfb827d2f9f42a0f7d9100c"} Jul 02 15:27:24.986049 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:24.986002 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:25.044022 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:25.043989 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:27.572557 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:27.572521 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:27.672371 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:27.672344 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:27.784414 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:27.784347 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:27.885461 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:27.885431 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:28.141636 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:28.141534 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-jpcp9" event={"ID":"18b267e0-3560-449a-a588-66886974070a","Type":"ContainerStarted","Data":"76404ee6638b8c9833b45ed2c5db35fc2bdd6d8b4168d440157f94153b1207f8"} Jul 02 15:27:28.141636 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:28.141622 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-jpcp9" event={"ID":"18b267e0-3560-449a-a588-66886974070a","Type":"ContainerStarted","Data":"bcc335b158e4f8582fc1126d500e36bfc2807f57309608e69dbf155c89c20f47"} Jul 02 15:27:28.143495 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:28.143470 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-krdd9" event={"ID":"0de4f1e9-d2ea-443f-b4f2-27c40d5a889c","Type":"ContainerStarted","Data":"0a3f2f58aa78d623da9f9dc80a5d0039c31f1f9435c360dbbcd839f925e14def"} Jul 02 15:27:28.145002 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:28.144977 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c988677bc-76gtr" event={"ID":"abb0dc5d-edd4-4d13-97f2-367a36dab886","Type":"ContainerStarted","Data":"fcfe457c5efc8e2d940390090e56f30965bb260ec883fa6ce156dd3ce2bc8eab"} Jul 02 15:27:28.159141 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:28.159100 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7b7d896497-jpcp9" podStartSLOduration=2.518425425 podStartE2EDuration="7.159086612s" totalImagesPullingTime="4.640661187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:28.159047947 +0000 UTC m=+59.789008817" watchObservedRunningTime="2026-07-02 15:27:28.159086612 +0000 UTC m=+59.789047457" Jul 02 15:27:28.180180 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:28.180142 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-krdd9" podStartSLOduration=1.7472249 podStartE2EDuration="12.180129539s" totalImagesPullingTime="10.432904639s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:27:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:28.179810611 +0000 UTC m=+59.809771475" watchObservedRunningTime="2026-07-02 15:27:28.180129539 +0000 UTC m=+59.810090387" Jul 02 15:27:28.196329 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:28.196293 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c988677bc-76gtr" podStartSLOduration=4.555602467 podStartE2EDuration="9.196280852s" totalImagesPullingTime="4.640678385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:27:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:28.195652305 +0000 UTC m=+59.825613157" watchObservedRunningTime="2026-07-02 15:27:28.196280852 +0000 UTC m=+59.826241703" Jul 02 15:27:29.563320 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:29.563289 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:29.666510 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:29.666484 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:29.787704 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:29.787676 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:29.849250 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:29.849174 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cz2gr"] Jul 02 15:27:29.851980 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:29.851960 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:29.854050 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:29.854026 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 15:27:29.854161 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:29.854030 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 15:27:29.854161 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:29.854101 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7gr7j\"" Jul 02 15:27:29.854161 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:29.854110 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 15:27:29.925908 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:29.925867 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3611668d-85c3-483b-9761-e807dc98ea75-sys\") pod \"node-exporter-cz2gr\" (UID: \"3611668d-85c3-483b-9761-e807dc98ea75\") " pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:29.926051 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:29.925922 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3611668d-85c3-483b-9761-e807dc98ea75-node-exporter-wtmp\") pod \"node-exporter-cz2gr\" (UID: \"3611668d-85c3-483b-9761-e807dc98ea75\") " pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:29.926051 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:29.925994 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3611668d-85c3-483b-9761-e807dc98ea75-node-exporter-accelerators-collector-config\") pod \"node-exporter-cz2gr\" (UID: \"3611668d-85c3-483b-9761-e807dc98ea75\") " pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:29.926051 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:29.926035 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3611668d-85c3-483b-9761-e807dc98ea75-root\") pod \"node-exporter-cz2gr\" (UID: \"3611668d-85c3-483b-9761-e807dc98ea75\") " pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:29.926160 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:29.926054 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67vn8\" (UniqueName: \"kubernetes.io/projected/3611668d-85c3-483b-9761-e807dc98ea75-kube-api-access-67vn8\") pod \"node-exporter-cz2gr\" (UID: \"3611668d-85c3-483b-9761-e807dc98ea75\") " pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:29.926160 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:29.926121 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3611668d-85c3-483b-9761-e807dc98ea75-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cz2gr\" (UID: \"3611668d-85c3-483b-9761-e807dc98ea75\") " pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:29.926160 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:29.926143 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3611668d-85c3-483b-9761-e807dc98ea75-node-exporter-tls\") pod \"node-exporter-cz2gr\" (UID: \"3611668d-85c3-483b-9761-e807dc98ea75\") " pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:29.926251 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:29.926170 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3611668d-85c3-483b-9761-e807dc98ea75-node-exporter-textfile\") pod \"node-exporter-cz2gr\" (UID: \"3611668d-85c3-483b-9761-e807dc98ea75\") " pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:29.926251 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:29.926190 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3611668d-85c3-483b-9761-e807dc98ea75-metrics-client-ca\") pod \"node-exporter-cz2gr\" (UID: \"3611668d-85c3-483b-9761-e807dc98ea75\") " pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:30.027389 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.027337 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3611668d-85c3-483b-9761-e807dc98ea75-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cz2gr\" (UID: \"3611668d-85c3-483b-9761-e807dc98ea75\") " pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:30.027581 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.027395 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3611668d-85c3-483b-9761-e807dc98ea75-node-exporter-tls\") pod \"node-exporter-cz2gr\" (UID: \"3611668d-85c3-483b-9761-e807dc98ea75\") " pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:30.027581 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.027440 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3611668d-85c3-483b-9761-e807dc98ea75-node-exporter-textfile\") pod \"node-exporter-cz2gr\" (UID: \"3611668d-85c3-483b-9761-e807dc98ea75\") " pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:30.027581 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.027465 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3611668d-85c3-483b-9761-e807dc98ea75-metrics-client-ca\") pod \"node-exporter-cz2gr\" (UID: \"3611668d-85c3-483b-9761-e807dc98ea75\") " pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:30.027581 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.027538 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3611668d-85c3-483b-9761-e807dc98ea75-sys\") pod \"node-exporter-cz2gr\" (UID: \"3611668d-85c3-483b-9761-e807dc98ea75\") " pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:30.027581 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:30.027551 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 02 15:27:30.027581 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.027565 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3611668d-85c3-483b-9761-e807dc98ea75-node-exporter-wtmp\") pod \"node-exporter-cz2gr\" (UID: \"3611668d-85c3-483b-9761-e807dc98ea75\") " pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:30.027913 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:30.027632 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3611668d-85c3-483b-9761-e807dc98ea75-node-exporter-tls podName:3611668d-85c3-483b-9761-e807dc98ea75 nodeName:}" failed. No retries permitted until 2026-07-02 15:27:30.52760911 +0000 UTC m=+62.157569956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3611668d-85c3-483b-9761-e807dc98ea75-node-exporter-tls") pod "node-exporter-cz2gr" (UID: "3611668d-85c3-483b-9761-e807dc98ea75") : secret "node-exporter-tls" not found Jul 02 15:27:30.027913 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.027657 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3611668d-85c3-483b-9761-e807dc98ea75-node-exporter-accelerators-collector-config\") pod \"node-exporter-cz2gr\" (UID: \"3611668d-85c3-483b-9761-e807dc98ea75\") " pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:30.027913 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.027692 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3611668d-85c3-483b-9761-e807dc98ea75-root\") pod \"node-exporter-cz2gr\" (UID: \"3611668d-85c3-483b-9761-e807dc98ea75\") " pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:30.027913 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.027716 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67vn8\" (UniqueName: \"kubernetes.io/projected/3611668d-85c3-483b-9761-e807dc98ea75-kube-api-access-67vn8\") pod \"node-exporter-cz2gr\" (UID: \"3611668d-85c3-483b-9761-e807dc98ea75\") " pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:30.027913 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.027732 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3611668d-85c3-483b-9761-e807dc98ea75-node-exporter-wtmp\") pod \"node-exporter-cz2gr\" (UID: \"3611668d-85c3-483b-9761-e807dc98ea75\") " pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:30.027913 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.027849 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3611668d-85c3-483b-9761-e807dc98ea75-sys\") pod \"node-exporter-cz2gr\" (UID: \"3611668d-85c3-483b-9761-e807dc98ea75\") " pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:30.027913 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.027861 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3611668d-85c3-483b-9761-e807dc98ea75-node-exporter-textfile\") pod \"node-exporter-cz2gr\" (UID: \"3611668d-85c3-483b-9761-e807dc98ea75\") " pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:30.028277 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.028018 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3611668d-85c3-483b-9761-e807dc98ea75-root\") pod \"node-exporter-cz2gr\" (UID: \"3611668d-85c3-483b-9761-e807dc98ea75\") " pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:30.028367 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.028349 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3611668d-85c3-483b-9761-e807dc98ea75-metrics-client-ca\") pod \"node-exporter-cz2gr\" (UID: \"3611668d-85c3-483b-9761-e807dc98ea75\") " pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:30.028424 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.028376 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3611668d-85c3-483b-9761-e807dc98ea75-node-exporter-accelerators-collector-config\") pod \"node-exporter-cz2gr\" (UID: \"3611668d-85c3-483b-9761-e807dc98ea75\") " pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:30.031134 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.031103 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3611668d-85c3-483b-9761-e807dc98ea75-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cz2gr\" (UID: \"3611668d-85c3-483b-9761-e807dc98ea75\") " pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:30.035750 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.035725 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67vn8\" (UniqueName: \"kubernetes.io/projected/3611668d-85c3-483b-9761-e807dc98ea75-kube-api-access-67vn8\") pod \"node-exporter-cz2gr\" (UID: \"3611668d-85c3-483b-9761-e807dc98ea75\") " pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:30.048185 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.048164 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2pztp" Jul 02 15:27:30.136963 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.136929 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c988677bc-76gtr" Jul 02 15:27:30.137116 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.137001 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c988677bc-76gtr" Jul 02 15:27:30.138314 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.138289 2578 patch_prober.go:28] interesting pod/console-6c988677bc-76gtr container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.9:8443/health\": dial tcp 10.133.0.9:8443: connect: connection refused" start-of-body= Jul 02 15:27:30.138430 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.138339 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6c988677bc-76gtr" podUID="abb0dc5d-edd4-4d13-97f2-367a36dab886" containerName="console" probeResult="failure" output="Get \"https://10.133.0.9:8443/health\": dial tcp 10.133.0.9:8443: connect: connection refused" Jul 02 15:27:30.201968 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.201934 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:30.282254 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.282224 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:30.366819 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.366788 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:30.532457 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.532332 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3611668d-85c3-483b-9761-e807dc98ea75-node-exporter-tls\") pod \"node-exporter-cz2gr\" (UID: \"3611668d-85c3-483b-9761-e807dc98ea75\") " pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:30.534613 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.534589 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3611668d-85c3-483b-9761-e807dc98ea75-node-exporter-tls\") pod \"node-exporter-cz2gr\" (UID: \"3611668d-85c3-483b-9761-e807dc98ea75\") " pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:30.536613 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.536585 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:30.632800 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.632766 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:30.734003 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.733972 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:30.760571 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.760547 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cz2gr" Jul 02 15:27:30.769974 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:27:30.769947 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3611668d_85c3_483b_9761_e807dc98ea75.slice/crio-de0cc46dac1df6e9a4bbc1fd5213482766963afd460b979e695b389c0c913aee WatchSource:0}: Error finding container de0cc46dac1df6e9a4bbc1fd5213482766963afd460b979e695b389c0c913aee: Status 404 returned error can't find the container with id de0cc46dac1df6e9a4bbc1fd5213482766963afd460b979e695b389c0c913aee Jul 02 15:27:30.833720 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.833652 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:30.931217 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:30.931182 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:31.047259 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:31.047228 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:31.148652 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:31.148622 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:31.156014 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:31.155989 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cz2gr" event={"ID":"3611668d-85c3-483b-9761-e807dc98ea75","Type":"ContainerStarted","Data":"de0cc46dac1df6e9a4bbc1fd5213482766963afd460b979e695b389c0c913aee"} Jul 02 15:27:32.160734 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:32.160645 2578 generic.go:356] "Generic (PLEG): container finished" podID="3611668d-85c3-483b-9761-e807dc98ea75" containerID="2476352bc167ed0ed2327a2aa32bc63cd1839b5eb72d4cfe7a440dd1ecac78c9" exitCode=0 Jul 02 15:27:32.160734 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:32.160722 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cz2gr" event={"ID":"3611668d-85c3-483b-9761-e807dc98ea75","Type":"ContainerDied","Data":"2476352bc167ed0ed2327a2aa32bc63cd1839b5eb72d4cfe7a440dd1ecac78c9"} Jul 02 15:27:32.836807 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:32.836769 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:32.905132 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:32.905099 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:32.908901 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:32.908868 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6b44dfcfc4-hljql"] Jul 02 15:27:32.911321 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:32.911307 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" Jul 02 15:27:32.913151 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:32.913132 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 02 15:27:32.913151 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:32.913145 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 02 15:27:32.913335 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:32.913146 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7pgkg\"" Jul 02 15:27:32.913335 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:32.913214 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 02 15:27:32.913491 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:32.913467 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 02 15:27:32.913642 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:32.913471 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 02 15:27:32.913754 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:32.913737 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-av8q4d09aaur4\"" Jul 02 15:27:32.924348 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:32.924327 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b44dfcfc4-hljql"] Jul 02 15:27:32.952610 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:32.952588 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a7251074-9516-49dd-9772-d4167678dac9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b44dfcfc4-hljql\" (UID: \"a7251074-9516-49dd-9772-d4167678dac9\") " pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" Jul 02 15:27:32.952722 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:32.952617 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a7251074-9516-49dd-9772-d4167678dac9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b44dfcfc4-hljql\" (UID: \"a7251074-9516-49dd-9772-d4167678dac9\") " pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" Jul 02 15:27:32.952722 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:32.952650 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7251074-9516-49dd-9772-d4167678dac9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b44dfcfc4-hljql\" (UID: \"a7251074-9516-49dd-9772-d4167678dac9\") " pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" Jul 02 15:27:32.952722 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:32.952674 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7251074-9516-49dd-9772-d4167678dac9-secret-grpc-tls\") pod \"thanos-querier-6b44dfcfc4-hljql\" (UID: \"a7251074-9516-49dd-9772-d4167678dac9\") " pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" Jul 02 15:27:32.952827 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:32.952715 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a7251074-9516-49dd-9772-d4167678dac9-secret-thanos-querier-tls\") pod \"thanos-querier-6b44dfcfc4-hljql\" (UID: \"a7251074-9516-49dd-9772-d4167678dac9\") " pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" Jul 02 15:27:32.952827 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:32.952755 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl5zb\" (UniqueName: \"kubernetes.io/projected/a7251074-9516-49dd-9772-d4167678dac9-kube-api-access-vl5zb\") pod \"thanos-querier-6b44dfcfc4-hljql\" (UID: \"a7251074-9516-49dd-9772-d4167678dac9\") " pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" Jul 02 15:27:32.952827 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:32.952781 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7251074-9516-49dd-9772-d4167678dac9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b44dfcfc4-hljql\" (UID: \"a7251074-9516-49dd-9772-d4167678dac9\") " pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" Jul 02 15:27:32.952935 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:32.952828 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7251074-9516-49dd-9772-d4167678dac9-metrics-client-ca\") pod \"thanos-querier-6b44dfcfc4-hljql\" (UID: \"a7251074-9516-49dd-9772-d4167678dac9\") " pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" Jul 02 15:27:32.989078 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:32.989056 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:33.053286 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:33.053256 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a7251074-9516-49dd-9772-d4167678dac9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b44dfcfc4-hljql\" (UID: \"a7251074-9516-49dd-9772-d4167678dac9\") " pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" Jul 02 15:27:33.053286 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:33.053287 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a7251074-9516-49dd-9772-d4167678dac9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b44dfcfc4-hljql\" (UID: \"a7251074-9516-49dd-9772-d4167678dac9\") " pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" Jul 02 15:27:33.053482 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:33.053322 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7251074-9516-49dd-9772-d4167678dac9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b44dfcfc4-hljql\" (UID: \"a7251074-9516-49dd-9772-d4167678dac9\") " pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" Jul 02 15:27:33.053482 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:33.053340 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7251074-9516-49dd-9772-d4167678dac9-secret-grpc-tls\") pod \"thanos-querier-6b44dfcfc4-hljql\" (UID: \"a7251074-9516-49dd-9772-d4167678dac9\") " pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" Jul 02 15:27:33.053482 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:33.053359 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a7251074-9516-49dd-9772-d4167678dac9-secret-thanos-querier-tls\") pod \"thanos-querier-6b44dfcfc4-hljql\" (UID: \"a7251074-9516-49dd-9772-d4167678dac9\") " pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" Jul 02 15:27:33.053482 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:33.053433 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl5zb\" (UniqueName: \"kubernetes.io/projected/a7251074-9516-49dd-9772-d4167678dac9-kube-api-access-vl5zb\") pod \"thanos-querier-6b44dfcfc4-hljql\" (UID: \"a7251074-9516-49dd-9772-d4167678dac9\") " pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" Jul 02 15:27:33.053482 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:33.053465 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7251074-9516-49dd-9772-d4167678dac9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b44dfcfc4-hljql\" (UID: \"a7251074-9516-49dd-9772-d4167678dac9\") " pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" Jul 02 15:27:33.053701 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:33.053493 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7251074-9516-49dd-9772-d4167678dac9-metrics-client-ca\") pod \"thanos-querier-6b44dfcfc4-hljql\" (UID: \"a7251074-9516-49dd-9772-d4167678dac9\") " pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" Jul 02 15:27:33.054350 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:33.054292 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7251074-9516-49dd-9772-d4167678dac9-metrics-client-ca\") pod \"thanos-querier-6b44dfcfc4-hljql\" (UID: \"a7251074-9516-49dd-9772-d4167678dac9\") " pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" Jul 02 15:27:33.056107 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:33.056087 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a7251074-9516-49dd-9772-d4167678dac9-secret-thanos-querier-tls\") pod \"thanos-querier-6b44dfcfc4-hljql\" (UID: \"a7251074-9516-49dd-9772-d4167678dac9\") " pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" Jul 02 15:27:33.056365 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:33.056346 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7251074-9516-49dd-9772-d4167678dac9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b44dfcfc4-hljql\" (UID: \"a7251074-9516-49dd-9772-d4167678dac9\") " pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" Jul 02 15:27:33.056431 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:33.056412 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a7251074-9516-49dd-9772-d4167678dac9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b44dfcfc4-hljql\" (UID: \"a7251074-9516-49dd-9772-d4167678dac9\") " pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" Jul 02 15:27:33.056431 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:33.056425 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7251074-9516-49dd-9772-d4167678dac9-secret-grpc-tls\") pod \"thanos-querier-6b44dfcfc4-hljql\" (UID: \"a7251074-9516-49dd-9772-d4167678dac9\") " pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" Jul 02 15:27:33.056530 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:33.056509 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a7251074-9516-49dd-9772-d4167678dac9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b44dfcfc4-hljql\" (UID: \"a7251074-9516-49dd-9772-d4167678dac9\") " pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" Jul 02 15:27:33.056571 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:33.056509 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7251074-9516-49dd-9772-d4167678dac9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b44dfcfc4-hljql\" (UID: \"a7251074-9516-49dd-9772-d4167678dac9\") " pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" Jul 02 15:27:33.061505 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:33.061487 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl5zb\" (UniqueName: \"kubernetes.io/projected/a7251074-9516-49dd-9772-d4167678dac9-kube-api-access-vl5zb\") pod \"thanos-querier-6b44dfcfc4-hljql\" (UID: \"a7251074-9516-49dd-9772-d4167678dac9\") " pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" Jul 02 15:27:33.094263 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:33.094197 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:33.130465 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:33.130446 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nd9r4" Jul 02 15:27:33.167004 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:33.166972 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cz2gr" event={"ID":"3611668d-85c3-483b-9761-e807dc98ea75","Type":"ContainerStarted","Data":"1bdd7370a1767e07cfa4604702a52dc29679934095237e29484df0f046e4d70e"} Jul 02 15:27:33.167372 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:33.167026 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cz2gr" event={"ID":"3611668d-85c3-483b-9761-e807dc98ea75","Type":"ContainerStarted","Data":"64221eb8d6f537b0f9f5a9f066db315aefa5221b4cea8d26b013a382d1a3bf98"} Jul 02 15:27:33.190301 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:33.190246 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cz2gr" podStartSLOduration=2.996633019 podStartE2EDuration="4.190223842s" totalImagesPullingTime="1.129992304s" totalInitContainerRuntime="63.598519ms" isStatefulPod=true podCreationTimestamp="2026-07-02 15:27:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:33.188842604 +0000 UTC m=+64.818803474" watchObservedRunningTime="2026-07-02 15:27:33.190223842 +0000 UTC m=+64.820184696" Jul 02 15:27:33.194954 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:33.194927 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:33.220605 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:33.220577 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" Jul 02 15:27:33.347766 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:33.347683 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b44dfcfc4-hljql"] Jul 02 15:27:33.351686 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:27:33.351649 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7251074_9516_49dd_9772_d4167678dac9.slice/crio-84c8e14b64fdf0c219d2b2894552efc8f8524e135fa0faf1bb7e6d383abd6341 WatchSource:0}: Error finding container 84c8e14b64fdf0c219d2b2894552efc8f8524e135fa0faf1bb7e6d383abd6341: Status 404 returned error can't find the container with id 84c8e14b64fdf0c219d2b2894552efc8f8524e135fa0faf1bb7e6d383abd6341 Jul 02 15:27:34.171818 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.171783 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" event={"ID":"a7251074-9516-49dd-9772-d4167678dac9","Type":"ContainerStarted","Data":"84c8e14b64fdf0c219d2b2894552efc8f8524e135fa0faf1bb7e6d383abd6341"} Jul 02 15:27:34.566715 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.566631 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be11a647-3b83-4a29-8f80-29cab689e649-metrics-certs\") pod \"network-metrics-daemon-jm5ld\" (UID: \"be11a647-3b83-4a29-8f80-29cab689e649\") " pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:27:34.566715 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.566677 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw5wd\" (UniqueName: \"kubernetes.io/projected/f85b2e6b-f8cc-4efd-87d3-6d85423e64a4-kube-api-access-hw5wd\") pod \"network-check-target-w528n\" (UID: \"f85b2e6b-f8cc-4efd-87d3-6d85423e64a4\") " pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:27:34.566944 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.566728 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac822a5a-c97b-4159-ac19-0000a2b4abfb-original-pull-secret\") pod \"global-pull-secret-syncer-7z5mp\" (UID: \"ac822a5a-c97b-4159-ac19-0000a2b4abfb\") " pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:27:34.568674 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.568654 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 15:27:34.569102 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.569088 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 15:27:34.569188 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.569093 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 15:27:34.579482 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.579440 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 15:27:34.579933 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.579910 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac822a5a-c97b-4159-ac19-0000a2b4abfb-original-pull-secret\") pod \"global-pull-secret-syncer-7z5mp\" (UID: \"ac822a5a-c97b-4159-ac19-0000a2b4abfb\") " pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:27:34.580014 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.579920 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be11a647-3b83-4a29-8f80-29cab689e649-metrics-certs\") pod \"network-metrics-daemon-jm5ld\" (UID: \"be11a647-3b83-4a29-8f80-29cab689e649\") " pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:27:34.589979 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.589959 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw5wd\" (UniqueName: \"kubernetes.io/projected/f85b2e6b-f8cc-4efd-87d3-6d85423e64a4-kube-api-access-hw5wd\") pod \"network-check-target-w528n\" (UID: \"f85b2e6b-f8cc-4efd-87d3-6d85423e64a4\") " pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:27:34.600291 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.600267 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-wk52z"] Jul 02 15:27:34.605118 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.605085 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:34.615003 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.614982 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-wk52z"] Jul 02 15:27:34.615103 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.615016 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c988677bc-76gtr"] Jul 02 15:27:34.615151 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.615105 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-wk52z" Jul 02 15:27:34.617128 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.617105 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 02 15:27:34.617228 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.617154 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-9ktgb\"" Jul 02 15:27:34.632724 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.632703 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pj7tx\"" Jul 02 15:27:34.641025 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.640997 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ffxgv\"" Jul 02 15:27:34.641025 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.641010 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:27:34.646580 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.646559 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7z5mp" Jul 02 15:27:34.647244 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.647226 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66864f79cc-9mbt5"] Jul 02 15:27:34.651624 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.651567 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm5ld" Jul 02 15:27:34.668033 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.668006 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nmlz\" (UniqueName: \"kubernetes.io/projected/f326861e-c941-4521-b3b8-9372a68c5d25-kube-api-access-4nmlz\") pod \"monitoring-plugin-cd8656b8-wk52z\" (UID: \"f326861e-c941-4521-b3b8-9372a68c5d25\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-wk52z" Jul 02 15:27:34.668150 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.668049 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f326861e-c941-4521-b3b8-9372a68c5d25-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-wk52z\" (UID: \"f326861e-c941-4521-b3b8-9372a68c5d25\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-wk52z" Jul 02 15:27:34.669362 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.669337 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66864f79cc-9mbt5"] Jul 02 15:27:34.669475 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.669450 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66864f79cc-9mbt5" Jul 02 15:27:34.690828 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.690796 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:34.769245 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.769174 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8bacea09-c51d-428e-aa19-03ca773f6bc8-service-ca\") pod \"console-66864f79cc-9mbt5\" (UID: \"8bacea09-c51d-428e-aa19-03ca773f6bc8\") " pod="openshift-console/console-66864f79cc-9mbt5" Jul 02 15:27:34.769403 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.769254 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8bacea09-c51d-428e-aa19-03ca773f6bc8-console-serving-cert\") pod \"console-66864f79cc-9mbt5\" (UID: \"8bacea09-c51d-428e-aa19-03ca773f6bc8\") " pod="openshift-console/console-66864f79cc-9mbt5" Jul 02 15:27:34.769403 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.769291 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjjxl\" (UniqueName: \"kubernetes.io/projected/8bacea09-c51d-428e-aa19-03ca773f6bc8-kube-api-access-fjjxl\") pod \"console-66864f79cc-9mbt5\" (UID: \"8bacea09-c51d-428e-aa19-03ca773f6bc8\") " pod="openshift-console/console-66864f79cc-9mbt5" Jul 02 15:27:34.769403 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.769326 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nmlz\" (UniqueName: \"kubernetes.io/projected/f326861e-c941-4521-b3b8-9372a68c5d25-kube-api-access-4nmlz\") pod \"monitoring-plugin-cd8656b8-wk52z\" (UID: \"f326861e-c941-4521-b3b8-9372a68c5d25\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-wk52z" Jul 02 15:27:34.769403 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.769352 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f326861e-c941-4521-b3b8-9372a68c5d25-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-wk52z\" (UID: \"f326861e-c941-4521-b3b8-9372a68c5d25\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-wk52z" Jul 02 15:27:34.769403 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.769375 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8bacea09-c51d-428e-aa19-03ca773f6bc8-console-config\") pod \"console-66864f79cc-9mbt5\" (UID: \"8bacea09-c51d-428e-aa19-03ca773f6bc8\") " pod="openshift-console/console-66864f79cc-9mbt5" Jul 02 15:27:34.769638 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.769412 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8bacea09-c51d-428e-aa19-03ca773f6bc8-console-oauth-config\") pod \"console-66864f79cc-9mbt5\" (UID: \"8bacea09-c51d-428e-aa19-03ca773f6bc8\") " pod="openshift-console/console-66864f79cc-9mbt5" Jul 02 15:27:34.769638 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.769440 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bacea09-c51d-428e-aa19-03ca773f6bc8-trusted-ca-bundle\") pod \"console-66864f79cc-9mbt5\" (UID: \"8bacea09-c51d-428e-aa19-03ca773f6bc8\") " pod="openshift-console/console-66864f79cc-9mbt5" Jul 02 15:27:34.769638 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.769475 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8bacea09-c51d-428e-aa19-03ca773f6bc8-oauth-serving-cert\") pod \"console-66864f79cc-9mbt5\" (UID: \"8bacea09-c51d-428e-aa19-03ca773f6bc8\") " pod="openshift-console/console-66864f79cc-9mbt5" Jul 02 15:27:34.770003 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:34.769980 2578 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 02 15:27:34.770119 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:27:34.770059 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f326861e-c941-4521-b3b8-9372a68c5d25-monitoring-plugin-cert podName:f326861e-c941-4521-b3b8-9372a68c5d25 nodeName:}" failed. No retries permitted until 2026-07-02 15:27:35.270034261 +0000 UTC m=+66.899995108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/f326861e-c941-4521-b3b8-9372a68c5d25-monitoring-plugin-cert") pod "monitoring-plugin-cd8656b8-wk52z" (UID: "f326861e-c941-4521-b3b8-9372a68c5d25") : secret "monitoring-plugin-cert" not found Jul 02 15:27:34.780163 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.780133 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nmlz\" (UniqueName: \"kubernetes.io/projected/f326861e-c941-4521-b3b8-9372a68c5d25-kube-api-access-4nmlz\") pod \"monitoring-plugin-cd8656b8-wk52z\" (UID: \"f326861e-c941-4521-b3b8-9372a68c5d25\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-wk52z" Jul 02 15:27:34.831198 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.831116 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w528n"] Jul 02 15:27:34.835382 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:27:34.835352 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf85b2e6b_f8cc_4efd_87d3_6d85423e64a4.slice/crio-dfa530d4f11bf840b519b7c47f59131d71b4acc41170815c6f5dcc6b96951d0a WatchSource:0}: Error finding container dfa530d4f11bf840b519b7c47f59131d71b4acc41170815c6f5dcc6b96951d0a: Status 404 returned error can't find the container with id dfa530d4f11bf840b519b7c47f59131d71b4acc41170815c6f5dcc6b96951d0a Jul 02 15:27:34.851054 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.851024 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7z5mp"] Jul 02 15:27:34.855191 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:27:34.855165 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac822a5a_c97b_4159_ac19_0000a2b4abfb.slice/crio-d32d2285c5e9d3e510f39014b84899e12ba744614c6eda20bddda531f0ff680d WatchSource:0}: Error finding container d32d2285c5e9d3e510f39014b84899e12ba744614c6eda20bddda531f0ff680d: Status 404 returned error can't find the container with id d32d2285c5e9d3e510f39014b84899e12ba744614c6eda20bddda531f0ff680d Jul 02 15:27:34.870207 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.870181 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjjxl\" (UniqueName: \"kubernetes.io/projected/8bacea09-c51d-428e-aa19-03ca773f6bc8-kube-api-access-fjjxl\") pod \"console-66864f79cc-9mbt5\" (UID: \"8bacea09-c51d-428e-aa19-03ca773f6bc8\") " pod="openshift-console/console-66864f79cc-9mbt5" Jul 02 15:27:34.870278 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.870241 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8bacea09-c51d-428e-aa19-03ca773f6bc8-console-config\") pod \"console-66864f79cc-9mbt5\" (UID: \"8bacea09-c51d-428e-aa19-03ca773f6bc8\") " pod="openshift-console/console-66864f79cc-9mbt5" Jul 02 15:27:34.870321 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.870279 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8bacea09-c51d-428e-aa19-03ca773f6bc8-console-oauth-config\") pod \"console-66864f79cc-9mbt5\" (UID: \"8bacea09-c51d-428e-aa19-03ca773f6bc8\") " pod="openshift-console/console-66864f79cc-9mbt5" Jul 02 15:27:34.870321 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.870306 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bacea09-c51d-428e-aa19-03ca773f6bc8-trusted-ca-bundle\") pod \"console-66864f79cc-9mbt5\" (UID: \"8bacea09-c51d-428e-aa19-03ca773f6bc8\") " pod="openshift-console/console-66864f79cc-9mbt5" Jul 02 15:27:34.870509 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.870453 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8bacea09-c51d-428e-aa19-03ca773f6bc8-oauth-serving-cert\") pod \"console-66864f79cc-9mbt5\" (UID: \"8bacea09-c51d-428e-aa19-03ca773f6bc8\") " pod="openshift-console/console-66864f79cc-9mbt5" Jul 02 15:27:34.870588 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.870541 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8bacea09-c51d-428e-aa19-03ca773f6bc8-service-ca\") pod \"console-66864f79cc-9mbt5\" (UID: \"8bacea09-c51d-428e-aa19-03ca773f6bc8\") " pod="openshift-console/console-66864f79cc-9mbt5" Jul 02 15:27:34.870588 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.870583 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8bacea09-c51d-428e-aa19-03ca773f6bc8-console-serving-cert\") pod \"console-66864f79cc-9mbt5\" (UID: \"8bacea09-c51d-428e-aa19-03ca773f6bc8\") " pod="openshift-console/console-66864f79cc-9mbt5" Jul 02 15:27:34.871109 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.871076 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8bacea09-c51d-428e-aa19-03ca773f6bc8-console-config\") pod \"console-66864f79cc-9mbt5\" (UID: \"8bacea09-c51d-428e-aa19-03ca773f6bc8\") " pod="openshift-console/console-66864f79cc-9mbt5" Jul 02 15:27:34.871248 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.871225 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8bacea09-c51d-428e-aa19-03ca773f6bc8-oauth-serving-cert\") pod \"console-66864f79cc-9mbt5\" (UID: \"8bacea09-c51d-428e-aa19-03ca773f6bc8\") " pod="openshift-console/console-66864f79cc-9mbt5" Jul 02 15:27:34.871288 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.871269 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8bacea09-c51d-428e-aa19-03ca773f6bc8-service-ca\") pod \"console-66864f79cc-9mbt5\" (UID: \"8bacea09-c51d-428e-aa19-03ca773f6bc8\") " pod="openshift-console/console-66864f79cc-9mbt5" Jul 02 15:27:34.871340 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.871315 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bacea09-c51d-428e-aa19-03ca773f6bc8-trusted-ca-bundle\") pod \"console-66864f79cc-9mbt5\" (UID: \"8bacea09-c51d-428e-aa19-03ca773f6bc8\") " pod="openshift-console/console-66864f79cc-9mbt5" Jul 02 15:27:34.872928 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.872887 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8bacea09-c51d-428e-aa19-03ca773f6bc8-console-serving-cert\") pod \"console-66864f79cc-9mbt5\" (UID: \"8bacea09-c51d-428e-aa19-03ca773f6bc8\") " pod="openshift-console/console-66864f79cc-9mbt5" Jul 02 15:27:34.873030 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.873010 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8bacea09-c51d-428e-aa19-03ca773f6bc8-console-oauth-config\") pod \"console-66864f79cc-9mbt5\" (UID: \"8bacea09-c51d-428e-aa19-03ca773f6bc8\") " pod="openshift-console/console-66864f79cc-9mbt5" Jul 02 15:27:34.874279 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.874257 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jm5ld"] Jul 02 15:27:34.877293 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:27:34.877273 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe11a647_3b83_4a29_8f80_29cab689e649.slice/crio-8eae0667e2d1a036be0e2b4583d66b3f447de4cfded957031df879484f703d5c WatchSource:0}: Error finding container 8eae0667e2d1a036be0e2b4583d66b3f447de4cfded957031df879484f703d5c: Status 404 returned error can't find the container with id 8eae0667e2d1a036be0e2b4583d66b3f447de4cfded957031df879484f703d5c Jul 02 15:27:34.878476 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.878458 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjjxl\" (UniqueName: \"kubernetes.io/projected/8bacea09-c51d-428e-aa19-03ca773f6bc8-kube-api-access-fjjxl\") pod \"console-66864f79cc-9mbt5\" (UID: \"8bacea09-c51d-428e-aa19-03ca773f6bc8\") " pod="openshift-console/console-66864f79cc-9mbt5" Jul 02 15:27:34.932971 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.932936 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:34.993100 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:34.993062 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66864f79cc-9mbt5" Jul 02 15:27:35.046696 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.046670 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-75d49746c4-pg77h"] Jul 02 15:27:35.082306 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.082225 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75d49746c4-pg77h"] Jul 02 15:27:35.082456 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.082360 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" Jul 02 15:27:35.084889 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.084868 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 02 15:27:35.085045 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.085001 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 02 15:27:35.085184 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.085167 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 02 15:27:35.085370 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.085302 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 02 15:27:35.085723 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.085704 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 02 15:27:35.088235 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.087395 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-r9hfz\"" Jul 02 15:27:35.090800 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.090781 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 02 15:27:35.172687 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.172651 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsqg9\" (UniqueName: \"kubernetes.io/projected/3c987e35-1f1d-4a3e-be84-fd9ea022430a-kube-api-access-rsqg9\") pod \"telemeter-client-75d49746c4-pg77h\" (UID: \"3c987e35-1f1d-4a3e-be84-fd9ea022430a\") " pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" Jul 02 15:27:35.173146 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.172700 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c987e35-1f1d-4a3e-be84-fd9ea022430a-serving-certs-ca-bundle\") pod \"telemeter-client-75d49746c4-pg77h\" (UID: \"3c987e35-1f1d-4a3e-be84-fd9ea022430a\") " pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" Jul 02 15:27:35.173146 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.172735 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3c987e35-1f1d-4a3e-be84-fd9ea022430a-federate-client-tls\") pod \"telemeter-client-75d49746c4-pg77h\" (UID: \"3c987e35-1f1d-4a3e-be84-fd9ea022430a\") " pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" Jul 02 15:27:35.173146 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.172801 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c987e35-1f1d-4a3e-be84-fd9ea022430a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75d49746c4-pg77h\" (UID: \"3c987e35-1f1d-4a3e-be84-fd9ea022430a\") " pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" Jul 02 15:27:35.173146 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.172851 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3c987e35-1f1d-4a3e-be84-fd9ea022430a-telemeter-client-tls\") pod \"telemeter-client-75d49746c4-pg77h\" (UID: \"3c987e35-1f1d-4a3e-be84-fd9ea022430a\") " pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" Jul 02 15:27:35.173146 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.172967 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3c987e35-1f1d-4a3e-be84-fd9ea022430a-secret-telemeter-client\") pod \"telemeter-client-75d49746c4-pg77h\" (UID: \"3c987e35-1f1d-4a3e-be84-fd9ea022430a\") " pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" Jul 02 15:27:35.173146 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.173013 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c987e35-1f1d-4a3e-be84-fd9ea022430a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75d49746c4-pg77h\" (UID: \"3c987e35-1f1d-4a3e-be84-fd9ea022430a\") " pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" Jul 02 15:27:35.173146 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.173048 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c987e35-1f1d-4a3e-be84-fd9ea022430a-metrics-client-ca\") pod \"telemeter-client-75d49746c4-pg77h\" (UID: \"3c987e35-1f1d-4a3e-be84-fd9ea022430a\") " pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" Jul 02 15:27:35.177689 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.177637 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w528n" event={"ID":"f85b2e6b-f8cc-4efd-87d3-6d85423e64a4","Type":"ContainerStarted","Data":"dfa530d4f11bf840b519b7c47f59131d71b4acc41170815c6f5dcc6b96951d0a"} Jul 02 15:27:35.179103 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.179078 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jm5ld" event={"ID":"be11a647-3b83-4a29-8f80-29cab689e649","Type":"ContainerStarted","Data":"8eae0667e2d1a036be0e2b4583d66b3f447de4cfded957031df879484f703d5c"} Jul 02 15:27:35.180379 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.180352 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7z5mp" event={"ID":"ac822a5a-c97b-4159-ac19-0000a2b4abfb","Type":"ContainerStarted","Data":"d32d2285c5e9d3e510f39014b84899e12ba744614c6eda20bddda531f0ff680d"} Jul 02 15:27:35.185286 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.185245 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66864f79cc-9mbt5"] Jul 02 15:27:35.188076 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:27:35.188050 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bacea09_c51d_428e_aa19_03ca773f6bc8.slice/crio-c8f92b4be7ea24c28f7061d0c4d0e884e55b34908ff96932ab4708719236d8b7 WatchSource:0}: Error finding container c8f92b4be7ea24c28f7061d0c4d0e884e55b34908ff96932ab4708719236d8b7: Status 404 returned error can't find the container with id c8f92b4be7ea24c28f7061d0c4d0e884e55b34908ff96932ab4708719236d8b7 Jul 02 15:27:35.274252 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.274227 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3c987e35-1f1d-4a3e-be84-fd9ea022430a-telemeter-client-tls\") pod \"telemeter-client-75d49746c4-pg77h\" (UID: \"3c987e35-1f1d-4a3e-be84-fd9ea022430a\") " pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" Jul 02 15:27:35.274351 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.274263 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3c987e35-1f1d-4a3e-be84-fd9ea022430a-secret-telemeter-client\") pod \"telemeter-client-75d49746c4-pg77h\" (UID: \"3c987e35-1f1d-4a3e-be84-fd9ea022430a\") " pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" Jul 02 15:27:35.274351 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.274288 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c987e35-1f1d-4a3e-be84-fd9ea022430a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75d49746c4-pg77h\" (UID: \"3c987e35-1f1d-4a3e-be84-fd9ea022430a\") " pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" Jul 02 15:27:35.274351 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.274317 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c987e35-1f1d-4a3e-be84-fd9ea022430a-metrics-client-ca\") pod \"telemeter-client-75d49746c4-pg77h\" (UID: \"3c987e35-1f1d-4a3e-be84-fd9ea022430a\") " pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" Jul 02 15:27:35.274351 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.274339 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f326861e-c941-4521-b3b8-9372a68c5d25-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-wk52z\" (UID: \"f326861e-c941-4521-b3b8-9372a68c5d25\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-wk52z" Jul 02 15:27:35.274558 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.274372 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsqg9\" (UniqueName: \"kubernetes.io/projected/3c987e35-1f1d-4a3e-be84-fd9ea022430a-kube-api-access-rsqg9\") pod \"telemeter-client-75d49746c4-pg77h\" (UID: \"3c987e35-1f1d-4a3e-be84-fd9ea022430a\") " pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" Jul 02 15:27:35.274558 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.274400 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c987e35-1f1d-4a3e-be84-fd9ea022430a-serving-certs-ca-bundle\") pod \"telemeter-client-75d49746c4-pg77h\" (UID: \"3c987e35-1f1d-4a3e-be84-fd9ea022430a\") " pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" Jul 02 15:27:35.274558 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.274427 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3c987e35-1f1d-4a3e-be84-fd9ea022430a-federate-client-tls\") pod \"telemeter-client-75d49746c4-pg77h\" (UID: \"3c987e35-1f1d-4a3e-be84-fd9ea022430a\") " pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" Jul 02 15:27:35.274558 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.274497 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c987e35-1f1d-4a3e-be84-fd9ea022430a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75d49746c4-pg77h\" (UID: \"3c987e35-1f1d-4a3e-be84-fd9ea022430a\") " pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" Jul 02 15:27:35.275447 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.275338 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c987e35-1f1d-4a3e-be84-fd9ea022430a-metrics-client-ca\") pod \"telemeter-client-75d49746c4-pg77h\" (UID: \"3c987e35-1f1d-4a3e-be84-fd9ea022430a\") " pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" Jul 02 15:27:35.275447 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.275370 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c987e35-1f1d-4a3e-be84-fd9ea022430a-serving-certs-ca-bundle\") pod \"telemeter-client-75d49746c4-pg77h\" (UID: \"3c987e35-1f1d-4a3e-be84-fd9ea022430a\") " pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" Jul 02 15:27:35.276128 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.276102 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c987e35-1f1d-4a3e-be84-fd9ea022430a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75d49746c4-pg77h\" (UID: \"3c987e35-1f1d-4a3e-be84-fd9ea022430a\") " pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" Jul 02 15:27:35.277362 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.277337 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f326861e-c941-4521-b3b8-9372a68c5d25-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-wk52z\" (UID: \"f326861e-c941-4521-b3b8-9372a68c5d25\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-wk52z" Jul 02 15:27:35.277479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.277384 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3c987e35-1f1d-4a3e-be84-fd9ea022430a-federate-client-tls\") pod \"telemeter-client-75d49746c4-pg77h\" (UID: \"3c987e35-1f1d-4a3e-be84-fd9ea022430a\") " pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" Jul 02 15:27:35.277479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.277443 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3c987e35-1f1d-4a3e-be84-fd9ea022430a-secret-telemeter-client\") pod \"telemeter-client-75d49746c4-pg77h\" (UID: \"3c987e35-1f1d-4a3e-be84-fd9ea022430a\") " pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" Jul 02 15:27:35.277479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.277459 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c987e35-1f1d-4a3e-be84-fd9ea022430a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75d49746c4-pg77h\" (UID: \"3c987e35-1f1d-4a3e-be84-fd9ea022430a\") " pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" Jul 02 15:27:35.277909 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.277856 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3c987e35-1f1d-4a3e-be84-fd9ea022430a-telemeter-client-tls\") pod \"telemeter-client-75d49746c4-pg77h\" (UID: \"3c987e35-1f1d-4a3e-be84-fd9ea022430a\") " pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" Jul 02 15:27:35.281729 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.281706 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsqg9\" (UniqueName: \"kubernetes.io/projected/3c987e35-1f1d-4a3e-be84-fd9ea022430a-kube-api-access-rsqg9\") pod \"telemeter-client-75d49746c4-pg77h\" (UID: \"3c987e35-1f1d-4a3e-be84-fd9ea022430a\") " pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" Jul 02 15:27:35.397847 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.397809 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" Jul 02 15:27:35.525545 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.525314 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-wk52z" Jul 02 15:27:35.582340 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.582287 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75d49746c4-pg77h"] Jul 02 15:27:35.738454 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:35.738341 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-wk52z"] Jul 02 15:27:36.153373 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.153319 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:36.159028 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.157200 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:27:36.160575 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.160550 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.163429 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.163146 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 15:27:36.174219 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.165843 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 15:27:36.174219 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.166514 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 15:27:36.174219 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.167404 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 15:27:36.174219 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.167815 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 15:27:36.174219 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.168362 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 15:27:36.174219 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.168666 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 02 15:27:36.174219 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.171385 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 15:27:36.174219 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.171773 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 15:27:36.174219 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.172163 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-x8gnk\"" Jul 02 15:27:36.174219 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.172168 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-acjn5drrsrsjk\"" Jul 02 15:27:36.174219 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.172330 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 15:27:36.175498 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.175368 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 15:27:36.175498 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.175378 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 15:27:36.176353 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.176030 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 15:27:36.177832 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.177670 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 15:27:36.180336 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.180180 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:27:36.184509 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.184258 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 15:27:36.193507 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.192821 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" event={"ID":"3c987e35-1f1d-4a3e-be84-fd9ea022430a","Type":"ContainerStarted","Data":"b6f691d18293179ed392721c6d499026cd7e0a57c440b6427b4b966dc3fa8136"} Jul 02 15:27:36.196447 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.196417 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66864f79cc-9mbt5" event={"ID":"8bacea09-c51d-428e-aa19-03ca773f6bc8","Type":"ContainerStarted","Data":"cb8b28b1d51b06c80ca9843ce11f0ebafcb17555b35ffc94155b83da7e7bbf33"} Jul 02 15:27:36.196551 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.196490 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66864f79cc-9mbt5" event={"ID":"8bacea09-c51d-428e-aa19-03ca773f6bc8","Type":"ContainerStarted","Data":"c8f92b4be7ea24c28f7061d0c4d0e884e55b34908ff96932ab4708719236d8b7"} Jul 02 15:27:36.221157 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.221092 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66864f79cc-9mbt5" podStartSLOduration=2.221068457 podStartE2EDuration="2.221068457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:27:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:36.219502733 +0000 UTC m=+67.849463586" watchObservedRunningTime="2026-07-02 15:27:36.221068457 +0000 UTC m=+67.851029308" Jul 02 15:27:36.228989 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.228955 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:36.290622 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.290581 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-config\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.290813 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.290636 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.290813 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.290685 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.290813 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.290731 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.290813 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.290756 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.290813 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.290787 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.291179 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.290816 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.291179 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.290847 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40192f74-f4c1-4784-83ff-52f8dd633c5a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.291179 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.290876 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.291179 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.290918 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.291179 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.290942 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.291179 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.290978 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.291179 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.291024 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.291179 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.291064 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.291179 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.291092 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.291179 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.291140 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-web-config\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.291664 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.291194 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.291664 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.291226 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.291664 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.291316 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40192f74-f4c1-4784-83ff-52f8dd633c5a-config-out\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.291664 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.291357 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds26c\" (UniqueName: \"kubernetes.io/projected/40192f74-f4c1-4784-83ff-52f8dd633c5a-kube-api-access-ds26c\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.296299 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.296267 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:36.393285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.391961 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40192f74-f4c1-4784-83ff-52f8dd633c5a-config-out\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.393285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.392011 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds26c\" (UniqueName: \"kubernetes.io/projected/40192f74-f4c1-4784-83ff-52f8dd633c5a-kube-api-access-ds26c\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.393285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.392042 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-config\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.393285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.392071 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.393285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.392098 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.393285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.392126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.393285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.392149 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.393285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.392178 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.393285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.392208 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.393285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.392236 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40192f74-f4c1-4784-83ff-52f8dd633c5a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.393285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.392262 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.393285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.392284 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.393285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.392308 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.393285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.392341 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.393285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.392371 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.393285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.392397 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.393285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.392424 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.394258 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.392454 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-web-config\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.394258 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.392484 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.394258 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.392501 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.395541 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.394738 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.395541 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.395054 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.395541 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.395253 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.396551 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.396229 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.397565 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.397538 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.398523 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.398080 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.404219 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.403281 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.404611 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.404565 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.404927 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.404872 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-web-config\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.405017 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.404881 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.405504 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.405478 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds26c\" (UniqueName: \"kubernetes.io/projected/40192f74-f4c1-4784-83ff-52f8dd633c5a-kube-api-access-ds26c\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.406842 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.406779 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.408394 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.407412 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.408394 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.407783 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40192f74-f4c1-4784-83ff-52f8dd633c5a-config-out\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.408394 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.407962 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.408394 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.408140 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40192f74-f4c1-4784-83ff-52f8dd633c5a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.408394 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.408337 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-config\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.409232 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.409191 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.410398 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.410380 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.413422 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.413396 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.485845 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:36.485801 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:36.538181 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:27:36.538146 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf326861e_c941_4521_b3b8_9372a68c5d25.slice/crio-ff1438ed9cf9f76dc60a1e6662567ade6ecb5344b155f60493d1d5bf6d766bcb WatchSource:0}: Error finding container ff1438ed9cf9f76dc60a1e6662567ade6ecb5344b155f60493d1d5bf6d766bcb: Status 404 returned error can't find the container with id ff1438ed9cf9f76dc60a1e6662567ade6ecb5344b155f60493d1d5bf6d766bcb Jul 02 15:27:37.148941 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:37.148312 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:27:37.169844 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:27:37.169777 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40192f74_f4c1_4784_83ff_52f8dd633c5a.slice/crio-e8984dec8a33559bfba91c769b2acaaa51b52fa9fde4d8aefb8a11b412f5dfa4 WatchSource:0}: Error finding container e8984dec8a33559bfba91c769b2acaaa51b52fa9fde4d8aefb8a11b412f5dfa4: Status 404 returned error can't find the container with id e8984dec8a33559bfba91c769b2acaaa51b52fa9fde4d8aefb8a11b412f5dfa4 Jul 02 15:27:37.219360 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:37.219316 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jm5ld" event={"ID":"be11a647-3b83-4a29-8f80-29cab689e649","Type":"ContainerStarted","Data":"c05e38c2304888861c3b78362fa97135f1e83acdcd693c0d798cc7704939e8cd"} Jul 02 15:27:37.221613 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:37.221533 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-wk52z" event={"ID":"f326861e-c941-4521-b3b8-9372a68c5d25","Type":"ContainerStarted","Data":"ff1438ed9cf9f76dc60a1e6662567ade6ecb5344b155f60493d1d5bf6d766bcb"} Jul 02 15:27:37.223538 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:37.223510 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40192f74-f4c1-4784-83ff-52f8dd633c5a","Type":"ContainerStarted","Data":"e8984dec8a33559bfba91c769b2acaaa51b52fa9fde4d8aefb8a11b412f5dfa4"} Jul 02 15:27:37.228760 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:37.228284 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" event={"ID":"a7251074-9516-49dd-9772-d4167678dac9","Type":"ContainerStarted","Data":"9e91e05e60119982231da91f5bb700dc0b7db04e122d1ab3e26e2ceed32d68d4"} Jul 02 15:27:37.228760 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:37.228355 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" event={"ID":"a7251074-9516-49dd-9772-d4167678dac9","Type":"ContainerStarted","Data":"aa78c0f7494a73a0a786b6496b92ac9cffc8ed8b8d5bb8c9f82c1b2cc2a4b8d6"} Jul 02 15:27:37.458378 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:37.458296 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:37.560000 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:37.559889 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:37.658996 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:37.658962 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:37.887642 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:37.887536 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:37.988816 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:37.988735 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:38.115113 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:38.115044 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:38.235381 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:38.235296 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" event={"ID":"a7251074-9516-49dd-9772-d4167678dac9","Type":"ContainerStarted","Data":"0dc1025531bce9b254a06660c543a91b215ae7f2884ba11c896ecb267d15b290"} Jul 02 15:27:38.237545 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:38.237516 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jm5ld" event={"ID":"be11a647-3b83-4a29-8f80-29cab689e649","Type":"ContainerStarted","Data":"33b54e07c651f96662d0a71462d80a8765ba1e698c17983efab76102c2d54d40"} Jul 02 15:27:38.253952 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:38.253877 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jm5ld" podStartSLOduration=67.185247152 podStartE2EDuration="1m9.25385837s" totalImagesPullingTime="2.068611218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:26:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:38.252388708 +0000 UTC m=+69.882349560" watchObservedRunningTime="2026-07-02 15:27:38.25385837 +0000 UTC m=+69.883819242" Jul 02 15:27:38.348870 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:38.348795 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:38.408734 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:38.408692 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:39.204726 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:39.204696 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:39.399579 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:39.399528 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:40.257595 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:40.257561 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:40.331106 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:40.331029 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:42.256826 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:42.256790 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" event={"ID":"3c987e35-1f1d-4a3e-be84-fd9ea022430a","Type":"ContainerStarted","Data":"4ada0ca6eef0b7b9d1148849de287d65fe59c3de2971f773b6e137f59701b3ed"} Jul 02 15:27:42.257274 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:42.256850 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" event={"ID":"3c987e35-1f1d-4a3e-be84-fd9ea022430a","Type":"ContainerStarted","Data":"a326daffbd6f959a3dba81c3387a7bbde233f2df26b2263ff917395b5598ecba"} Jul 02 15:27:42.257274 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:42.256873 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" event={"ID":"3c987e35-1f1d-4a3e-be84-fd9ea022430a","Type":"ContainerStarted","Data":"55d5be83313367e73d509110afd7b5c69ff659cbd27eec99559873eceb8ab450"} Jul 02 15:27:42.258310 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:42.258283 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-wk52z" event={"ID":"f326861e-c941-4521-b3b8-9372a68c5d25","Type":"ContainerStarted","Data":"283f5357cc0f2f17bbcb32dc2ccbbc50b3e38d1df3985d2cf9fecaf14b08ebb6"} Jul 02 15:27:42.258440 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:42.258420 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-wk52z" Jul 02 15:27:42.259955 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:42.259929 2578 generic.go:356] "Generic (PLEG): container finished" podID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerID="d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963" exitCode=0 Jul 02 15:27:42.260077 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:42.260026 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40192f74-f4c1-4784-83ff-52f8dd633c5a","Type":"ContainerDied","Data":"d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963"} Jul 02 15:27:42.263522 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:42.263497 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" event={"ID":"a7251074-9516-49dd-9772-d4167678dac9","Type":"ContainerStarted","Data":"8281c688e0d9b43a2cd99fdfac734bac085a7265f4b77bc55db06bec26a276e6"} Jul 02 15:27:42.263641 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:42.263559 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" event={"ID":"a7251074-9516-49dd-9772-d4167678dac9","Type":"ContainerStarted","Data":"dfb7886649a43c72382ee29f21a41e2eb3bdd0140f5dcc867c6db5a6dc4ec52c"} Jul 02 15:27:42.263641 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:42.263623 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" Jul 02 15:27:42.263749 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:42.263666 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" event={"ID":"a7251074-9516-49dd-9772-d4167678dac9","Type":"ContainerStarted","Data":"9cfa9af87a0ad9e1b442c5fda946dbe9150e93f82ce56204ae337b3df0242520"} Jul 02 15:27:42.264187 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:42.264169 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-wk52z" Jul 02 15:27:42.265763 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:42.265740 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w528n" event={"ID":"f85b2e6b-f8cc-4efd-87d3-6d85423e64a4","Type":"ContainerStarted","Data":"2d185ec1eac9d21df1d33d87eeb6935402b3b376bcce0a5563187a4689b001b9"} Jul 02 15:27:42.265849 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:42.265797 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:27:42.267261 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:42.267239 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7z5mp" event={"ID":"ac822a5a-c97b-4159-ac19-0000a2b4abfb","Type":"ContainerStarted","Data":"58a777ad0a8a73b4809a9c1dd2556d47ca0d7d03a317a06f2168deda4816731a"} Jul 02 15:27:42.269371 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:42.269356 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" Jul 02 15:27:42.281262 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:42.281225 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:42.314155 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:42.314109 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-75d49746c4-pg77h" podStartSLOduration=1.324169993 podStartE2EDuration="7.314094742s" totalImagesPullingTime="5.989924749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:27:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:42.283962906 +0000 UTC m=+73.913923760" watchObservedRunningTime="2026-07-02 15:27:42.314094742 +0000 UTC m=+73.944055571" Jul 02 15:27:42.331361 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:42.331326 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-w528n" podStartSLOduration=67.566721414 podStartE2EDuration="1m14.331312914s" totalImagesPullingTime="6.7645915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:26:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:42.330967629 +0000 UTC m=+73.960928482" watchObservedRunningTime="2026-07-02 15:27:42.331312914 +0000 UTC m=+73.961273782" Jul 02 15:27:42.351998 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:42.351957 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7z5mp" podStartSLOduration=66.592370694 podStartE2EDuration="1m13.351944154s" totalImagesPullingTime="6.75957346s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:26:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:42.351371552 +0000 UTC m=+73.981332414" watchObservedRunningTime="2026-07-02 15:27:42.351944154 +0000 UTC m=+73.981905006" Jul 02 15:27:42.361569 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:42.361547 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:42.378485 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:42.378442 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6b44dfcfc4-hljql" podStartSLOduration=2.493439742 podStartE2EDuration="10.37842876s" totalImagesPullingTime="7.884989018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:27:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:42.377675057 +0000 UTC m=+74.007635949" watchObservedRunningTime="2026-07-02 15:27:42.37842876 +0000 UTC m=+74.008389610" Jul 02 15:27:42.398525 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:42.398481 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-wk52z" podStartSLOduration=3.36075129 podStartE2EDuration="8.398467271s" totalImagesPullingTime="5.037715981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:27:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:42.397543982 +0000 UTC m=+74.027504863" watchObservedRunningTime="2026-07-02 15:27:42.398467271 +0000 UTC m=+74.028428161" Jul 02 15:27:43.160156 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:43.160102 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66864f79cc-9mbt5"] Jul 02 15:27:43.449726 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:43.449619 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:43.550030 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:43.549977 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:44.151881 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:44.151851 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:44.255780 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:44.255746 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:44.993375 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:44.993334 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66864f79cc-9mbt5" Jul 02 15:27:47.072925 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:47.072873 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:47.172993 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:47.172956 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:47.290843 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:47.290813 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40192f74-f4c1-4784-83ff-52f8dd633c5a","Type":"ContainerStarted","Data":"126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b"} Jul 02 15:27:47.291032 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:47.290890 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40192f74-f4c1-4784-83ff-52f8dd633c5a","Type":"ContainerStarted","Data":"8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287"} Jul 02 15:27:47.291032 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:47.290959 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40192f74-f4c1-4784-83ff-52f8dd633c5a","Type":"ContainerStarted","Data":"704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002"} Jul 02 15:27:47.291032 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:47.290996 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40192f74-f4c1-4784-83ff-52f8dd633c5a","Type":"ContainerStarted","Data":"35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f"} Jul 02 15:27:47.291193 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:47.291034 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40192f74-f4c1-4784-83ff-52f8dd633c5a","Type":"ContainerStarted","Data":"47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84"} Jul 02 15:27:47.291193 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:47.291072 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40192f74-f4c1-4784-83ff-52f8dd633c5a","Type":"ContainerStarted","Data":"8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17"} Jul 02 15:27:47.320139 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:47.320090 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.865560449 podStartE2EDuration="11.320074701s" totalImagesPullingTime="8.421780576s" totalInitContainerRuntime="32.733676ms" isStatefulPod=false podCreationTimestamp="2026-07-02 15:27:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:47.318109037 +0000 UTC m=+78.948069906" watchObservedRunningTime="2026-07-02 15:27:47.320074701 +0000 UTC m=+78.950035551" Jul 02 15:27:51.292788 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:51.292675 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:51.392955 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:51.392921 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:51.487237 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:51.487204 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:27:52.897325 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:52.897292 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:52.978151 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:52.978115 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:54.467559 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:54.467509 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:54.568775 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:54.568743 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:54.669102 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:54.669070 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:27:59.637160 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:59.637097 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6c988677bc-76gtr" podUID="abb0dc5d-edd4-4d13-97f2-367a36dab886" containerName="console" containerID="cri-o://fcfe457c5efc8e2d940390090e56f30965bb260ec883fa6ce156dd3ce2bc8eab" gracePeriod=15 Jul 02 15:27:59.879328 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:59.879299 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c988677bc-76gtr" Jul 02 15:27:59.915377 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:59.915304 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8vx2\" (UniqueName: \"kubernetes.io/projected/abb0dc5d-edd4-4d13-97f2-367a36dab886-kube-api-access-x8vx2\") pod \"abb0dc5d-edd4-4d13-97f2-367a36dab886\" (UID: \"abb0dc5d-edd4-4d13-97f2-367a36dab886\") " Jul 02 15:27:59.915377 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:59.915342 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/abb0dc5d-edd4-4d13-97f2-367a36dab886-console-serving-cert\") pod \"abb0dc5d-edd4-4d13-97f2-367a36dab886\" (UID: \"abb0dc5d-edd4-4d13-97f2-367a36dab886\") " Jul 02 15:27:59.915586 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:59.915392 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/abb0dc5d-edd4-4d13-97f2-367a36dab886-console-oauth-config\") pod \"abb0dc5d-edd4-4d13-97f2-367a36dab886\" (UID: \"abb0dc5d-edd4-4d13-97f2-367a36dab886\") " Jul 02 15:27:59.915586 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:59.915418 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abb0dc5d-edd4-4d13-97f2-367a36dab886-trusted-ca-bundle\") pod \"abb0dc5d-edd4-4d13-97f2-367a36dab886\" (UID: \"abb0dc5d-edd4-4d13-97f2-367a36dab886\") " Jul 02 15:27:59.915586 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:59.915449 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/abb0dc5d-edd4-4d13-97f2-367a36dab886-console-config\") pod \"abb0dc5d-edd4-4d13-97f2-367a36dab886\" (UID: \"abb0dc5d-edd4-4d13-97f2-367a36dab886\") " Jul 02 15:27:59.915747 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:59.915619 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/abb0dc5d-edd4-4d13-97f2-367a36dab886-service-ca\") pod \"abb0dc5d-edd4-4d13-97f2-367a36dab886\" (UID: \"abb0dc5d-edd4-4d13-97f2-367a36dab886\") " Jul 02 15:27:59.915747 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:59.915706 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/abb0dc5d-edd4-4d13-97f2-367a36dab886-oauth-serving-cert\") pod \"abb0dc5d-edd4-4d13-97f2-367a36dab886\" (UID: \"abb0dc5d-edd4-4d13-97f2-367a36dab886\") " Jul 02 15:27:59.915948 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:59.915882 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abb0dc5d-edd4-4d13-97f2-367a36dab886-console-config" (OuterVolumeSpecName: "console-config") pod "abb0dc5d-edd4-4d13-97f2-367a36dab886" (UID: "abb0dc5d-edd4-4d13-97f2-367a36dab886"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:27:59.916051 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:59.915958 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abb0dc5d-edd4-4d13-97f2-367a36dab886-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "abb0dc5d-edd4-4d13-97f2-367a36dab886" (UID: "abb0dc5d-edd4-4d13-97f2-367a36dab886"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:27:59.916051 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:59.915999 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abb0dc5d-edd4-4d13-97f2-367a36dab886-service-ca" (OuterVolumeSpecName: "service-ca") pod "abb0dc5d-edd4-4d13-97f2-367a36dab886" (UID: "abb0dc5d-edd4-4d13-97f2-367a36dab886"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:27:59.916051 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:59.916021 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abb0dc5d-edd4-4d13-97f2-367a36dab886-trusted-ca-bundle\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:27:59.916051 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:59.916040 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/abb0dc5d-edd4-4d13-97f2-367a36dab886-console-config\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:27:59.916259 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:59.916202 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abb0dc5d-edd4-4d13-97f2-367a36dab886-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "abb0dc5d-edd4-4d13-97f2-367a36dab886" (UID: "abb0dc5d-edd4-4d13-97f2-367a36dab886"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:27:59.917807 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:59.917772 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abb0dc5d-edd4-4d13-97f2-367a36dab886-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "abb0dc5d-edd4-4d13-97f2-367a36dab886" (UID: "abb0dc5d-edd4-4d13-97f2-367a36dab886"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:27:59.917971 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:59.917841 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abb0dc5d-edd4-4d13-97f2-367a36dab886-kube-api-access-x8vx2" (OuterVolumeSpecName: "kube-api-access-x8vx2") pod "abb0dc5d-edd4-4d13-97f2-367a36dab886" (UID: "abb0dc5d-edd4-4d13-97f2-367a36dab886"). InnerVolumeSpecName "kube-api-access-x8vx2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:27:59.917971 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:27:59.917919 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abb0dc5d-edd4-4d13-97f2-367a36dab886-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "abb0dc5d-edd4-4d13-97f2-367a36dab886" (UID: "abb0dc5d-edd4-4d13-97f2-367a36dab886"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:28:00.016705 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:00.016667 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/abb0dc5d-edd4-4d13-97f2-367a36dab886-console-oauth-config\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:00.016705 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:00.016697 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/abb0dc5d-edd4-4d13-97f2-367a36dab886-service-ca\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:00.016705 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:00.016706 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/abb0dc5d-edd4-4d13-97f2-367a36dab886-oauth-serving-cert\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:00.016705 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:00.016715 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8vx2\" (UniqueName: \"kubernetes.io/projected/abb0dc5d-edd4-4d13-97f2-367a36dab886-kube-api-access-x8vx2\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:00.016988 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:00.016725 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/abb0dc5d-edd4-4d13-97f2-367a36dab886-console-serving-cert\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:00.343523 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:00.343440 2578 generic.go:356] "Generic (PLEG): container finished" podID="abb0dc5d-edd4-4d13-97f2-367a36dab886" containerID="fcfe457c5efc8e2d940390090e56f30965bb260ec883fa6ce156dd3ce2bc8eab" exitCode=0 Jul 02 15:28:00.343523 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:00.343482 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c988677bc-76gtr" Jul 02 15:28:00.343523 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:00.343506 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c988677bc-76gtr" event={"ID":"abb0dc5d-edd4-4d13-97f2-367a36dab886","Type":"ContainerDied","Data":"fcfe457c5efc8e2d940390090e56f30965bb260ec883fa6ce156dd3ce2bc8eab"} Jul 02 15:28:00.343755 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:00.343549 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c988677bc-76gtr" event={"ID":"abb0dc5d-edd4-4d13-97f2-367a36dab886","Type":"ContainerDied","Data":"0f235e5d321fd4c49cfd59130d60e1ba71a4290d9910b53ca94a89bc11e84ade"} Jul 02 15:28:00.343755 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:00.343570 2578 scope.go:117] "RemoveContainer" containerID="fcfe457c5efc8e2d940390090e56f30965bb260ec883fa6ce156dd3ce2bc8eab" Jul 02 15:28:00.354181 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:00.354161 2578 scope.go:117] "RemoveContainer" containerID="fcfe457c5efc8e2d940390090e56f30965bb260ec883fa6ce156dd3ce2bc8eab" Jul 02 15:28:00.354442 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:28:00.354421 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcfe457c5efc8e2d940390090e56f30965bb260ec883fa6ce156dd3ce2bc8eab\": container with ID starting with fcfe457c5efc8e2d940390090e56f30965bb260ec883fa6ce156dd3ce2bc8eab not found: ID does not exist" containerID="fcfe457c5efc8e2d940390090e56f30965bb260ec883fa6ce156dd3ce2bc8eab" Jul 02 15:28:00.354495 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:00.354449 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcfe457c5efc8e2d940390090e56f30965bb260ec883fa6ce156dd3ce2bc8eab"} err="failed to get container status \"fcfe457c5efc8e2d940390090e56f30965bb260ec883fa6ce156dd3ce2bc8eab\": rpc error: code = NotFound desc = could not find container \"fcfe457c5efc8e2d940390090e56f30965bb260ec883fa6ce156dd3ce2bc8eab\": container with ID starting with fcfe457c5efc8e2d940390090e56f30965bb260ec883fa6ce156dd3ce2bc8eab not found: ID does not exist" Jul 02 15:28:00.370777 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:00.370756 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c988677bc-76gtr"] Jul 02 15:28:00.382017 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:00.381997 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c988677bc-76gtr"] Jul 02 15:28:00.816382 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:00.816352 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abb0dc5d-edd4-4d13-97f2-367a36dab886" path="/var/lib/kubelet/pods/abb0dc5d-edd4-4d13-97f2-367a36dab886/volumes" Jul 02 15:28:08.185729 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:08.185654 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-66864f79cc-9mbt5" podUID="8bacea09-c51d-428e-aa19-03ca773f6bc8" containerName="console" containerID="cri-o://cb8b28b1d51b06c80ca9843ce11f0ebafcb17555b35ffc94155b83da7e7bbf33" gracePeriod=15 Jul 02 15:28:08.376129 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:08.376099 2578 generic.go:356] "Generic (PLEG): container finished" podID="8bacea09-c51d-428e-aa19-03ca773f6bc8" containerID="cb8b28b1d51b06c80ca9843ce11f0ebafcb17555b35ffc94155b83da7e7bbf33" exitCode=0 Jul 02 15:28:08.376272 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:08.376171 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66864f79cc-9mbt5" event={"ID":"8bacea09-c51d-428e-aa19-03ca773f6bc8","Type":"ContainerDied","Data":"cb8b28b1d51b06c80ca9843ce11f0ebafcb17555b35ffc94155b83da7e7bbf33"} Jul 02 15:28:08.424285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:08.424262 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66864f79cc-9mbt5" Jul 02 15:28:08.491127 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:08.491056 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjjxl\" (UniqueName: \"kubernetes.io/projected/8bacea09-c51d-428e-aa19-03ca773f6bc8-kube-api-access-fjjxl\") pod \"8bacea09-c51d-428e-aa19-03ca773f6bc8\" (UID: \"8bacea09-c51d-428e-aa19-03ca773f6bc8\") " Jul 02 15:28:08.491127 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:08.491098 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8bacea09-c51d-428e-aa19-03ca773f6bc8-console-oauth-config\") pod \"8bacea09-c51d-428e-aa19-03ca773f6bc8\" (UID: \"8bacea09-c51d-428e-aa19-03ca773f6bc8\") " Jul 02 15:28:08.491333 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:08.491133 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8bacea09-c51d-428e-aa19-03ca773f6bc8-oauth-serving-cert\") pod \"8bacea09-c51d-428e-aa19-03ca773f6bc8\" (UID: \"8bacea09-c51d-428e-aa19-03ca773f6bc8\") " Jul 02 15:28:08.491333 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:08.491149 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8bacea09-c51d-428e-aa19-03ca773f6bc8-console-serving-cert\") pod \"8bacea09-c51d-428e-aa19-03ca773f6bc8\" (UID: \"8bacea09-c51d-428e-aa19-03ca773f6bc8\") " Jul 02 15:28:08.491333 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:08.491194 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bacea09-c51d-428e-aa19-03ca773f6bc8-trusted-ca-bundle\") pod \"8bacea09-c51d-428e-aa19-03ca773f6bc8\" (UID: \"8bacea09-c51d-428e-aa19-03ca773f6bc8\") " Jul 02 15:28:08.491333 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:08.491215 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8bacea09-c51d-428e-aa19-03ca773f6bc8-console-config\") pod \"8bacea09-c51d-428e-aa19-03ca773f6bc8\" (UID: \"8bacea09-c51d-428e-aa19-03ca773f6bc8\") " Jul 02 15:28:08.491333 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:08.491254 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8bacea09-c51d-428e-aa19-03ca773f6bc8-service-ca\") pod \"8bacea09-c51d-428e-aa19-03ca773f6bc8\" (UID: \"8bacea09-c51d-428e-aa19-03ca773f6bc8\") " Jul 02 15:28:08.491608 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:08.491581 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bacea09-c51d-428e-aa19-03ca773f6bc8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8bacea09-c51d-428e-aa19-03ca773f6bc8" (UID: "8bacea09-c51d-428e-aa19-03ca773f6bc8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:28:08.491740 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:08.491602 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bacea09-c51d-428e-aa19-03ca773f6bc8-console-config" (OuterVolumeSpecName: "console-config") pod "8bacea09-c51d-428e-aa19-03ca773f6bc8" (UID: "8bacea09-c51d-428e-aa19-03ca773f6bc8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:28:08.491740 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:08.491702 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bacea09-c51d-428e-aa19-03ca773f6bc8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8bacea09-c51d-428e-aa19-03ca773f6bc8" (UID: "8bacea09-c51d-428e-aa19-03ca773f6bc8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:28:08.491856 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:08.491796 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bacea09-c51d-428e-aa19-03ca773f6bc8-service-ca" (OuterVolumeSpecName: "service-ca") pod "8bacea09-c51d-428e-aa19-03ca773f6bc8" (UID: "8bacea09-c51d-428e-aa19-03ca773f6bc8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:28:08.493433 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:08.493406 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bacea09-c51d-428e-aa19-03ca773f6bc8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8bacea09-c51d-428e-aa19-03ca773f6bc8" (UID: "8bacea09-c51d-428e-aa19-03ca773f6bc8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:28:08.493520 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:08.493431 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bacea09-c51d-428e-aa19-03ca773f6bc8-kube-api-access-fjjxl" (OuterVolumeSpecName: "kube-api-access-fjjxl") pod "8bacea09-c51d-428e-aa19-03ca773f6bc8" (UID: "8bacea09-c51d-428e-aa19-03ca773f6bc8"). InnerVolumeSpecName "kube-api-access-fjjxl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:28:08.493520 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:08.493462 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bacea09-c51d-428e-aa19-03ca773f6bc8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8bacea09-c51d-428e-aa19-03ca773f6bc8" (UID: "8bacea09-c51d-428e-aa19-03ca773f6bc8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:28:08.592528 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:08.592491 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8bacea09-c51d-428e-aa19-03ca773f6bc8-oauth-serving-cert\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:08.592528 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:08.592522 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8bacea09-c51d-428e-aa19-03ca773f6bc8-console-serving-cert\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:08.592528 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:08.592531 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bacea09-c51d-428e-aa19-03ca773f6bc8-trusted-ca-bundle\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:08.592737 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:08.592539 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8bacea09-c51d-428e-aa19-03ca773f6bc8-console-config\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:08.592737 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:08.592551 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8bacea09-c51d-428e-aa19-03ca773f6bc8-service-ca\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:08.592737 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:08.592558 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjjxl\" (UniqueName: \"kubernetes.io/projected/8bacea09-c51d-428e-aa19-03ca773f6bc8-kube-api-access-fjjxl\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:08.592737 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:08.592567 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8bacea09-c51d-428e-aa19-03ca773f6bc8-console-oauth-config\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:09.382365 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:09.382334 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66864f79cc-9mbt5" Jul 02 15:28:09.382365 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:09.382348 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66864f79cc-9mbt5" event={"ID":"8bacea09-c51d-428e-aa19-03ca773f6bc8","Type":"ContainerDied","Data":"c8f92b4be7ea24c28f7061d0c4d0e884e55b34908ff96932ab4708719236d8b7"} Jul 02 15:28:09.382847 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:09.382414 2578 scope.go:117] "RemoveContainer" containerID="cb8b28b1d51b06c80ca9843ce11f0ebafcb17555b35ffc94155b83da7e7bbf33" Jul 02 15:28:09.405740 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:09.405716 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66864f79cc-9mbt5"] Jul 02 15:28:09.410441 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:09.410418 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66864f79cc-9mbt5"] Jul 02 15:28:10.815854 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:10.815815 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bacea09-c51d-428e-aa19-03ca773f6bc8" path="/var/lib/kubelet/pods/8bacea09-c51d-428e-aa19-03ca773f6bc8/volumes" Jul 02 15:28:13.274052 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:13.274013 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-w528n" Jul 02 15:28:36.486939 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:36.486890 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:36.507179 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:36.507152 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:37.508320 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:37.508289 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:46.022809 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:46.022748 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:46.152778 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:46.152739 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:54.690154 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.690116 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:28:54.690722 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.690447 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerName="prometheus" containerID="cri-o://8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17" gracePeriod=600 Jul 02 15:28:54.690722 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.690493 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerName="kube-rbac-proxy" containerID="cri-o://8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287" gracePeriod=600 Jul 02 15:28:54.690722 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.690484 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerName="kube-rbac-proxy-web" containerID="cri-o://704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002" gracePeriod=600 Jul 02 15:28:54.690722 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.690499 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerName="config-reloader" containerID="cri-o://47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84" gracePeriod=600 Jul 02 15:28:54.690722 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.690449 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b" gracePeriod=600 Jul 02 15:28:54.690722 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.690484 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerName="thanos-sidecar" containerID="cri-o://35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f" gracePeriod=600 Jul 02 15:28:54.947673 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.947603 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:54.964143 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.964109 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-grpc-tls\") pod \"40192f74-f4c1-4784-83ff-52f8dd633c5a\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " Jul 02 15:28:54.964297 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.964158 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-configmap-metrics-client-ca\") pod \"40192f74-f4c1-4784-83ff-52f8dd633c5a\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " Jul 02 15:28:54.964297 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.964186 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-configmap-serving-certs-ca-bundle\") pod \"40192f74-f4c1-4784-83ff-52f8dd633c5a\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " Jul 02 15:28:54.964297 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.964220 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-trusted-ca-bundle\") pod \"40192f74-f4c1-4784-83ff-52f8dd633c5a\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " Jul 02 15:28:54.964297 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.964246 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-kube-rbac-proxy\") pod \"40192f74-f4c1-4784-83ff-52f8dd633c5a\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " Jul 02 15:28:54.964297 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.964275 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"40192f74-f4c1-4784-83ff-52f8dd633c5a\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " Jul 02 15:28:54.964549 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.964502 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-k8s-db\") pod \"40192f74-f4c1-4784-83ff-52f8dd633c5a\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " Jul 02 15:28:54.964607 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.964562 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ds26c\" (UniqueName: \"kubernetes.io/projected/40192f74-f4c1-4784-83ff-52f8dd633c5a-kube-api-access-ds26c\") pod \"40192f74-f4c1-4784-83ff-52f8dd633c5a\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " Jul 02 15:28:54.964607 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.964577 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "40192f74-f4c1-4784-83ff-52f8dd633c5a" (UID: "40192f74-f4c1-4784-83ff-52f8dd633c5a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:28:54.964607 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.964592 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-metrics-client-certs\") pod \"40192f74-f4c1-4784-83ff-52f8dd633c5a\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " Jul 02 15:28:54.964761 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.964623 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40192f74-f4c1-4784-83ff-52f8dd633c5a-tls-assets\") pod \"40192f74-f4c1-4784-83ff-52f8dd633c5a\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " Jul 02 15:28:54.964761 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.964622 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "40192f74-f4c1-4784-83ff-52f8dd633c5a" (UID: "40192f74-f4c1-4784-83ff-52f8dd633c5a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:28:54.964761 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.964630 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "40192f74-f4c1-4784-83ff-52f8dd633c5a" (UID: "40192f74-f4c1-4784-83ff-52f8dd633c5a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:28:54.964761 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.964659 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-k8s-rulefiles-1\") pod \"40192f74-f4c1-4784-83ff-52f8dd633c5a\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " Jul 02 15:28:54.964761 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.964698 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-config\") pod \"40192f74-f4c1-4784-83ff-52f8dd633c5a\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " Jul 02 15:28:54.964761 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.964730 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-thanos-prometheus-http-client-file\") pod \"40192f74-f4c1-4784-83ff-52f8dd633c5a\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " Jul 02 15:28:54.965075 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.964769 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-web-config\") pod \"40192f74-f4c1-4784-83ff-52f8dd633c5a\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " Jul 02 15:28:54.965075 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.964805 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-k8s-rulefiles-0\") pod \"40192f74-f4c1-4784-83ff-52f8dd633c5a\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " Jul 02 15:28:54.965075 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.964909 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-configmap-kubelet-serving-ca-bundle\") pod \"40192f74-f4c1-4784-83ff-52f8dd633c5a\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " Jul 02 15:28:54.965075 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.964950 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-prometheus-k8s-tls\") pod \"40192f74-f4c1-4784-83ff-52f8dd633c5a\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " Jul 02 15:28:54.965075 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.964975 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40192f74-f4c1-4784-83ff-52f8dd633c5a-config-out\") pod \"40192f74-f4c1-4784-83ff-52f8dd633c5a\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " Jul 02 15:28:54.965075 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.965016 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-k8s-rulefiles-2\") pod \"40192f74-f4c1-4784-83ff-52f8dd633c5a\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " Jul 02 15:28:54.965075 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.965054 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"40192f74-f4c1-4784-83ff-52f8dd633c5a\" (UID: \"40192f74-f4c1-4784-83ff-52f8dd633c5a\") " Jul 02 15:28:54.965385 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.965285 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-configmap-metrics-client-ca\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:54.965385 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.965304 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:54.965385 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.965320 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:54.966100 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.965680 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "40192f74-f4c1-4784-83ff-52f8dd633c5a" (UID: "40192f74-f4c1-4784-83ff-52f8dd633c5a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:28:54.966100 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.965687 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "40192f74-f4c1-4784-83ff-52f8dd633c5a" (UID: "40192f74-f4c1-4784-83ff-52f8dd633c5a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:28:54.967321 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.966806 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "40192f74-f4c1-4784-83ff-52f8dd633c5a" (UID: "40192f74-f4c1-4784-83ff-52f8dd633c5a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:28:54.967321 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.967262 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "40192f74-f4c1-4784-83ff-52f8dd633c5a" (UID: "40192f74-f4c1-4784-83ff-52f8dd633c5a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:28:54.970074 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.970046 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "40192f74-f4c1-4784-83ff-52f8dd633c5a" (UID: "40192f74-f4c1-4784-83ff-52f8dd633c5a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:28:54.970172 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.970103 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "40192f74-f4c1-4784-83ff-52f8dd633c5a" (UID: "40192f74-f4c1-4784-83ff-52f8dd633c5a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:28:54.970662 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.970637 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40192f74-f4c1-4784-83ff-52f8dd633c5a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "40192f74-f4c1-4784-83ff-52f8dd633c5a" (UID: "40192f74-f4c1-4784-83ff-52f8dd633c5a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:28:54.970777 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.970757 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "40192f74-f4c1-4784-83ff-52f8dd633c5a" (UID: "40192f74-f4c1-4784-83ff-52f8dd633c5a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:28:54.971493 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.971467 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40192f74-f4c1-4784-83ff-52f8dd633c5a-kube-api-access-ds26c" (OuterVolumeSpecName: "kube-api-access-ds26c") pod "40192f74-f4c1-4784-83ff-52f8dd633c5a" (UID: "40192f74-f4c1-4784-83ff-52f8dd633c5a"). InnerVolumeSpecName "kube-api-access-ds26c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:28:54.971605 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.971586 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "40192f74-f4c1-4784-83ff-52f8dd633c5a" (UID: "40192f74-f4c1-4784-83ff-52f8dd633c5a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:28:54.971853 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.971820 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40192f74-f4c1-4784-83ff-52f8dd633c5a-config-out" (OuterVolumeSpecName: "config-out") pod "40192f74-f4c1-4784-83ff-52f8dd633c5a" (UID: "40192f74-f4c1-4784-83ff-52f8dd633c5a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:28:54.971973 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.971845 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "40192f74-f4c1-4784-83ff-52f8dd633c5a" (UID: "40192f74-f4c1-4784-83ff-52f8dd633c5a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:28:54.971973 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.971957 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "40192f74-f4c1-4784-83ff-52f8dd633c5a" (UID: "40192f74-f4c1-4784-83ff-52f8dd633c5a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:28:54.972086 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.972024 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-config" (OuterVolumeSpecName: "config") pod "40192f74-f4c1-4784-83ff-52f8dd633c5a" (UID: "40192f74-f4c1-4784-83ff-52f8dd633c5a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:28:54.972139 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.972117 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "40192f74-f4c1-4784-83ff-52f8dd633c5a" (UID: "40192f74-f4c1-4784-83ff-52f8dd633c5a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:28:54.972214 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.972194 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "40192f74-f4c1-4784-83ff-52f8dd633c5a" (UID: "40192f74-f4c1-4784-83ff-52f8dd633c5a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:28:54.982285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:54.982257 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-web-config" (OuterVolumeSpecName: "web-config") pod "40192f74-f4c1-4784-83ff-52f8dd633c5a" (UID: "40192f74-f4c1-4784-83ff-52f8dd633c5a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:28:55.066138 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.066100 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:55.066138 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.066131 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-k8s-db\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:55.066138 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.066147 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ds26c\" (UniqueName: \"kubernetes.io/projected/40192f74-f4c1-4784-83ff-52f8dd633c5a-kube-api-access-ds26c\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:55.066398 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.066159 2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-metrics-client-certs\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:55.066398 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.066171 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40192f74-f4c1-4784-83ff-52f8dd633c5a-tls-assets\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:55.066398 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.066182 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:55.066398 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.066193 2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-config\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:55.066398 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.066204 2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:55.066398 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.066217 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-web-config\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:55.066398 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.066229 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:55.066398 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.066240 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:55.066398 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.066251 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:55.066398 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.066263 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40192f74-f4c1-4784-83ff-52f8dd633c5a-config-out\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:55.066398 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.066274 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/40192f74-f4c1-4784-83ff-52f8dd633c5a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:55.066398 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.066288 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:55.066398 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.066302 2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-grpc-tls\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:55.066398 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.066315 2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40192f74-f4c1-4784-83ff-52f8dd633c5a-secret-kube-rbac-proxy\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:28:55.557389 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.557358 2578 generic.go:356] "Generic (PLEG): container finished" podID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerID="126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b" exitCode=0 Jul 02 15:28:55.557389 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.557382 2578 generic.go:356] "Generic (PLEG): container finished" podID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerID="8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287" exitCode=0 Jul 02 15:28:55.557389 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.557388 2578 generic.go:356] "Generic (PLEG): container finished" podID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerID="704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002" exitCode=0 Jul 02 15:28:55.557389 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.557394 2578 generic.go:356] "Generic (PLEG): container finished" podID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerID="35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f" exitCode=0 Jul 02 15:28:55.557389 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.557399 2578 generic.go:356] "Generic (PLEG): container finished" podID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerID="47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84" exitCode=0 Jul 02 15:28:55.557671 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.557405 2578 generic.go:356] "Generic (PLEG): container finished" podID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerID="8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17" exitCode=0 Jul 02 15:28:55.557671 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.557440 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.557671 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.557438 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40192f74-f4c1-4784-83ff-52f8dd633c5a","Type":"ContainerDied","Data":"126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b"} Jul 02 15:28:55.557671 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.557509 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40192f74-f4c1-4784-83ff-52f8dd633c5a","Type":"ContainerDied","Data":"8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287"} Jul 02 15:28:55.557671 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.557536 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40192f74-f4c1-4784-83ff-52f8dd633c5a","Type":"ContainerDied","Data":"704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002"} Jul 02 15:28:55.557671 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.557562 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40192f74-f4c1-4784-83ff-52f8dd633c5a","Type":"ContainerDied","Data":"35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f"} Jul 02 15:28:55.557671 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.557574 2578 scope.go:117] "RemoveContainer" containerID="126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b" Jul 02 15:28:55.557671 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.557586 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40192f74-f4c1-4784-83ff-52f8dd633c5a","Type":"ContainerDied","Data":"47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84"} Jul 02 15:28:55.557671 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.557611 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40192f74-f4c1-4784-83ff-52f8dd633c5a","Type":"ContainerDied","Data":"8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17"} Jul 02 15:28:55.557671 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.557637 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40192f74-f4c1-4784-83ff-52f8dd633c5a","Type":"ContainerDied","Data":"e8984dec8a33559bfba91c769b2acaaa51b52fa9fde4d8aefb8a11b412f5dfa4"} Jul 02 15:28:55.565381 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.565365 2578 scope.go:117] "RemoveContainer" containerID="8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287" Jul 02 15:28:55.572118 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.572096 2578 scope.go:117] "RemoveContainer" containerID="704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002" Jul 02 15:28:55.578601 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.578581 2578 scope.go:117] "RemoveContainer" containerID="35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f" Jul 02 15:28:55.580225 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.580206 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:28:55.585561 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.585536 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:28:55.586290 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.586268 2578 scope.go:117] "RemoveContainer" containerID="47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84" Jul 02 15:28:55.592537 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.592522 2578 scope.go:117] "RemoveContainer" containerID="8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17" Jul 02 15:28:55.599035 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.599019 2578 scope.go:117] "RemoveContainer" containerID="d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963" Jul 02 15:28:55.605244 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.605228 2578 scope.go:117] "RemoveContainer" containerID="126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b" Jul 02 15:28:55.605490 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:28:55.605473 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b\": container with ID starting with 126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b not found: ID does not exist" containerID="126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b" Jul 02 15:28:55.605536 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.605500 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b"} err="failed to get container status \"126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b\": rpc error: code = NotFound desc = could not find container \"126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b\": container with ID starting with 126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b not found: ID does not exist" Jul 02 15:28:55.605536 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.605522 2578 scope.go:117] "RemoveContainer" containerID="8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287" Jul 02 15:28:55.605731 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:28:55.605716 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287\": container with ID starting with 8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287 not found: ID does not exist" containerID="8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287" Jul 02 15:28:55.605770 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.605738 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287"} err="failed to get container status \"8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287\": rpc error: code = NotFound desc = could not find container \"8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287\": container with ID starting with 8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287 not found: ID does not exist" Jul 02 15:28:55.605770 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.605754 2578 scope.go:117] "RemoveContainer" containerID="704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002" Jul 02 15:28:55.605970 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:28:55.605956 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002\": container with ID starting with 704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002 not found: ID does not exist" containerID="704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002" Jul 02 15:28:55.606018 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.605974 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002"} err="failed to get container status \"704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002\": rpc error: code = NotFound desc = could not find container \"704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002\": container with ID starting with 704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002 not found: ID does not exist" Jul 02 15:28:55.606018 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.605990 2578 scope.go:117] "RemoveContainer" containerID="35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f" Jul 02 15:28:55.606203 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:28:55.606186 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f\": container with ID starting with 35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f not found: ID does not exist" containerID="35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f" Jul 02 15:28:55.606243 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.606206 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f"} err="failed to get container status \"35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f\": rpc error: code = NotFound desc = could not find container \"35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f\": container with ID starting with 35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f not found: ID does not exist" Jul 02 15:28:55.606243 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.606224 2578 scope.go:117] "RemoveContainer" containerID="47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84" Jul 02 15:28:55.606403 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:28:55.606388 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84\": container with ID starting with 47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84 not found: ID does not exist" containerID="47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84" Jul 02 15:28:55.606436 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.606406 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84"} err="failed to get container status \"47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84\": rpc error: code = NotFound desc = could not find container \"47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84\": container with ID starting with 47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84 not found: ID does not exist" Jul 02 15:28:55.606436 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.606422 2578 scope.go:117] "RemoveContainer" containerID="8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17" Jul 02 15:28:55.606618 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:28:55.606599 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17\": container with ID starting with 8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17 not found: ID does not exist" containerID="8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17" Jul 02 15:28:55.606662 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.606621 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17"} err="failed to get container status \"8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17\": rpc error: code = NotFound desc = could not find container \"8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17\": container with ID starting with 8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17 not found: ID does not exist" Jul 02 15:28:55.606662 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.606632 2578 scope.go:117] "RemoveContainer" containerID="d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963" Jul 02 15:28:55.606844 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:28:55.606827 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963\": container with ID starting with d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963 not found: ID does not exist" containerID="d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963" Jul 02 15:28:55.606938 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.606852 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963"} err="failed to get container status \"d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963\": rpc error: code = NotFound desc = could not find container \"d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963\": container with ID starting with d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963 not found: ID does not exist" Jul 02 15:28:55.606938 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.606872 2578 scope.go:117] "RemoveContainer" containerID="126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b" Jul 02 15:28:55.607245 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.607227 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b"} err="failed to get container status \"126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b\": rpc error: code = NotFound desc = could not find container \"126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b\": container with ID starting with 126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b not found: ID does not exist" Jul 02 15:28:55.607295 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.607246 2578 scope.go:117] "RemoveContainer" containerID="8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287" Jul 02 15:28:55.607431 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.607416 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287"} err="failed to get container status \"8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287\": rpc error: code = NotFound desc = could not find container \"8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287\": container with ID starting with 8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287 not found: ID does not exist" Jul 02 15:28:55.607472 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.607431 2578 scope.go:117] "RemoveContainer" containerID="704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002" Jul 02 15:28:55.607664 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.607646 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002"} err="failed to get container status \"704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002\": rpc error: code = NotFound desc = could not find container \"704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002\": container with ID starting with 704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002 not found: ID does not exist" Jul 02 15:28:55.607664 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.607664 2578 scope.go:117] "RemoveContainer" containerID="35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f" Jul 02 15:28:55.607936 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.607919 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f"} err="failed to get container status \"35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f\": rpc error: code = NotFound desc = could not find container \"35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f\": container with ID starting with 35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f not found: ID does not exist" Jul 02 15:28:55.608004 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.607938 2578 scope.go:117] "RemoveContainer" containerID="47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84" Jul 02 15:28:55.608200 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.608181 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84"} err="failed to get container status \"47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84\": rpc error: code = NotFound desc = could not find container \"47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84\": container with ID starting with 47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84 not found: ID does not exist" Jul 02 15:28:55.608257 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.608202 2578 scope.go:117] "RemoveContainer" containerID="8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17" Jul 02 15:28:55.608412 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.608393 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17"} err="failed to get container status \"8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17\": rpc error: code = NotFound desc = could not find container \"8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17\": container with ID starting with 8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17 not found: ID does not exist" Jul 02 15:28:55.608450 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.608413 2578 scope.go:117] "RemoveContainer" containerID="d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963" Jul 02 15:28:55.608635 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.608616 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963"} err="failed to get container status \"d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963\": rpc error: code = NotFound desc = could not find container \"d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963\": container with ID starting with d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963 not found: ID does not exist" Jul 02 15:28:55.608708 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.608637 2578 scope.go:117] "RemoveContainer" containerID="126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b" Jul 02 15:28:55.608845 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.608829 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b"} err="failed to get container status \"126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b\": rpc error: code = NotFound desc = could not find container \"126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b\": container with ID starting with 126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b not found: ID does not exist" Jul 02 15:28:55.608845 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.608844 2578 scope.go:117] "RemoveContainer" containerID="8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287" Jul 02 15:28:55.609240 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.609195 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287"} err="failed to get container status \"8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287\": rpc error: code = NotFound desc = could not find container \"8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287\": container with ID starting with 8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287 not found: ID does not exist" Jul 02 15:28:55.609240 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.609221 2578 scope.go:117] "RemoveContainer" containerID="704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002" Jul 02 15:28:55.609555 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.609533 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002"} err="failed to get container status \"704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002\": rpc error: code = NotFound desc = could not find container \"704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002\": container with ID starting with 704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002 not found: ID does not exist" Jul 02 15:28:55.609645 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.609557 2578 scope.go:117] "RemoveContainer" containerID="35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f" Jul 02 15:28:55.609833 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.609811 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f"} err="failed to get container status \"35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f\": rpc error: code = NotFound desc = could not find container \"35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f\": container with ID starting with 35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f not found: ID does not exist" Jul 02 15:28:55.609930 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.609834 2578 scope.go:117] "RemoveContainer" containerID="47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84" Jul 02 15:28:55.610149 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.610126 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84"} err="failed to get container status \"47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84\": rpc error: code = NotFound desc = could not find container \"47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84\": container with ID starting with 47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84 not found: ID does not exist" Jul 02 15:28:55.610149 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.610149 2578 scope.go:117] "RemoveContainer" containerID="8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17" Jul 02 15:28:55.610413 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.610395 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17"} err="failed to get container status \"8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17\": rpc error: code = NotFound desc = could not find container \"8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17\": container with ID starting with 8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17 not found: ID does not exist" Jul 02 15:28:55.610413 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.610413 2578 scope.go:117] "RemoveContainer" containerID="d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963" Jul 02 15:28:55.610660 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.610644 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963"} err="failed to get container status \"d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963\": rpc error: code = NotFound desc = could not find container \"d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963\": container with ID starting with d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963 not found: ID does not exist" Jul 02 15:28:55.610717 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.610661 2578 scope.go:117] "RemoveContainer" containerID="126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b" Jul 02 15:28:55.610769 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.610750 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:28:55.610873 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.610853 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b"} err="failed to get container status \"126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b\": rpc error: code = NotFound desc = could not find container \"126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b\": container with ID starting with 126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b not found: ID does not exist" Jul 02 15:28:55.610947 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.610874 2578 scope.go:117] "RemoveContainer" containerID="8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287" Jul 02 15:28:55.611057 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611044 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abb0dc5d-edd4-4d13-97f2-367a36dab886" containerName="console" Jul 02 15:28:55.611094 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611060 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="abb0dc5d-edd4-4d13-97f2-367a36dab886" containerName="console" Jul 02 15:28:55.611094 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611075 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerName="kube-rbac-proxy-web" Jul 02 15:28:55.611094 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611081 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerName="kube-rbac-proxy-web" Jul 02 15:28:55.611094 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611087 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerName="init-config-reloader" Jul 02 15:28:55.611212 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611097 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerName="init-config-reloader" Jul 02 15:28:55.611212 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611103 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerName="thanos-sidecar" Jul 02 15:28:55.611212 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611109 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerName="thanos-sidecar" Jul 02 15:28:55.611212 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611120 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerName="kube-rbac-proxy-thanos" Jul 02 15:28:55.611212 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611125 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerName="kube-rbac-proxy-thanos" Jul 02 15:28:55.611212 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611132 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerName="config-reloader" Jul 02 15:28:55.611212 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611136 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerName="config-reloader" Jul 02 15:28:55.611212 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611149 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerName="prometheus" Jul 02 15:28:55.611212 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611154 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerName="prometheus" Jul 02 15:28:55.611212 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611161 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bacea09-c51d-428e-aa19-03ca773f6bc8" containerName="console" Jul 02 15:28:55.611212 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611165 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bacea09-c51d-428e-aa19-03ca773f6bc8" containerName="console" Jul 02 15:28:55.611212 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611172 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerName="kube-rbac-proxy" Jul 02 15:28:55.611212 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611176 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerName="kube-rbac-proxy" Jul 02 15:28:55.611212 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611083 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287"} err="failed to get container status \"8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287\": rpc error: code = NotFound desc = could not find container \"8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287\": container with ID starting with 8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287 not found: ID does not exist" Jul 02 15:28:55.611212 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611190 2578 scope.go:117] "RemoveContainer" containerID="704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002" Jul 02 15:28:55.611212 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611215 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bacea09-c51d-428e-aa19-03ca773f6bc8" containerName="console" Jul 02 15:28:55.611708 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611222 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerName="thanos-sidecar" Jul 02 15:28:55.611708 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611227 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerName="kube-rbac-proxy-web" Jul 02 15:28:55.611708 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611233 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerName="prometheus" Jul 02 15:28:55.611708 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611239 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerName="kube-rbac-proxy" Jul 02 15:28:55.611708 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611246 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerName="config-reloader" Jul 02 15:28:55.611708 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611250 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="abb0dc5d-edd4-4d13-97f2-367a36dab886" containerName="console" Jul 02 15:28:55.611708 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611255 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="40192f74-f4c1-4784-83ff-52f8dd633c5a" containerName="kube-rbac-proxy-thanos" Jul 02 15:28:55.611708 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611415 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002"} err="failed to get container status \"704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002\": rpc error: code = NotFound desc = could not find container \"704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002\": container with ID starting with 704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002 not found: ID does not exist" Jul 02 15:28:55.611708 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611437 2578 scope.go:117] "RemoveContainer" containerID="35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f" Jul 02 15:28:55.611708 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611635 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f"} err="failed to get container status \"35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f\": rpc error: code = NotFound desc = could not find container \"35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f\": container with ID starting with 35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f not found: ID does not exist" Jul 02 15:28:55.611708 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611648 2578 scope.go:117] "RemoveContainer" containerID="47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84" Jul 02 15:28:55.612079 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611862 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84"} err="failed to get container status \"47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84\": rpc error: code = NotFound desc = could not find container \"47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84\": container with ID starting with 47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84 not found: ID does not exist" Jul 02 15:28:55.612079 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.611882 2578 scope.go:117] "RemoveContainer" containerID="8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17" Jul 02 15:28:55.612163 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.612108 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17"} err="failed to get container status \"8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17\": rpc error: code = NotFound desc = could not find container \"8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17\": container with ID starting with 8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17 not found: ID does not exist" Jul 02 15:28:55.612163 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.612126 2578 scope.go:117] "RemoveContainer" containerID="d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963" Jul 02 15:28:55.612352 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.612333 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963"} err="failed to get container status \"d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963\": rpc error: code = NotFound desc = could not find container \"d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963\": container with ID starting with d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963 not found: ID does not exist" Jul 02 15:28:55.612397 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.612353 2578 scope.go:117] "RemoveContainer" containerID="126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b" Jul 02 15:28:55.612595 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.612577 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b"} err="failed to get container status \"126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b\": rpc error: code = NotFound desc = could not find container \"126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b\": container with ID starting with 126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b not found: ID does not exist" Jul 02 15:28:55.612662 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.612596 2578 scope.go:117] "RemoveContainer" containerID="8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287" Jul 02 15:28:55.612852 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.612835 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287"} err="failed to get container status \"8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287\": rpc error: code = NotFound desc = could not find container \"8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287\": container with ID starting with 8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287 not found: ID does not exist" Jul 02 15:28:55.612930 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.612852 2578 scope.go:117] "RemoveContainer" containerID="704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002" Jul 02 15:28:55.613122 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.613105 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002"} err="failed to get container status \"704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002\": rpc error: code = NotFound desc = could not find container \"704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002\": container with ID starting with 704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002 not found: ID does not exist" Jul 02 15:28:55.613122 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.613121 2578 scope.go:117] "RemoveContainer" containerID="35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f" Jul 02 15:28:55.613355 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.613335 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f"} err="failed to get container status \"35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f\": rpc error: code = NotFound desc = could not find container \"35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f\": container with ID starting with 35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f not found: ID does not exist" Jul 02 15:28:55.613401 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.613357 2578 scope.go:117] "RemoveContainer" containerID="47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84" Jul 02 15:28:55.613575 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.613558 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84"} err="failed to get container status \"47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84\": rpc error: code = NotFound desc = could not find container \"47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84\": container with ID starting with 47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84 not found: ID does not exist" Jul 02 15:28:55.613575 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.613573 2578 scope.go:117] "RemoveContainer" containerID="8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17" Jul 02 15:28:55.613847 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.613828 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17"} err="failed to get container status \"8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17\": rpc error: code = NotFound desc = could not find container \"8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17\": container with ID starting with 8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17 not found: ID does not exist" Jul 02 15:28:55.613926 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.613849 2578 scope.go:117] "RemoveContainer" containerID="d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963" Jul 02 15:28:55.614153 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.614135 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963"} err="failed to get container status \"d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963\": rpc error: code = NotFound desc = could not find container \"d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963\": container with ID starting with d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963 not found: ID does not exist" Jul 02 15:28:55.614153 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.614152 2578 scope.go:117] "RemoveContainer" containerID="126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b" Jul 02 15:28:55.614377 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.614360 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b"} err="failed to get container status \"126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b\": rpc error: code = NotFound desc = could not find container \"126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b\": container with ID starting with 126954aa4ff924b078abb5567ecfb5b2466083fba64a4862634fc4fe78d03d9b not found: ID does not exist" Jul 02 15:28:55.614445 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.614378 2578 scope.go:117] "RemoveContainer" containerID="8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287" Jul 02 15:28:55.614667 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.614650 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287"} err="failed to get container status \"8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287\": rpc error: code = NotFound desc = could not find container \"8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287\": container with ID starting with 8112d84176f5089dafd9aac2eb7ea82c8c68d57d6a87a1e0947996c2706df287 not found: ID does not exist" Jul 02 15:28:55.614719 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.614667 2578 scope.go:117] "RemoveContainer" containerID="704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002" Jul 02 15:28:55.614882 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.614866 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002"} err="failed to get container status \"704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002\": rpc error: code = NotFound desc = could not find container \"704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002\": container with ID starting with 704a433114144f271ba1fdddc33a28e5fc26ae9de17914a38109dce9e929e002 not found: ID does not exist" Jul 02 15:28:55.614962 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.614882 2578 scope.go:117] "RemoveContainer" containerID="35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f" Jul 02 15:28:55.615087 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.615042 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.615133 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.615107 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f"} err="failed to get container status \"35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f\": rpc error: code = NotFound desc = could not find container \"35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f\": container with ID starting with 35bcfdbdeb00fb963ed049c3868f5748ae930d5e0b9628692e1ee0c43831a77f not found: ID does not exist" Jul 02 15:28:55.615133 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.615123 2578 scope.go:117] "RemoveContainer" containerID="47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84" Jul 02 15:28:55.615482 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.615452 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84"} err="failed to get container status \"47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84\": rpc error: code = NotFound desc = could not find container \"47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84\": container with ID starting with 47a289b9ca5be5bab5361a46da320c153094265cdb3c758568080561759def84 not found: ID does not exist" Jul 02 15:28:55.615634 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.615502 2578 scope.go:117] "RemoveContainer" containerID="8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17" Jul 02 15:28:55.615795 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.615769 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17"} err="failed to get container status \"8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17\": rpc error: code = NotFound desc = could not find container \"8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17\": container with ID starting with 8bd513046f9eb80cf7bd0970d791de9e3e01af052fc7feaee4619515aea8be17 not found: ID does not exist" Jul 02 15:28:55.615878 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.615797 2578 scope.go:117] "RemoveContainer" containerID="d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963" Jul 02 15:28:55.616113 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.616092 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963"} err="failed to get container status \"d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963\": rpc error: code = NotFound desc = could not find container \"d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963\": container with ID starting with d26b766216bf2f28ae7f8a2e56445a25e5e09cdcd5bb12872c8d84fa9084f963 not found: ID does not exist" Jul 02 15:28:55.617470 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.617448 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 15:28:55.617603 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.617580 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 15:28:55.617725 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.617686 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 15:28:55.617725 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.617714 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 15:28:55.617862 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.617823 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 15:28:55.617862 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.617824 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-x8gnk\"" Jul 02 15:28:55.618534 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.618518 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 15:28:55.619102 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.619089 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 15:28:55.619225 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.619189 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 15:28:55.619831 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.619802 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 15:28:55.619994 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.619978 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 15:28:55.620096 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.620069 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 15:28:55.620272 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.620256 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 02 15:28:55.620515 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.620452 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 15:28:55.623657 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.622382 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-acjn5drrsrsjk\"" Jul 02 15:28:55.629004 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.628985 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 15:28:55.629398 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.629376 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 15:28:55.635136 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.635112 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:28:55.669604 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.669573 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7adb4dc4-7629-49a4-bab7-0c07292df168-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.669718 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.669608 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7adb4dc4-7629-49a4-bab7-0c07292df168-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.669718 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.669676 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7adb4dc4-7629-49a4-bab7-0c07292df168-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.669718 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.669708 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7adb4dc4-7629-49a4-bab7-0c07292df168-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.669821 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.669732 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7adb4dc4-7629-49a4-bab7-0c07292df168-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.669821 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.669749 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7adb4dc4-7629-49a4-bab7-0c07292df168-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.669821 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.669772 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7adb4dc4-7629-49a4-bab7-0c07292df168-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.669821 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.669794 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7adb4dc4-7629-49a4-bab7-0c07292df168-config-out\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.669821 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.669812 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7adb4dc4-7629-49a4-bab7-0c07292df168-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.670000 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.669835 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmrtr\" (UniqueName: \"kubernetes.io/projected/7adb4dc4-7629-49a4-bab7-0c07292df168-kube-api-access-zmrtr\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.670000 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.669871 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7adb4dc4-7629-49a4-bab7-0c07292df168-web-config\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.670000 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.669919 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7adb4dc4-7629-49a4-bab7-0c07292df168-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.670000 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.669955 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7adb4dc4-7629-49a4-bab7-0c07292df168-config\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.670000 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.669969 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7adb4dc4-7629-49a4-bab7-0c07292df168-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.670000 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.669994 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7adb4dc4-7629-49a4-bab7-0c07292df168-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.670165 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.670008 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7adb4dc4-7629-49a4-bab7-0c07292df168-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.670165 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.670027 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7adb4dc4-7629-49a4-bab7-0c07292df168-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.670165 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.670057 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7adb4dc4-7629-49a4-bab7-0c07292df168-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.670165 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.670085 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7adb4dc4-7629-49a4-bab7-0c07292df168-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.670165 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.670100 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7adb4dc4-7629-49a4-bab7-0c07292df168-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.770770 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.770742 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7adb4dc4-7629-49a4-bab7-0c07292df168-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.771175 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.770775 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7adb4dc4-7629-49a4-bab7-0c07292df168-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.771175 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.770799 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7adb4dc4-7629-49a4-bab7-0c07292df168-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.771175 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.770823 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7adb4dc4-7629-49a4-bab7-0c07292df168-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.771175 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.770847 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7adb4dc4-7629-49a4-bab7-0c07292df168-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.771175 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.770874 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7adb4dc4-7629-49a4-bab7-0c07292df168-config-out\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.771175 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.770919 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7adb4dc4-7629-49a4-bab7-0c07292df168-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.771175 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.770944 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmrtr\" (UniqueName: \"kubernetes.io/projected/7adb4dc4-7629-49a4-bab7-0c07292df168-kube-api-access-zmrtr\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.771175 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.771066 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7adb4dc4-7629-49a4-bab7-0c07292df168-web-config\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.771175 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.771094 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7adb4dc4-7629-49a4-bab7-0c07292df168-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.771175 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.771142 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7adb4dc4-7629-49a4-bab7-0c07292df168-config\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.771175 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.771164 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7adb4dc4-7629-49a4-bab7-0c07292df168-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.771735 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.771195 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7adb4dc4-7629-49a4-bab7-0c07292df168-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.771735 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.771219 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7adb4dc4-7629-49a4-bab7-0c07292df168-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.771735 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.771250 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7adb4dc4-7629-49a4-bab7-0c07292df168-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.771735 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.771279 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7adb4dc4-7629-49a4-bab7-0c07292df168-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.771735 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.771304 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7adb4dc4-7629-49a4-bab7-0c07292df168-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.771735 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.771346 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7adb4dc4-7629-49a4-bab7-0c07292df168-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.771735 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.771376 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7adb4dc4-7629-49a4-bab7-0c07292df168-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.771735 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.771414 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7adb4dc4-7629-49a4-bab7-0c07292df168-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.771735 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.771502 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7adb4dc4-7629-49a4-bab7-0c07292df168-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.771735 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.771585 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7adb4dc4-7629-49a4-bab7-0c07292df168-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.771735 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.771683 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7adb4dc4-7629-49a4-bab7-0c07292df168-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.772298 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.772137 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7adb4dc4-7629-49a4-bab7-0c07292df168-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.772991 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.772962 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7adb4dc4-7629-49a4-bab7-0c07292df168-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.774069 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.774044 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7adb4dc4-7629-49a4-bab7-0c07292df168-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.774619 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.774162 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7adb4dc4-7629-49a4-bab7-0c07292df168-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.774619 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.774183 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7adb4dc4-7629-49a4-bab7-0c07292df168-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.774619 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.774339 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7adb4dc4-7629-49a4-bab7-0c07292df168-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.774619 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.774356 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7adb4dc4-7629-49a4-bab7-0c07292df168-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.774619 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.774481 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7adb4dc4-7629-49a4-bab7-0c07292df168-config-out\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.774619 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.774550 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7adb4dc4-7629-49a4-bab7-0c07292df168-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.774999 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.774688 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7adb4dc4-7629-49a4-bab7-0c07292df168-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.774999 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.774861 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7adb4dc4-7629-49a4-bab7-0c07292df168-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.775648 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.775622 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7adb4dc4-7629-49a4-bab7-0c07292df168-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.776830 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.776806 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7adb4dc4-7629-49a4-bab7-0c07292df168-config\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.776939 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.776847 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7adb4dc4-7629-49a4-bab7-0c07292df168-web-config\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.776939 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.776864 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7adb4dc4-7629-49a4-bab7-0c07292df168-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.777474 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.777450 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7adb4dc4-7629-49a4-bab7-0c07292df168-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.783860 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.783843 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmrtr\" (UniqueName: \"kubernetes.io/projected/7adb4dc4-7629-49a4-bab7-0c07292df168-kube-api-access-zmrtr\") pod \"prometheus-k8s-0\" (UID: \"7adb4dc4-7629-49a4-bab7-0c07292df168\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:55.928118 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:55.928080 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:28:56.105507 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:28:56.105478 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7adb4dc4_7629_49a4_bab7_0c07292df168.slice/crio-76c715d12422dd69b28e59f7db988434be6ec71a52fb7d8f503370e3d9ef6240 WatchSource:0}: Error finding container 76c715d12422dd69b28e59f7db988434be6ec71a52fb7d8f503370e3d9ef6240: Status 404 returned error can't find the container with id 76c715d12422dd69b28e59f7db988434be6ec71a52fb7d8f503370e3d9ef6240 Jul 02 15:28:56.109152 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:56.109124 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:28:56.562152 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:56.562115 2578 generic.go:356] "Generic (PLEG): container finished" podID="7adb4dc4-7629-49a4-bab7-0c07292df168" containerID="9cf7ea3a625780cca6a615547acbab99885113d290c4e13e9633d9ddc93f8bf4" exitCode=0 Jul 02 15:28:56.562321 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:56.562204 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7adb4dc4-7629-49a4-bab7-0c07292df168","Type":"ContainerDied","Data":"9cf7ea3a625780cca6a615547acbab99885113d290c4e13e9633d9ddc93f8bf4"} Jul 02 15:28:56.562321 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:56.562267 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7adb4dc4-7629-49a4-bab7-0c07292df168","Type":"ContainerStarted","Data":"76c715d12422dd69b28e59f7db988434be6ec71a52fb7d8f503370e3d9ef6240"} Jul 02 15:28:56.816204 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:56.816114 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40192f74-f4c1-4784-83ff-52f8dd633c5a" path="/var/lib/kubelet/pods/40192f74-f4c1-4784-83ff-52f8dd633c5a/volumes" Jul 02 15:28:57.575231 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:57.575197 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7adb4dc4-7629-49a4-bab7-0c07292df168","Type":"ContainerStarted","Data":"7defa4f4f6e89c204f64f6811832ba943f5dd8ea1472d8b5a9256e8cef253b26"} Jul 02 15:28:57.575374 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:57.575283 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7adb4dc4-7629-49a4-bab7-0c07292df168","Type":"ContainerStarted","Data":"70d2de53f0d95b9e26758eb925a92b09fb452cac0d7a623fa26a849948466413"} Jul 02 15:28:57.575374 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:57.575309 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7adb4dc4-7629-49a4-bab7-0c07292df168","Type":"ContainerStarted","Data":"e6ebd40ec7b4da09f85cd6da6a88fdcd2e0a99b3efdc4eca957323539401f8bf"} Jul 02 15:28:57.575374 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:57.575347 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7adb4dc4-7629-49a4-bab7-0c07292df168","Type":"ContainerStarted","Data":"b4e0ed2b193f822af1b1e3ef18129a1659a83d9277514e2a5c74477254f3ad26"} Jul 02 15:28:57.575484 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:57.575391 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7adb4dc4-7629-49a4-bab7-0c07292df168","Type":"ContainerStarted","Data":"72b2afd6df1963ddd80f8258fd4b044c17fc2d6d15d599000282990b51d311c6"} Jul 02 15:28:57.575484 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:57.575453 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7adb4dc4-7629-49a4-bab7-0c07292df168","Type":"ContainerStarted","Data":"0cfa2eec2292ad5c4111ff094c577f70b9619d4ae47faebc7bc2c5fb84dfea75"} Jul 02 15:28:57.606280 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:57.606230 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.5861946749999998 podStartE2EDuration="2.60621358s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.018905ms" isStatefulPod=false podCreationTimestamp="2026-07-02 15:28:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:28:57.60413817 +0000 UTC m=+149.234099020" watchObservedRunningTime="2026-07-02 15:28:57.60621358 +0000 UTC m=+149.236174430" Jul 02 15:28:57.903947 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:57.903914 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:28:57.975417 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:28:57.975387 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:29:00.928286 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:29:00.928241 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:29:03.830154 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:29:03.830114 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:29:03.893458 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:29:03.893417 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:29:04.071214 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:29:04.071179 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:29:04.132310 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:29:04.132281 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:29:04.692353 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:29:04.692326 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:29:04.751591 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:29:04.751556 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:29:07.906741 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:29:07.906704 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:29:08.009160 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:29:08.009124 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:29:14.682140 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:29:14.682107 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:29:14.782886 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:29:14.782845 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:29:30.785107 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:29:30.785069 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:29:30.848263 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:29:30.848213 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:29:55.928842 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:29:55.928808 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:29:55.943945 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:29:55.943915 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:29:56.803196 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:29:56.803172 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:30:02.655204 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:02.655163 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:02.720718 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:02.720684 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:12.660688 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:12.660654 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:12.786246 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:12.786205 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:22.357033 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:22.356996 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:39.898981 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:39.898947 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:40.318621 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:40.318540 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:44.049007 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:44.048971 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:44.154582 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:44.154545 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:45.271012 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:45.270977 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:45.369307 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:45.369276 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:47.646311 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:47.646279 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:47.868185 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:47.868156 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:48.037080 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:48.036992 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:48.096359 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:48.096331 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:50.641317 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:50.641229 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:50.708127 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:50.708071 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:54.163367 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:54.163337 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:54.264102 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:54.264073 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:55.284412 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:55.284381 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:30:55.557612 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:55.557539 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5f4s2"] Jul 02 15:30:55.559587 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:55.559568 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-5f4s2" Jul 02 15:30:55.561841 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:55.561814 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 02 15:30:55.561961 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:55.561867 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 02 15:30:55.562344 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:55.562323 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-lfm2q\"" Jul 02 15:30:55.568524 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:55.568502 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5f4s2"] Jul 02 15:30:55.615434 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:55.615405 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/acb70e2f-1e5f-40fe-a41a-4d85abde5fbc-bound-sa-token\") pod \"cert-manager-55b4d954d5-5f4s2\" (UID: \"acb70e2f-1e5f-40fe-a41a-4d85abde5fbc\") " pod="cert-manager/cert-manager-55b4d954d5-5f4s2" Jul 02 15:30:55.615580 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:55.615438 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx4gc\" (UniqueName: \"kubernetes.io/projected/acb70e2f-1e5f-40fe-a41a-4d85abde5fbc-kube-api-access-tx4gc\") pod \"cert-manager-55b4d954d5-5f4s2\" (UID: \"acb70e2f-1e5f-40fe-a41a-4d85abde5fbc\") " pod="cert-manager/cert-manager-55b4d954d5-5f4s2" Jul 02 15:30:55.716034 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:55.716002 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx4gc\" (UniqueName: \"kubernetes.io/projected/acb70e2f-1e5f-40fe-a41a-4d85abde5fbc-kube-api-access-tx4gc\") pod \"cert-manager-55b4d954d5-5f4s2\" (UID: \"acb70e2f-1e5f-40fe-a41a-4d85abde5fbc\") " pod="cert-manager/cert-manager-55b4d954d5-5f4s2" Jul 02 15:30:55.716229 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:55.716122 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/acb70e2f-1e5f-40fe-a41a-4d85abde5fbc-bound-sa-token\") pod \"cert-manager-55b4d954d5-5f4s2\" (UID: \"acb70e2f-1e5f-40fe-a41a-4d85abde5fbc\") " pod="cert-manager/cert-manager-55b4d954d5-5f4s2" Jul 02 15:30:55.724857 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:55.724823 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/acb70e2f-1e5f-40fe-a41a-4d85abde5fbc-bound-sa-token\") pod \"cert-manager-55b4d954d5-5f4s2\" (UID: \"acb70e2f-1e5f-40fe-a41a-4d85abde5fbc\") " pod="cert-manager/cert-manager-55b4d954d5-5f4s2" Jul 02 15:30:55.724990 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:55.724963 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx4gc\" (UniqueName: \"kubernetes.io/projected/acb70e2f-1e5f-40fe-a41a-4d85abde5fbc-kube-api-access-tx4gc\") pod \"cert-manager-55b4d954d5-5f4s2\" (UID: \"acb70e2f-1e5f-40fe-a41a-4d85abde5fbc\") " pod="cert-manager/cert-manager-55b4d954d5-5f4s2" Jul 02 15:30:55.876325 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:55.876294 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-5f4s2" Jul 02 15:30:56.002408 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:56.002380 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5f4s2"] Jul 02 15:30:56.004695 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:30:56.004663 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podacb70e2f_1e5f_40fe_a41a_4d85abde5fbc.slice/crio-76b772651893bdfd5df016b99be8cb12fc41d0b62da4704f9f51e21a5859f135 WatchSource:0}: Error finding container 76b772651893bdfd5df016b99be8cb12fc41d0b62da4704f9f51e21a5859f135: Status 404 returned error can't find the container with id 76b772651893bdfd5df016b99be8cb12fc41d0b62da4704f9f51e21a5859f135 Jul 02 15:30:57.000602 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:30:57.000557 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-5f4s2" event={"ID":"acb70e2f-1e5f-40fe-a41a-4d85abde5fbc","Type":"ContainerStarted","Data":"76b772651893bdfd5df016b99be8cb12fc41d0b62da4704f9f51e21a5859f135"} Jul 02 15:31:00.015594 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:00.015557 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-5f4s2" event={"ID":"acb70e2f-1e5f-40fe-a41a-4d85abde5fbc","Type":"ContainerStarted","Data":"b36c543c3e01a02cc53f980f0bdaf746fd74a0ea0a3ac0bf93dee174b144fb7f"} Jul 02 15:31:00.030803 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:00.030758 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-5f4s2" podStartSLOduration=1.719394827 podStartE2EDuration="5.030741932s" totalImagesPullingTime="3.311347105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:31:00.029880509 +0000 UTC m=+271.659841360" watchObservedRunningTime="2026-07-02 15:31:00.030741932 +0000 UTC m=+271.660702783" Jul 02 15:31:00.516718 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:00.516678 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:01.801233 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:01.801201 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:06.744549 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:06.744518 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:06.857687 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:06.857653 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:08.837009 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:08.836977 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:13.129615 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:13.129575 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:14.959350 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:14.959319 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:20.469762 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:20.469719 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:20.624430 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:20.624391 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:21.077783 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.077747 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:21.349927 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.349824 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:21.401249 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.401219 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d66c884b7-b8pds"] Jul 02 15:31:21.404238 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.404222 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-b8pds" Jul 02 15:31:21.409370 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.409348 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 15:31:21.410749 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.410394 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fhrwk\"" Jul 02 15:31:21.410993 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.410969 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 15:31:21.411256 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.411239 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 15:31:21.411334 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.411267 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 15:31:21.451479 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.451451 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d66c884b7-b8pds"] Jul 02 15:31:21.459503 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.459462 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:21.512704 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.512668 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1de9a322-128a-4b24-9a6f-cbd75f3d46d3-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d66c884b7-b8pds\" (UID: \"1de9a322-128a-4b24-9a6f-cbd75f3d46d3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-b8pds" Jul 02 15:31:21.513071 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.512709 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1de9a322-128a-4b24-9a6f-cbd75f3d46d3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d66c884b7-b8pds\" (UID: \"1de9a322-128a-4b24-9a6f-cbd75f3d46d3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-b8pds" Jul 02 15:31:21.513071 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.512746 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7wxt\" (UniqueName: \"kubernetes.io/projected/1de9a322-128a-4b24-9a6f-cbd75f3d46d3-kube-api-access-x7wxt\") pod \"opendatahub-operator-controller-manager-6d66c884b7-b8pds\" (UID: \"1de9a322-128a-4b24-9a6f-cbd75f3d46d3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-b8pds" Jul 02 15:31:21.513071 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.512809 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1de9a322-128a-4b24-9a6f-cbd75f3d46d3-tmp\") pod \"opendatahub-operator-controller-manager-6d66c884b7-b8pds\" (UID: \"1de9a322-128a-4b24-9a6f-cbd75f3d46d3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-b8pds" Jul 02 15:31:21.513071 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.512851 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1de9a322-128a-4b24-9a6f-cbd75f3d46d3-manifests\") pod \"opendatahub-operator-controller-manager-6d66c884b7-b8pds\" (UID: \"1de9a322-128a-4b24-9a6f-cbd75f3d46d3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-b8pds" Jul 02 15:31:21.614017 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.613986 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1de9a322-128a-4b24-9a6f-cbd75f3d46d3-tmp\") pod \"opendatahub-operator-controller-manager-6d66c884b7-b8pds\" (UID: \"1de9a322-128a-4b24-9a6f-cbd75f3d46d3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-b8pds" Jul 02 15:31:21.614184 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.614026 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1de9a322-128a-4b24-9a6f-cbd75f3d46d3-manifests\") pod \"opendatahub-operator-controller-manager-6d66c884b7-b8pds\" (UID: \"1de9a322-128a-4b24-9a6f-cbd75f3d46d3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-b8pds" Jul 02 15:31:21.614184 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.614062 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1de9a322-128a-4b24-9a6f-cbd75f3d46d3-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d66c884b7-b8pds\" (UID: \"1de9a322-128a-4b24-9a6f-cbd75f3d46d3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-b8pds" Jul 02 15:31:21.614184 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.614093 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1de9a322-128a-4b24-9a6f-cbd75f3d46d3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d66c884b7-b8pds\" (UID: \"1de9a322-128a-4b24-9a6f-cbd75f3d46d3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-b8pds" Jul 02 15:31:21.614184 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.614133 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7wxt\" (UniqueName: \"kubernetes.io/projected/1de9a322-128a-4b24-9a6f-cbd75f3d46d3-kube-api-access-x7wxt\") pod \"opendatahub-operator-controller-manager-6d66c884b7-b8pds\" (UID: \"1de9a322-128a-4b24-9a6f-cbd75f3d46d3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-b8pds" Jul 02 15:31:21.614463 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.614440 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1de9a322-128a-4b24-9a6f-cbd75f3d46d3-manifests\") pod \"opendatahub-operator-controller-manager-6d66c884b7-b8pds\" (UID: \"1de9a322-128a-4b24-9a6f-cbd75f3d46d3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-b8pds" Jul 02 15:31:21.616346 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.616318 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1de9a322-128a-4b24-9a6f-cbd75f3d46d3-tmp\") pod \"opendatahub-operator-controller-manager-6d66c884b7-b8pds\" (UID: \"1de9a322-128a-4b24-9a6f-cbd75f3d46d3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-b8pds" Jul 02 15:31:21.616551 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.616533 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1de9a322-128a-4b24-9a6f-cbd75f3d46d3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d66c884b7-b8pds\" (UID: \"1de9a322-128a-4b24-9a6f-cbd75f3d46d3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-b8pds" Jul 02 15:31:21.616591 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.616566 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1de9a322-128a-4b24-9a6f-cbd75f3d46d3-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d66c884b7-b8pds\" (UID: \"1de9a322-128a-4b24-9a6f-cbd75f3d46d3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-b8pds" Jul 02 15:31:21.624802 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.624750 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7wxt\" (UniqueName: \"kubernetes.io/projected/1de9a322-128a-4b24-9a6f-cbd75f3d46d3-kube-api-access-x7wxt\") pod \"opendatahub-operator-controller-manager-6d66c884b7-b8pds\" (UID: \"1de9a322-128a-4b24-9a6f-cbd75f3d46d3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-b8pds" Jul 02 15:31:21.645393 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.645367 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:21.714300 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.714272 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-b8pds" Jul 02 15:31:21.746562 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.746534 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:21.847254 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.847224 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:21.855918 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.853007 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d66c884b7-b8pds"] Jul 02 15:31:21.859796 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:31:21.859768 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1de9a322_128a_4b24_9a6f_cbd75f3d46d3.slice/crio-63794621b8f773ae922415412becb40f07aee872b8cf363d3f240bbe5103d375 WatchSource:0}: Error finding container 63794621b8f773ae922415412becb40f07aee872b8cf363d3f240bbe5103d375: Status 404 returned error can't find the container with id 63794621b8f773ae922415412becb40f07aee872b8cf363d3f240bbe5103d375 Jul 02 15:31:21.946346 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:21.946311 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:22.046579 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:22.046544 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:22.099835 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:22.099803 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-b8pds" event={"ID":"1de9a322-128a-4b24-9a6f-cbd75f3d46d3","Type":"ContainerStarted","Data":"63794621b8f773ae922415412becb40f07aee872b8cf363d3f240bbe5103d375"} Jul 02 15:31:22.146728 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:22.146648 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:25.113628 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:25.113594 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-b8pds" event={"ID":"1de9a322-128a-4b24-9a6f-cbd75f3d46d3","Type":"ContainerStarted","Data":"201d1a560d005589c2686f0a7fae444d35abcc4417d47bbc26caa7d33c58b708"} Jul 02 15:31:26.118943 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:26.118913 2578 generic.go:356] "Generic (PLEG): container finished" podID="1de9a322-128a-4b24-9a6f-cbd75f3d46d3" containerID="201d1a560d005589c2686f0a7fae444d35abcc4417d47bbc26caa7d33c58b708" exitCode=0 Jul 02 15:31:26.119292 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:26.118964 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-b8pds" event={"ID":"1de9a322-128a-4b24-9a6f-cbd75f3d46d3","Type":"ContainerDied","Data":"201d1a560d005589c2686f0a7fae444d35abcc4417d47bbc26caa7d33c58b708"} Jul 02 15:31:27.124340 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:27.124301 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-b8pds" event={"ID":"1de9a322-128a-4b24-9a6f-cbd75f3d46d3","Type":"ContainerStarted","Data":"f301655e942b2c81b92b31155578bc06a466e4aee8d3c34f68ac1d09aa69c362"} Jul 02 15:31:27.124721 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:27.124439 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-b8pds" Jul 02 15:31:27.145908 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:27.145853 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-b8pds" podStartSLOduration=1.674071605 podStartE2EDuration="6.145838356s" totalImagesPullingTime="3.414241801s" totalInitContainerRuntime="1.05752495s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:31:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:31:27.144784026 +0000 UTC m=+298.774744923" watchObservedRunningTime="2026-07-02 15:31:27.145838356 +0000 UTC m=+298.775799208" Jul 02 15:31:28.770565 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:28.770536 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2pztp_9a21b8b7-cc97-4782-aa1f-1ebd124c2987/ovn-acl-logging/0.log" Jul 02 15:31:28.772772 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:28.772754 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2pztp_9a21b8b7-cc97-4782-aa1f-1ebd124c2987/ovn-acl-logging/0.log" Jul 02 15:31:28.773392 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:28.773376 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 15:31:34.664590 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:34.664558 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:34.749390 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:34.749352 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:38.129764 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:38.129729 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-b8pds" Jul 02 15:31:40.740201 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:40.740169 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:40.872811 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:40.872778 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:41.518481 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:41.518448 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:41.620459 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:41.620420 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:41.717768 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:41.717736 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:41.817546 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:41.817469 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:42.044344 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:42.044303 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-dshtn"] Jul 02 15:31:42.046985 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:42.046963 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-dshtn" Jul 02 15:31:42.049117 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:42.049099 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 02 15:31:42.064682 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:42.064646 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-dshtn"] Jul 02 15:31:42.089159 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:42.089094 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:42.188745 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:42.188716 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qddmk\" (UniqueName: \"kubernetes.io/projected/d7138dfd-4467-4caf-b4d6-2ea79d88ce9c-kube-api-access-qddmk\") pod \"model-serving-api-54d89bd5fc-dshtn\" (UID: \"d7138dfd-4467-4caf-b4d6-2ea79d88ce9c\") " pod="opendatahub/model-serving-api-54d89bd5fc-dshtn" Jul 02 15:31:42.188934 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:42.188779 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7138dfd-4467-4caf-b4d6-2ea79d88ce9c-tls-certs\") pod \"model-serving-api-54d89bd5fc-dshtn\" (UID: \"d7138dfd-4467-4caf-b4d6-2ea79d88ce9c\") " pod="opendatahub/model-serving-api-54d89bd5fc-dshtn" Jul 02 15:31:42.264174 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:42.264142 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:42.289876 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:42.289845 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7138dfd-4467-4caf-b4d6-2ea79d88ce9c-tls-certs\") pod \"model-serving-api-54d89bd5fc-dshtn\" (UID: \"d7138dfd-4467-4caf-b4d6-2ea79d88ce9c\") " pod="opendatahub/model-serving-api-54d89bd5fc-dshtn" Jul 02 15:31:42.290044 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:42.289940 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qddmk\" (UniqueName: \"kubernetes.io/projected/d7138dfd-4467-4caf-b4d6-2ea79d88ce9c-kube-api-access-qddmk\") pod \"model-serving-api-54d89bd5fc-dshtn\" (UID: \"d7138dfd-4467-4caf-b4d6-2ea79d88ce9c\") " pod="opendatahub/model-serving-api-54d89bd5fc-dshtn" Jul 02 15:31:42.292185 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:42.292156 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7138dfd-4467-4caf-b4d6-2ea79d88ce9c-tls-certs\") pod \"model-serving-api-54d89bd5fc-dshtn\" (UID: \"d7138dfd-4467-4caf-b4d6-2ea79d88ce9c\") " pod="opendatahub/model-serving-api-54d89bd5fc-dshtn" Jul 02 15:31:42.298499 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:42.298476 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qddmk\" (UniqueName: \"kubernetes.io/projected/d7138dfd-4467-4caf-b4d6-2ea79d88ce9c-kube-api-access-qddmk\") pod \"model-serving-api-54d89bd5fc-dshtn\" (UID: \"d7138dfd-4467-4caf-b4d6-2ea79d88ce9c\") " pod="opendatahub/model-serving-api-54d89bd5fc-dshtn" Jul 02 15:31:42.364380 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:42.364343 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-dshtn" Jul 02 15:31:42.492203 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:42.492147 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-dshtn"] Jul 02 15:31:42.495583 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:31:42.495551 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7138dfd_4467_4caf_b4d6_2ea79d88ce9c.slice/crio-917dd16616653116b49fc8a37e7aac67db421d3a02c5ed163143f5187782b011 WatchSource:0}: Error finding container 917dd16616653116b49fc8a37e7aac67db421d3a02c5ed163143f5187782b011: Status 404 returned error can't find the container with id 917dd16616653116b49fc8a37e7aac67db421d3a02c5ed163143f5187782b011 Jul 02 15:31:42.497607 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:42.497581 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 15:31:43.185054 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:43.185012 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-dshtn" event={"ID":"d7138dfd-4467-4caf-b4d6-2ea79d88ce9c","Type":"ContainerStarted","Data":"917dd16616653116b49fc8a37e7aac67db421d3a02c5ed163143f5187782b011"} Jul 02 15:31:44.228859 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:44.228823 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:44.287458 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:44.287427 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-655c797d79-kqr8k"] Jul 02 15:31:44.290295 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:44.290275 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-655c797d79-kqr8k" Jul 02 15:31:44.292498 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:44.292470 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 02 15:31:44.293504 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:44.293483 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 15:31:44.294053 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:44.293887 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 02 15:31:44.294053 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:44.293916 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 15:31:44.294053 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:44.294027 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zt949\"" Jul 02 15:31:44.300816 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:44.300793 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-655c797d79-kqr8k"] Jul 02 15:31:44.392945 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:44.392910 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:44.408223 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:44.408195 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23d445b9-5e3c-4ca1-a1e8-5d22a486b73b-tls-certs\") pod \"kube-auth-proxy-655c797d79-kqr8k\" (UID: \"23d445b9-5e3c-4ca1-a1e8-5d22a486b73b\") " pod="openshift-ingress/kube-auth-proxy-655c797d79-kqr8k" Jul 02 15:31:44.408351 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:44.408230 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23d445b9-5e3c-4ca1-a1e8-5d22a486b73b-tmp\") pod \"kube-auth-proxy-655c797d79-kqr8k\" (UID: \"23d445b9-5e3c-4ca1-a1e8-5d22a486b73b\") " pod="openshift-ingress/kube-auth-proxy-655c797d79-kqr8k" Jul 02 15:31:44.408351 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:44.408266 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkkhs\" (UniqueName: \"kubernetes.io/projected/23d445b9-5e3c-4ca1-a1e8-5d22a486b73b-kube-api-access-wkkhs\") pod \"kube-auth-proxy-655c797d79-kqr8k\" (UID: \"23d445b9-5e3c-4ca1-a1e8-5d22a486b73b\") " pod="openshift-ingress/kube-auth-proxy-655c797d79-kqr8k" Jul 02 15:31:44.509488 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:44.509413 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23d445b9-5e3c-4ca1-a1e8-5d22a486b73b-tls-certs\") pod \"kube-auth-proxy-655c797d79-kqr8k\" (UID: \"23d445b9-5e3c-4ca1-a1e8-5d22a486b73b\") " pod="openshift-ingress/kube-auth-proxy-655c797d79-kqr8k" Jul 02 15:31:44.509488 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:44.509448 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23d445b9-5e3c-4ca1-a1e8-5d22a486b73b-tmp\") pod \"kube-auth-proxy-655c797d79-kqr8k\" (UID: \"23d445b9-5e3c-4ca1-a1e8-5d22a486b73b\") " pod="openshift-ingress/kube-auth-proxy-655c797d79-kqr8k" Jul 02 15:31:44.509488 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:44.509473 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkkhs\" (UniqueName: \"kubernetes.io/projected/23d445b9-5e3c-4ca1-a1e8-5d22a486b73b-kube-api-access-wkkhs\") pod \"kube-auth-proxy-655c797d79-kqr8k\" (UID: \"23d445b9-5e3c-4ca1-a1e8-5d22a486b73b\") " pod="openshift-ingress/kube-auth-proxy-655c797d79-kqr8k" Jul 02 15:31:44.511682 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:44.511660 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23d445b9-5e3c-4ca1-a1e8-5d22a486b73b-tmp\") pod \"kube-auth-proxy-655c797d79-kqr8k\" (UID: \"23d445b9-5e3c-4ca1-a1e8-5d22a486b73b\") " pod="openshift-ingress/kube-auth-proxy-655c797d79-kqr8k" Jul 02 15:31:44.511791 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:44.511747 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23d445b9-5e3c-4ca1-a1e8-5d22a486b73b-tls-certs\") pod \"kube-auth-proxy-655c797d79-kqr8k\" (UID: \"23d445b9-5e3c-4ca1-a1e8-5d22a486b73b\") " pod="openshift-ingress/kube-auth-proxy-655c797d79-kqr8k" Jul 02 15:31:44.520949 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:44.520925 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkkhs\" (UniqueName: \"kubernetes.io/projected/23d445b9-5e3c-4ca1-a1e8-5d22a486b73b-kube-api-access-wkkhs\") pod \"kube-auth-proxy-655c797d79-kqr8k\" (UID: \"23d445b9-5e3c-4ca1-a1e8-5d22a486b73b\") " pod="openshift-ingress/kube-auth-proxy-655c797d79-kqr8k" Jul 02 15:31:44.603696 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:44.603669 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-655c797d79-kqr8k" Jul 02 15:31:44.731563 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:44.731529 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-655c797d79-kqr8k"] Jul 02 15:31:44.734734 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:31:44.734707 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23d445b9_5e3c_4ca1_a1e8_5d22a486b73b.slice/crio-ee454d65c9c6805cdb028cbb8037542230d414d1cc2b0ac1514209f81f9698c1 WatchSource:0}: Error finding container ee454d65c9c6805cdb028cbb8037542230d414d1cc2b0ac1514209f81f9698c1: Status 404 returned error can't find the container with id ee454d65c9c6805cdb028cbb8037542230d414d1cc2b0ac1514209f81f9698c1 Jul 02 15:31:45.195051 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.195016 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-dshtn" event={"ID":"d7138dfd-4467-4caf-b4d6-2ea79d88ce9c","Type":"ContainerStarted","Data":"53028b0886d2a99201ee34de94df6853212a2390ba231dce638373f32f776d16"} Jul 02 15:31:45.195252 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.195096 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-dshtn" Jul 02 15:31:45.196363 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.196341 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-655c797d79-kqr8k" event={"ID":"23d445b9-5e3c-4ca1-a1e8-5d22a486b73b","Type":"ContainerStarted","Data":"ee454d65c9c6805cdb028cbb8037542230d414d1cc2b0ac1514209f81f9698c1"} Jul 02 15:31:45.220477 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.220430 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-dshtn" podStartSLOduration=1.184214314 podStartE2EDuration="3.220413823s" totalImagesPullingTime="2.036199509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:31:45.219965621 +0000 UTC m=+316.849926500" watchObservedRunningTime="2026-07-02 15:31:45.220413823 +0000 UTC m=+316.850374674" Jul 02 15:31:45.610654 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.610614 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6"] Jul 02 15:31:45.612851 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.612833 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" Jul 02 15:31:45.614941 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.614916 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 02 15:31:45.615055 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.614917 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kfs98\"" Jul 02 15:31:45.615055 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.615024 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 02 15:31:45.615055 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.614951 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 02 15:31:45.615055 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.614923 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 02 15:31:45.624194 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.624175 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:45.635383 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.635355 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6"] Jul 02 15:31:45.689473 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.689441 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:45.719678 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.719645 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5c6b6c7-0aef-4766-89ac-79312246fa08-istio-token\") pod \"istiod-openshift-gateway-7574459656-pw8t6\" (UID: \"c5c6b6c7-0aef-4766-89ac-79312246fa08\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" Jul 02 15:31:45.719857 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.719683 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5c6b6c7-0aef-4766-89ac-79312246fa08-local-certs\") pod \"istiod-openshift-gateway-7574459656-pw8t6\" (UID: \"c5c6b6c7-0aef-4766-89ac-79312246fa08\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" Jul 02 15:31:45.719857 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.719725 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c5c6b6c7-0aef-4766-89ac-79312246fa08-cacerts\") pod \"istiod-openshift-gateway-7574459656-pw8t6\" (UID: \"c5c6b6c7-0aef-4766-89ac-79312246fa08\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" Jul 02 15:31:45.719857 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.719766 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5c6b6c7-0aef-4766-89ac-79312246fa08-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-pw8t6\" (UID: \"c5c6b6c7-0aef-4766-89ac-79312246fa08\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" Jul 02 15:31:45.719857 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.719792 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5c6b6c7-0aef-4766-89ac-79312246fa08-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-pw8t6\" (UID: \"c5c6b6c7-0aef-4766-89ac-79312246fa08\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" Jul 02 15:31:45.720110 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.719879 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5c6b6c7-0aef-4766-89ac-79312246fa08-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-pw8t6\" (UID: \"c5c6b6c7-0aef-4766-89ac-79312246fa08\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" Jul 02 15:31:45.720110 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.719939 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb22x\" (UniqueName: \"kubernetes.io/projected/c5c6b6c7-0aef-4766-89ac-79312246fa08-kube-api-access-wb22x\") pod \"istiod-openshift-gateway-7574459656-pw8t6\" (UID: \"c5c6b6c7-0aef-4766-89ac-79312246fa08\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" Jul 02 15:31:45.820428 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.820382 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5c6b6c7-0aef-4766-89ac-79312246fa08-istio-token\") pod \"istiod-openshift-gateway-7574459656-pw8t6\" (UID: \"c5c6b6c7-0aef-4766-89ac-79312246fa08\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" Jul 02 15:31:45.820428 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.820434 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5c6b6c7-0aef-4766-89ac-79312246fa08-local-certs\") pod \"istiod-openshift-gateway-7574459656-pw8t6\" (UID: \"c5c6b6c7-0aef-4766-89ac-79312246fa08\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" Jul 02 15:31:45.820677 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.820472 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c5c6b6c7-0aef-4766-89ac-79312246fa08-cacerts\") pod \"istiod-openshift-gateway-7574459656-pw8t6\" (UID: \"c5c6b6c7-0aef-4766-89ac-79312246fa08\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" Jul 02 15:31:45.820677 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.820519 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5c6b6c7-0aef-4766-89ac-79312246fa08-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-pw8t6\" (UID: \"c5c6b6c7-0aef-4766-89ac-79312246fa08\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" Jul 02 15:31:45.820677 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.820548 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5c6b6c7-0aef-4766-89ac-79312246fa08-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-pw8t6\" (UID: \"c5c6b6c7-0aef-4766-89ac-79312246fa08\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" Jul 02 15:31:45.820677 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.820580 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5c6b6c7-0aef-4766-89ac-79312246fa08-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-pw8t6\" (UID: \"c5c6b6c7-0aef-4766-89ac-79312246fa08\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" Jul 02 15:31:45.820677 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.820611 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb22x\" (UniqueName: \"kubernetes.io/projected/c5c6b6c7-0aef-4766-89ac-79312246fa08-kube-api-access-wb22x\") pod \"istiod-openshift-gateway-7574459656-pw8t6\" (UID: \"c5c6b6c7-0aef-4766-89ac-79312246fa08\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" Jul 02 15:31:45.821525 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.821494 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5c6b6c7-0aef-4766-89ac-79312246fa08-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-pw8t6\" (UID: \"c5c6b6c7-0aef-4766-89ac-79312246fa08\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" Jul 02 15:31:45.823681 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.823642 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5c6b6c7-0aef-4766-89ac-79312246fa08-local-certs\") pod \"istiod-openshift-gateway-7574459656-pw8t6\" (UID: \"c5c6b6c7-0aef-4766-89ac-79312246fa08\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" Jul 02 15:31:45.823859 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.823840 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5c6b6c7-0aef-4766-89ac-79312246fa08-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-pw8t6\" (UID: \"c5c6b6c7-0aef-4766-89ac-79312246fa08\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" Jul 02 15:31:45.823956 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.823926 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c5c6b6c7-0aef-4766-89ac-79312246fa08-cacerts\") pod \"istiod-openshift-gateway-7574459656-pw8t6\" (UID: \"c5c6b6c7-0aef-4766-89ac-79312246fa08\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" Jul 02 15:31:45.824003 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.823945 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5c6b6c7-0aef-4766-89ac-79312246fa08-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-pw8t6\" (UID: \"c5c6b6c7-0aef-4766-89ac-79312246fa08\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" Jul 02 15:31:45.829563 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.829540 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5c6b6c7-0aef-4766-89ac-79312246fa08-istio-token\") pod \"istiod-openshift-gateway-7574459656-pw8t6\" (UID: \"c5c6b6c7-0aef-4766-89ac-79312246fa08\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" Jul 02 15:31:45.829797 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.829762 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb22x\" (UniqueName: \"kubernetes.io/projected/c5c6b6c7-0aef-4766-89ac-79312246fa08-kube-api-access-wb22x\") pod \"istiod-openshift-gateway-7574459656-pw8t6\" (UID: \"c5c6b6c7-0aef-4766-89ac-79312246fa08\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" Jul 02 15:31:45.922014 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:45.921937 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" Jul 02 15:31:46.064734 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:46.064696 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6"] Jul 02 15:31:46.068227 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:31:46.068199 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5c6b6c7_0aef_4766_89ac_79312246fa08.slice/crio-e825268eeb867aa635032b3fa43a4fee6fc82db2590b1d59d8fdd8a2232766c2 WatchSource:0}: Error finding container e825268eeb867aa635032b3fa43a4fee6fc82db2590b1d59d8fdd8a2232766c2: Status 404 returned error can't find the container with id e825268eeb867aa635032b3fa43a4fee6fc82db2590b1d59d8fdd8a2232766c2 Jul 02 15:31:46.203073 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:46.202973 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" event={"ID":"c5c6b6c7-0aef-4766-89ac-79312246fa08","Type":"ContainerStarted","Data":"e825268eeb867aa635032b3fa43a4fee6fc82db2590b1d59d8fdd8a2232766c2"} Jul 02 15:31:46.609566 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:46.609520 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:49.254575 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:49.254540 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 15:31:49.254942 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:49.254621 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 15:31:49.872903 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:49.872855 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-578857ff64-r292d"] Jul 02 15:31:49.875043 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:49.875026 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-578857ff64-r292d" Jul 02 15:31:49.891256 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:49.891230 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 02 15:31:49.891535 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:49.891511 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 02 15:31:49.891749 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:49.891731 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 02 15:31:49.891863 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:49.891754 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vppxt\"" Jul 02 15:31:49.891863 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:49.891815 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 02 15:31:49.892058 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:49.892045 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 02 15:31:49.921312 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:49.921289 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-578857ff64-r292d"] Jul 02 15:31:50.057417 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:50.057380 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea88b191-cee6-4b6e-8ac9-b659ff43ee8f-cert\") pod \"lws-controller-manager-578857ff64-r292d\" (UID: \"ea88b191-cee6-4b6e-8ac9-b659ff43ee8f\") " pod="openshift-lws-operator/lws-controller-manager-578857ff64-r292d" Jul 02 15:31:50.057626 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:50.057442 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ea88b191-cee6-4b6e-8ac9-b659ff43ee8f-manager-config\") pod \"lws-controller-manager-578857ff64-r292d\" (UID: \"ea88b191-cee6-4b6e-8ac9-b659ff43ee8f\") " pod="openshift-lws-operator/lws-controller-manager-578857ff64-r292d" Jul 02 15:31:50.057626 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:50.057506 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ea88b191-cee6-4b6e-8ac9-b659ff43ee8f-metrics-cert\") pod \"lws-controller-manager-578857ff64-r292d\" (UID: \"ea88b191-cee6-4b6e-8ac9-b659ff43ee8f\") " pod="openshift-lws-operator/lws-controller-manager-578857ff64-r292d" Jul 02 15:31:50.057626 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:50.057611 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzwpj\" (UniqueName: \"kubernetes.io/projected/ea88b191-cee6-4b6e-8ac9-b659ff43ee8f-kube-api-access-gzwpj\") pod \"lws-controller-manager-578857ff64-r292d\" (UID: \"ea88b191-cee6-4b6e-8ac9-b659ff43ee8f\") " pod="openshift-lws-operator/lws-controller-manager-578857ff64-r292d" Jul 02 15:31:50.158789 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:50.158703 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea88b191-cee6-4b6e-8ac9-b659ff43ee8f-cert\") pod \"lws-controller-manager-578857ff64-r292d\" (UID: \"ea88b191-cee6-4b6e-8ac9-b659ff43ee8f\") " pod="openshift-lws-operator/lws-controller-manager-578857ff64-r292d" Jul 02 15:31:50.158789 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:50.158764 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ea88b191-cee6-4b6e-8ac9-b659ff43ee8f-manager-config\") pod \"lws-controller-manager-578857ff64-r292d\" (UID: \"ea88b191-cee6-4b6e-8ac9-b659ff43ee8f\") " pod="openshift-lws-operator/lws-controller-manager-578857ff64-r292d" Jul 02 15:31:50.158789 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:50.158788 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ea88b191-cee6-4b6e-8ac9-b659ff43ee8f-metrics-cert\") pod \"lws-controller-manager-578857ff64-r292d\" (UID: \"ea88b191-cee6-4b6e-8ac9-b659ff43ee8f\") " pod="openshift-lws-operator/lws-controller-manager-578857ff64-r292d" Jul 02 15:31:50.159113 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:50.158820 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzwpj\" (UniqueName: \"kubernetes.io/projected/ea88b191-cee6-4b6e-8ac9-b659ff43ee8f-kube-api-access-gzwpj\") pod \"lws-controller-manager-578857ff64-r292d\" (UID: \"ea88b191-cee6-4b6e-8ac9-b659ff43ee8f\") " pod="openshift-lws-operator/lws-controller-manager-578857ff64-r292d" Jul 02 15:31:50.159574 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:50.159549 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ea88b191-cee6-4b6e-8ac9-b659ff43ee8f-manager-config\") pod \"lws-controller-manager-578857ff64-r292d\" (UID: \"ea88b191-cee6-4b6e-8ac9-b659ff43ee8f\") " pod="openshift-lws-operator/lws-controller-manager-578857ff64-r292d" Jul 02 15:31:50.161324 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:50.161293 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea88b191-cee6-4b6e-8ac9-b659ff43ee8f-cert\") pod \"lws-controller-manager-578857ff64-r292d\" (UID: \"ea88b191-cee6-4b6e-8ac9-b659ff43ee8f\") " pod="openshift-lws-operator/lws-controller-manager-578857ff64-r292d" Jul 02 15:31:50.161465 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:50.161443 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ea88b191-cee6-4b6e-8ac9-b659ff43ee8f-metrics-cert\") pod \"lws-controller-manager-578857ff64-r292d\" (UID: \"ea88b191-cee6-4b6e-8ac9-b659ff43ee8f\") " pod="openshift-lws-operator/lws-controller-manager-578857ff64-r292d" Jul 02 15:31:50.166442 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:50.166419 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzwpj\" (UniqueName: \"kubernetes.io/projected/ea88b191-cee6-4b6e-8ac9-b659ff43ee8f-kube-api-access-gzwpj\") pod \"lws-controller-manager-578857ff64-r292d\" (UID: \"ea88b191-cee6-4b6e-8ac9-b659ff43ee8f\") " pod="openshift-lws-operator/lws-controller-manager-578857ff64-r292d" Jul 02 15:31:50.184222 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:50.184204 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-578857ff64-r292d" Jul 02 15:31:50.225553 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:50.225515 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-655c797d79-kqr8k" event={"ID":"23d445b9-5e3c-4ca1-a1e8-5d22a486b73b","Type":"ContainerStarted","Data":"b463504dfcf5d1385ca7e7a1b7c166dccfbc4b0cf77e643726d21ab164d8a5c2"} Jul 02 15:31:50.227279 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:50.227247 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" event={"ID":"c5c6b6c7-0aef-4766-89ac-79312246fa08","Type":"ContainerStarted","Data":"34e457740611f00b8e714ab0f7502f24e2b9c4d218fd969c632d1fb0badb65b7"} Jul 02 15:31:50.227491 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:50.227474 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" Jul 02 15:31:50.229455 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:50.229431 2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-pw8t6 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 02 15:31:50.229561 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:50.229480 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" podUID="c5c6b6c7-0aef-4766-89ac-79312246fa08" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 15:31:50.249703 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:50.249463 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-655c797d79-kqr8k" podStartSLOduration=1.7326025170000001 podStartE2EDuration="6.249442142s" totalImagesPullingTime="4.516839625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:31:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:31:50.248422583 +0000 UTC m=+321.878383457" watchObservedRunningTime="2026-07-02 15:31:50.249442142 +0000 UTC m=+321.879402997" Jul 02 15:31:50.280871 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:50.280745 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" podStartSLOduration=2.097100949 podStartE2EDuration="5.28072197s" totalImagesPullingTime="3.183621021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:31:50.276677982 +0000 UTC m=+321.906638834" watchObservedRunningTime="2026-07-02 15:31:50.28072197 +0000 UTC m=+321.910682823" Jul 02 15:31:50.346363 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:50.346277 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-578857ff64-r292d"] Jul 02 15:31:50.348448 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:31:50.348421 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea88b191_cee6_4b6e_8ac9_b659ff43ee8f.slice/crio-a3784f08129076713411a3c1d62c10d7ff9fcf1edb55d7b25cf19371536fd441 WatchSource:0}: Error finding container a3784f08129076713411a3c1d62c10d7ff9fcf1edb55d7b25cf19371536fd441: Status 404 returned error can't find the container with id a3784f08129076713411a3c1d62c10d7ff9fcf1edb55d7b25cf19371536fd441 Jul 02 15:31:50.550220 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:50.550144 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:50.725141 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:50.725100 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:51.233481 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:51.233450 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-578857ff64-r292d" event={"ID":"ea88b191-cee6-4b6e-8ac9-b659ff43ee8f","Type":"ContainerStarted","Data":"a3784f08129076713411a3c1d62c10d7ff9fcf1edb55d7b25cf19371536fd441"} Jul 02 15:31:51.234285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:51.234256 2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-pw8t6 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 02 15:31:51.234410 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:51.234323 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" podUID="c5c6b6c7-0aef-4766-89ac-79312246fa08" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 15:31:51.780018 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:51.779924 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:52.005229 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:52.005153 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:52.250032 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:52.250001 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:52.357070 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:52.356995 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:52.467793 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:52.467752 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:52.784325 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:52.784285 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:52.886588 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:52.886554 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:53.244200 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:53.244169 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-578857ff64-r292d" event={"ID":"ea88b191-cee6-4b6e-8ac9-b659ff43ee8f","Type":"ContainerStarted","Data":"55a21103c314c05a5f1b48f080c6675966fd906257a252ee9ea66746a56085d0"} Jul 02 15:31:53.244352 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:53.244294 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-578857ff64-r292d" Jul 02 15:31:53.268136 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:53.268086 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-578857ff64-r292d" podStartSLOduration=1.555512056 podStartE2EDuration="4.268073227s" totalImagesPullingTime="2.712561171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:31:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:31:53.267084421 +0000 UTC m=+324.897045297" watchObservedRunningTime="2026-07-02 15:31:53.268073227 +0000 UTC m=+324.898034079" Jul 02 15:31:53.680079 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:53.680047 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:53.854416 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:53.854387 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:53.983970 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:53.983877 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:31:54.234940 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:54.234853 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" Jul 02 15:31:54.301051 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:54.301025 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6"] Jul 02 15:31:54.301207 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:54.301183 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" podUID="c5c6b6c7-0aef-4766-89ac-79312246fa08" containerName="discovery" containerID="cri-o://34e457740611f00b8e714ab0f7502f24e2b9c4d218fd969c632d1fb0badb65b7" gracePeriod=30 Jul 02 15:31:54.555844 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:54.555817 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" Jul 02 15:31:54.598054 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:54.598030 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c5c6b6c7-0aef-4766-89ac-79312246fa08-cacerts\") pod \"c5c6b6c7-0aef-4766-89ac-79312246fa08\" (UID: \"c5c6b6c7-0aef-4766-89ac-79312246fa08\") " Jul 02 15:31:54.598187 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:54.598078 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5c6b6c7-0aef-4766-89ac-79312246fa08-istio-csr-ca-configmap\") pod \"c5c6b6c7-0aef-4766-89ac-79312246fa08\" (UID: \"c5c6b6c7-0aef-4766-89ac-79312246fa08\") " Jul 02 15:31:54.598187 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:54.598119 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5c6b6c7-0aef-4766-89ac-79312246fa08-local-certs\") pod \"c5c6b6c7-0aef-4766-89ac-79312246fa08\" (UID: \"c5c6b6c7-0aef-4766-89ac-79312246fa08\") " Jul 02 15:31:54.598187 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:54.598162 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5c6b6c7-0aef-4766-89ac-79312246fa08-istio-csr-dns-cert\") pod \"c5c6b6c7-0aef-4766-89ac-79312246fa08\" (UID: \"c5c6b6c7-0aef-4766-89ac-79312246fa08\") " Jul 02 15:31:54.598340 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:54.598190 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wb22x\" (UniqueName: \"kubernetes.io/projected/c5c6b6c7-0aef-4766-89ac-79312246fa08-kube-api-access-wb22x\") pod \"c5c6b6c7-0aef-4766-89ac-79312246fa08\" (UID: \"c5c6b6c7-0aef-4766-89ac-79312246fa08\") " Jul 02 15:31:54.598340 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:54.598232 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5c6b6c7-0aef-4766-89ac-79312246fa08-istio-token\") pod \"c5c6b6c7-0aef-4766-89ac-79312246fa08\" (UID: \"c5c6b6c7-0aef-4766-89ac-79312246fa08\") " Jul 02 15:31:54.598340 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:54.598271 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5c6b6c7-0aef-4766-89ac-79312246fa08-istio-kubeconfig\") pod \"c5c6b6c7-0aef-4766-89ac-79312246fa08\" (UID: \"c5c6b6c7-0aef-4766-89ac-79312246fa08\") " Jul 02 15:31:54.598619 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:54.598569 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5c6b6c7-0aef-4766-89ac-79312246fa08-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "c5c6b6c7-0aef-4766-89ac-79312246fa08" (UID: "c5c6b6c7-0aef-4766-89ac-79312246fa08"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:31:54.600396 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:54.600369 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5c6b6c7-0aef-4766-89ac-79312246fa08-local-certs" (OuterVolumeSpecName: "local-certs") pod "c5c6b6c7-0aef-4766-89ac-79312246fa08" (UID: "c5c6b6c7-0aef-4766-89ac-79312246fa08"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:31:54.600566 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:54.600542 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5c6b6c7-0aef-4766-89ac-79312246fa08-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "c5c6b6c7-0aef-4766-89ac-79312246fa08" (UID: "c5c6b6c7-0aef-4766-89ac-79312246fa08"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:31:54.600701 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:54.600680 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5c6b6c7-0aef-4766-89ac-79312246fa08-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "c5c6b6c7-0aef-4766-89ac-79312246fa08" (UID: "c5c6b6c7-0aef-4766-89ac-79312246fa08"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:31:54.600760 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:54.600695 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5c6b6c7-0aef-4766-89ac-79312246fa08-cacerts" (OuterVolumeSpecName: "cacerts") pod "c5c6b6c7-0aef-4766-89ac-79312246fa08" (UID: "c5c6b6c7-0aef-4766-89ac-79312246fa08"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:31:54.600760 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:54.600710 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5c6b6c7-0aef-4766-89ac-79312246fa08-kube-api-access-wb22x" (OuterVolumeSpecName: "kube-api-access-wb22x") pod "c5c6b6c7-0aef-4766-89ac-79312246fa08" (UID: "c5c6b6c7-0aef-4766-89ac-79312246fa08"). InnerVolumeSpecName "kube-api-access-wb22x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:31:54.600760 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:54.600752 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5c6b6c7-0aef-4766-89ac-79312246fa08-istio-token" (OuterVolumeSpecName: "istio-token") pod "c5c6b6c7-0aef-4766-89ac-79312246fa08" (UID: "c5c6b6c7-0aef-4766-89ac-79312246fa08"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:31:54.699151 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:54.699116 2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5c6b6c7-0aef-4766-89ac-79312246fa08-istio-csr-dns-cert\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:31:54.699151 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:54.699147 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb22x\" (UniqueName: \"kubernetes.io/projected/c5c6b6c7-0aef-4766-89ac-79312246fa08-kube-api-access-wb22x\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:31:54.699151 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:54.699158 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5c6b6c7-0aef-4766-89ac-79312246fa08-istio-token\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:31:54.699394 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:54.699166 2578 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5c6b6c7-0aef-4766-89ac-79312246fa08-istio-kubeconfig\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:31:54.699394 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:54.699174 2578 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c5c6b6c7-0aef-4766-89ac-79312246fa08-cacerts\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:31:54.699394 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:54.699183 2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5c6b6c7-0aef-4766-89ac-79312246fa08-istio-csr-ca-configmap\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:31:54.699394 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:54.699191 2578 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5c6b6c7-0aef-4766-89ac-79312246fa08-local-certs\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:31:55.258602 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:55.258568 2578 generic.go:356] "Generic (PLEG): container finished" podID="c5c6b6c7-0aef-4766-89ac-79312246fa08" containerID="34e457740611f00b8e714ab0f7502f24e2b9c4d218fd969c632d1fb0badb65b7" exitCode=0 Jul 02 15:31:55.259113 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:55.258617 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" event={"ID":"c5c6b6c7-0aef-4766-89ac-79312246fa08","Type":"ContainerDied","Data":"34e457740611f00b8e714ab0f7502f24e2b9c4d218fd969c632d1fb0badb65b7"} Jul 02 15:31:55.259113 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:55.258640 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" Jul 02 15:31:55.259113 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:55.258683 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6" event={"ID":"c5c6b6c7-0aef-4766-89ac-79312246fa08","Type":"ContainerDied","Data":"e825268eeb867aa635032b3fa43a4fee6fc82db2590b1d59d8fdd8a2232766c2"} Jul 02 15:31:55.259113 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:55.258708 2578 scope.go:117] "RemoveContainer" containerID="34e457740611f00b8e714ab0f7502f24e2b9c4d218fd969c632d1fb0badb65b7" Jul 02 15:31:55.266652 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:55.266637 2578 scope.go:117] "RemoveContainer" containerID="34e457740611f00b8e714ab0f7502f24e2b9c4d218fd969c632d1fb0badb65b7" Jul 02 15:31:55.266927 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:31:55.266907 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34e457740611f00b8e714ab0f7502f24e2b9c4d218fd969c632d1fb0badb65b7\": container with ID starting with 34e457740611f00b8e714ab0f7502f24e2b9c4d218fd969c632d1fb0badb65b7 not found: ID does not exist" containerID="34e457740611f00b8e714ab0f7502f24e2b9c4d218fd969c632d1fb0badb65b7" Jul 02 15:31:55.267003 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:55.266933 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34e457740611f00b8e714ab0f7502f24e2b9c4d218fd969c632d1fb0badb65b7"} err="failed to get container status \"34e457740611f00b8e714ab0f7502f24e2b9c4d218fd969c632d1fb0badb65b7\": rpc error: code = NotFound desc = could not find container \"34e457740611f00b8e714ab0f7502f24e2b9c4d218fd969c632d1fb0badb65b7\": container with ID starting with 34e457740611f00b8e714ab0f7502f24e2b9c4d218fd969c632d1fb0badb65b7 not found: ID does not exist" Jul 02 15:31:55.276705 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:55.276680 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6"] Jul 02 15:31:55.281731 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:55.281708 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pw8t6"] Jul 02 15:31:56.207686 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:56.207657 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-dshtn" Jul 02 15:31:56.816456 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:31:56.816428 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5c6b6c7-0aef-4766-89ac-79312246fa08" path="/var/lib/kubelet/pods/c5c6b6c7-0aef-4766-89ac-79312246fa08/volumes" Jul 02 15:32:04.250052 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:32:04.250020 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-578857ff64-r292d" Jul 02 15:32:08.775927 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:32:08.775854 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:28.494837 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:32:28.494784 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:42.417103 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:32:42.417048 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:42.519544 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:32:42.519495 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:32:42.602717 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:32:42.602679 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:04.302729 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:04.302695 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:13.346380 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:13.346345 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:15.033035 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:15.033003 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:15.165784 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:15.165743 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:15.317504 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:15.317404 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:16.596568 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:16.596529 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:18.279028 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:18.278995 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:18.669685 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:18.669653 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:19.299711 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:19.299675 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:20.726935 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:20.726905 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-cqtzp"] Jul 02 15:33:20.727285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:20.727209 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5c6b6c7-0aef-4766-89ac-79312246fa08" containerName="discovery" Jul 02 15:33:20.727285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:20.727219 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5c6b6c7-0aef-4766-89ac-79312246fa08" containerName="discovery" Jul 02 15:33:20.727285 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:20.727271 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5c6b6c7-0aef-4766-89ac-79312246fa08" containerName="discovery" Jul 02 15:33:20.729811 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:20.729796 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cqtzp" Jul 02 15:33:20.733116 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:20.733093 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-6z9ft\"" Jul 02 15:33:20.733521 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:20.733494 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 15:33:20.733610 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:20.733520 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 15:33:20.745594 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:20.745574 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-cqtzp"] Jul 02 15:33:20.801052 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:20.801021 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27qzn\" (UniqueName: \"kubernetes.io/projected/364efa7a-6e27-4670-a20a-20fa02f77432-kube-api-access-27qzn\") pod \"authorino-operator-75cc8d5cb7-cqtzp\" (UID: \"364efa7a-6e27-4670-a20a-20fa02f77432\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-cqtzp" Jul 02 15:33:20.902210 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:20.902181 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27qzn\" (UniqueName: \"kubernetes.io/projected/364efa7a-6e27-4670-a20a-20fa02f77432-kube-api-access-27qzn\") pod \"authorino-operator-75cc8d5cb7-cqtzp\" (UID: \"364efa7a-6e27-4670-a20a-20fa02f77432\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-cqtzp" Jul 02 15:33:20.914990 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:20.914965 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27qzn\" (UniqueName: \"kubernetes.io/projected/364efa7a-6e27-4670-a20a-20fa02f77432-kube-api-access-27qzn\") pod \"authorino-operator-75cc8d5cb7-cqtzp\" (UID: \"364efa7a-6e27-4670-a20a-20fa02f77432\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-cqtzp" Jul 02 15:33:21.039139 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:21.039063 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cqtzp" Jul 02 15:33:21.174786 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:21.174763 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-cqtzp"] Jul 02 15:33:21.176751 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:33:21.176725 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod364efa7a_6e27_4670_a20a_20fa02f77432.slice/crio-963f0f4fa23b0fe08e03c8f797b962cb503b144cec545fcb0ec82db80db58b5c WatchSource:0}: Error finding container 963f0f4fa23b0fe08e03c8f797b962cb503b144cec545fcb0ec82db80db58b5c: Status 404 returned error can't find the container with id 963f0f4fa23b0fe08e03c8f797b962cb503b144cec545fcb0ec82db80db58b5c Jul 02 15:33:21.318701 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:21.318622 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:21.621540 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:21.621508 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cqtzp" event={"ID":"364efa7a-6e27-4670-a20a-20fa02f77432","Type":"ContainerStarted","Data":"963f0f4fa23b0fe08e03c8f797b962cb503b144cec545fcb0ec82db80db58b5c"} Jul 02 15:33:23.289177 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:23.289148 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:23.563424 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:23.563347 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:24.634604 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:24.634574 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cqtzp" event={"ID":"364efa7a-6e27-4670-a20a-20fa02f77432","Type":"ContainerStarted","Data":"179d38a8070524423d1da7cff11d33df0b9b93fb47b20a1866d1825f748f4274"} Jul 02 15:33:24.635036 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:24.634650 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cqtzp" Jul 02 15:33:24.681422 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:24.681368 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cqtzp" podStartSLOduration=2.258625088 podStartE2EDuration="4.681353018s" totalImagesPullingTime="2.42272793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:33:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:33:24.679339607 +0000 UTC m=+416.309300477" watchObservedRunningTime="2026-07-02 15:33:24.681353018 +0000 UTC m=+416.311313868" Jul 02 15:33:25.906682 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:25.906648 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:27.666995 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:27.666967 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:27.804951 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:27.804918 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:27.874123 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:27.874091 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-77mdx"] Jul 02 15:33:27.877470 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:27.877453 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-77mdx" Jul 02 15:33:27.879411 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:27.879388 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 02 15:33:27.879595 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:27.879578 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 02 15:33:27.879752 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:27.879738 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-s8dmg\"" Jul 02 15:33:27.885603 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:27.885572 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-77mdx"] Jul 02 15:33:27.891908 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:27.891870 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:27.965256 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:27.965193 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkqcv\" (UniqueName: \"kubernetes.io/projected/da73cb94-bc90-439f-9ed8-e96b39592203-kube-api-access-bkqcv\") pod \"kuadrant-console-plugin-66b5774985-77mdx\" (UID: \"da73cb94-bc90-439f-9ed8-e96b39592203\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-77mdx" Jul 02 15:33:27.965256 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:27.965235 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/da73cb94-bc90-439f-9ed8-e96b39592203-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-77mdx\" (UID: \"da73cb94-bc90-439f-9ed8-e96b39592203\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-77mdx" Jul 02 15:33:27.965385 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:27.965258 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/da73cb94-bc90-439f-9ed8-e96b39592203-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-77mdx\" (UID: \"da73cb94-bc90-439f-9ed8-e96b39592203\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-77mdx" Jul 02 15:33:28.065843 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:28.065817 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/da73cb94-bc90-439f-9ed8-e96b39592203-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-77mdx\" (UID: \"da73cb94-bc90-439f-9ed8-e96b39592203\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-77mdx" Jul 02 15:33:28.066048 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:28.065859 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/da73cb94-bc90-439f-9ed8-e96b39592203-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-77mdx\" (UID: \"da73cb94-bc90-439f-9ed8-e96b39592203\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-77mdx" Jul 02 15:33:28.066048 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:28.065971 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkqcv\" (UniqueName: \"kubernetes.io/projected/da73cb94-bc90-439f-9ed8-e96b39592203-kube-api-access-bkqcv\") pod \"kuadrant-console-plugin-66b5774985-77mdx\" (UID: \"da73cb94-bc90-439f-9ed8-e96b39592203\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-77mdx" Jul 02 15:33:28.066048 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:33:28.065992 2578 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 02 15:33:28.066205 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:33:28.066055 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da73cb94-bc90-439f-9ed8-e96b39592203-plugin-serving-cert podName:da73cb94-bc90-439f-9ed8-e96b39592203 nodeName:}" failed. No retries permitted until 2026-07-02 15:33:28.566038771 +0000 UTC m=+420.195999600 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/da73cb94-bc90-439f-9ed8-e96b39592203-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-77mdx" (UID: "da73cb94-bc90-439f-9ed8-e96b39592203") : secret "plugin-serving-cert" not found Jul 02 15:33:28.066470 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:28.066450 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/da73cb94-bc90-439f-9ed8-e96b39592203-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-77mdx\" (UID: \"da73cb94-bc90-439f-9ed8-e96b39592203\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-77mdx" Jul 02 15:33:28.073673 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:28.073645 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkqcv\" (UniqueName: \"kubernetes.io/projected/da73cb94-bc90-439f-9ed8-e96b39592203-kube-api-access-bkqcv\") pod \"kuadrant-console-plugin-66b5774985-77mdx\" (UID: \"da73cb94-bc90-439f-9ed8-e96b39592203\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-77mdx" Jul 02 15:33:28.339730 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:28.339646 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:28.571498 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:28.571463 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/da73cb94-bc90-439f-9ed8-e96b39592203-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-77mdx\" (UID: \"da73cb94-bc90-439f-9ed8-e96b39592203\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-77mdx" Jul 02 15:33:28.573873 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:28.573845 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/da73cb94-bc90-439f-9ed8-e96b39592203-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-77mdx\" (UID: \"da73cb94-bc90-439f-9ed8-e96b39592203\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-77mdx" Jul 02 15:33:28.788972 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:28.788944 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-s8dmg\"" Jul 02 15:33:28.797257 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:28.797234 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-77mdx" Jul 02 15:33:28.922818 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:28.922785 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-77mdx"] Jul 02 15:33:28.926617 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:33:28.926587 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda73cb94_bc90_439f_9ed8_e96b39592203.slice/crio-0eb82ae72eb4d0ae97eacb1b68f0eeda041166d2bcc967271ac09ad8c73d3155 WatchSource:0}: Error finding container 0eb82ae72eb4d0ae97eacb1b68f0eeda041166d2bcc967271ac09ad8c73d3155: Status 404 returned error can't find the container with id 0eb82ae72eb4d0ae97eacb1b68f0eeda041166d2bcc967271ac09ad8c73d3155 Jul 02 15:33:29.656325 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:29.656290 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-77mdx" event={"ID":"da73cb94-bc90-439f-9ed8-e96b39592203","Type":"ContainerStarted","Data":"0eb82ae72eb4d0ae97eacb1b68f0eeda041166d2bcc967271ac09ad8c73d3155"} Jul 02 15:33:35.641179 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:35.641144 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cqtzp" Jul 02 15:33:37.637435 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:37.637402 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:37.796301 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:37.796263 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:40.047299 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:40.047266 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:40.142577 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:40.142539 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:44.674811 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:44.674777 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:44.800490 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:44.800457 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:48.479719 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:48.479674 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:48.644448 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:48.644413 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:52.771911 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:52.771859 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-77mdx" event={"ID":"da73cb94-bc90-439f-9ed8-e96b39592203","Type":"ContainerStarted","Data":"6878baf0983b7fda33639b9780df8061884e9939fa2eaf096b2b5242506d118d"} Jul 02 15:33:52.787541 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:52.787495 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-77mdx" podStartSLOduration=2.834575765 podStartE2EDuration="25.787472147s" totalImagesPullingTime="22.952896382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:33:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:33:52.787322658 +0000 UTC m=+444.417283509" watchObservedRunningTime="2026-07-02 15:33:52.787472147 +0000 UTC m=+444.417433000" Jul 02 15:33:57.462022 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:57.461974 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:57.571858 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:57.571831 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:59.772020 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:59.771986 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:33:59.889990 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:33:59.889959 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:03.665251 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:03.665206 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:03.725123 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:03.725087 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:04.489657 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:04.489611 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:04.590409 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:04.590375 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:07.982071 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:07.982030 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:08.575201 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:08.575143 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:08.696930 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:08.696879 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:08.772912 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:08.772871 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:10.107629 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:10.107593 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:10.214609 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:10.214575 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:10.273464 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:10.273431 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:10.463442 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:10.463361 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlqtn"] Jul 02 15:34:10.505579 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:10.505547 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlqtn"] Jul 02 15:34:10.505755 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:10.505591 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlqtn"] Jul 02 15:34:10.505755 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:10.505672 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-nlqtn" Jul 02 15:34:10.508205 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:10.508185 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 02 15:34:10.651306 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:10.651268 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-894f6\" (UniqueName: \"kubernetes.io/projected/ffe192c5-428d-47e9-8ff9-4b8f8e4d73bd-kube-api-access-894f6\") pod \"limitador-limitador-54d6d988d5-nlqtn\" (UID: \"ffe192c5-428d-47e9-8ff9-4b8f8e4d73bd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nlqtn" Jul 02 15:34:10.651482 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:10.651369 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ffe192c5-428d-47e9-8ff9-4b8f8e4d73bd-config-file\") pod \"limitador-limitador-54d6d988d5-nlqtn\" (UID: \"ffe192c5-428d-47e9-8ff9-4b8f8e4d73bd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nlqtn" Jul 02 15:34:10.751954 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:10.751846 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-894f6\" (UniqueName: \"kubernetes.io/projected/ffe192c5-428d-47e9-8ff9-4b8f8e4d73bd-kube-api-access-894f6\") pod \"limitador-limitador-54d6d988d5-nlqtn\" (UID: \"ffe192c5-428d-47e9-8ff9-4b8f8e4d73bd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nlqtn" Jul 02 15:34:10.752125 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:10.751965 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ffe192c5-428d-47e9-8ff9-4b8f8e4d73bd-config-file\") pod \"limitador-limitador-54d6d988d5-nlqtn\" (UID: \"ffe192c5-428d-47e9-8ff9-4b8f8e4d73bd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nlqtn" Jul 02 15:34:10.752593 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:10.752568 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ffe192c5-428d-47e9-8ff9-4b8f8e4d73bd-config-file\") pod \"limitador-limitador-54d6d988d5-nlqtn\" (UID: \"ffe192c5-428d-47e9-8ff9-4b8f8e4d73bd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nlqtn" Jul 02 15:34:10.760352 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:10.760328 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-894f6\" (UniqueName: \"kubernetes.io/projected/ffe192c5-428d-47e9-8ff9-4b8f8e4d73bd-kube-api-access-894f6\") pod \"limitador-limitador-54d6d988d5-nlqtn\" (UID: \"ffe192c5-428d-47e9-8ff9-4b8f8e4d73bd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nlqtn" Jul 02 15:34:10.815225 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:10.815201 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-nlqtn" Jul 02 15:34:10.912711 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:10.912679 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-vvs7z"] Jul 02 15:34:10.916801 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:10.916774 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vvs7z" Jul 02 15:34:10.918802 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:10.918781 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kltg6\"" Jul 02 15:34:10.922099 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:10.922079 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-vvs7z"] Jul 02 15:34:10.944108 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:10.944020 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlqtn"] Jul 02 15:34:10.946814 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:10.946772 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:10.946977 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:34:10.946953 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffe192c5_428d_47e9_8ff9_4b8f8e4d73bd.slice/crio-16a5118cfc4efcc31558ff26d2fdd9a78d1a16c4af77709e1d14fd0e218b848c WatchSource:0}: Error finding container 16a5118cfc4efcc31558ff26d2fdd9a78d1a16c4af77709e1d14fd0e218b848c: Status 404 returned error can't find the container with id 16a5118cfc4efcc31558ff26d2fdd9a78d1a16c4af77709e1d14fd0e218b848c Jul 02 15:34:11.048551 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:11.048437 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:11.053585 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:11.053562 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99qtz\" (UniqueName: \"kubernetes.io/projected/17f62fde-946e-4f93-acce-ae5ad94379d3-kube-api-access-99qtz\") pod \"authorino-58cd955675-vvs7z\" (UID: \"17f62fde-946e-4f93-acce-ae5ad94379d3\") " pod="kuadrant-system/authorino-58cd955675-vvs7z" Jul 02 15:34:11.154999 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:11.154965 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99qtz\" (UniqueName: \"kubernetes.io/projected/17f62fde-946e-4f93-acce-ae5ad94379d3-kube-api-access-99qtz\") pod \"authorino-58cd955675-vvs7z\" (UID: \"17f62fde-946e-4f93-acce-ae5ad94379d3\") " pod="kuadrant-system/authorino-58cd955675-vvs7z" Jul 02 15:34:11.163069 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:11.163044 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99qtz\" (UniqueName: \"kubernetes.io/projected/17f62fde-946e-4f93-acce-ae5ad94379d3-kube-api-access-99qtz\") pod \"authorino-58cd955675-vvs7z\" (UID: \"17f62fde-946e-4f93-acce-ae5ad94379d3\") " pod="kuadrant-system/authorino-58cd955675-vvs7z" Jul 02 15:34:11.229029 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:11.228998 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vvs7z" Jul 02 15:34:11.354731 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:11.354700 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:11.360449 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:11.360428 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-vvs7z"] Jul 02 15:34:11.362931 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:34:11.362889 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17f62fde_946e_4f93_acce_ae5ad94379d3.slice/crio-7cefddcf9f8a8b633ae3e354090111c57191f1593ae2ad2665a59332e5570e93 WatchSource:0}: Error finding container 7cefddcf9f8a8b633ae3e354090111c57191f1593ae2ad2665a59332e5570e93: Status 404 returned error can't find the container with id 7cefddcf9f8a8b633ae3e354090111c57191f1593ae2ad2665a59332e5570e93 Jul 02 15:34:11.875131 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:11.875046 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-nlqtn" event={"ID":"ffe192c5-428d-47e9-8ff9-4b8f8e4d73bd","Type":"ContainerStarted","Data":"16a5118cfc4efcc31558ff26d2fdd9a78d1a16c4af77709e1d14fd0e218b848c"} Jul 02 15:34:11.878816 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:11.878785 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vvs7z" event={"ID":"17f62fde-946e-4f93-acce-ae5ad94379d3","Type":"ContainerStarted","Data":"7cefddcf9f8a8b633ae3e354090111c57191f1593ae2ad2665a59332e5570e93"} Jul 02 15:34:14.898610 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:14.898568 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-nlqtn" event={"ID":"ffe192c5-428d-47e9-8ff9-4b8f8e4d73bd","Type":"ContainerStarted","Data":"97af000a6838b0b6ec0e474bc29faa52ee9aacdf16ff6d542639d1bdf3790fbc"} Jul 02 15:34:14.899108 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:14.898662 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-nlqtn" Jul 02 15:34:14.938252 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:14.938200 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-nlqtn" podStartSLOduration=1.975126811 podStartE2EDuration="4.938182577s" totalImagesPullingTime="2.963055766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:34:14.936216587 +0000 UTC m=+466.566177458" watchObservedRunningTime="2026-07-02 15:34:14.938182577 +0000 UTC m=+466.568143428" Jul 02 15:34:15.903881 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:15.903845 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vvs7z" event={"ID":"17f62fde-946e-4f93-acce-ae5ad94379d3","Type":"ContainerStarted","Data":"80239b2b4d7d57e847cf58171e997cae9d5047a767c63c5f1f637659d1f15dfe"} Jul 02 15:34:15.918833 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:15.918777 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-vvs7z" podStartSLOduration=1.746229282 podStartE2EDuration="5.918760746s" totalImagesPullingTime="4.172531464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:34:15.917252832 +0000 UTC m=+467.547213684" watchObservedRunningTime="2026-07-02 15:34:15.918760746 +0000 UTC m=+467.548721597" Jul 02 15:34:16.751858 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:16.751830 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-vvs7z"] Jul 02 15:34:17.700913 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:17.700857 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:17.801006 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:17.800975 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:17.914230 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:17.914190 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-vvs7z" podUID="17f62fde-946e-4f93-acce-ae5ad94379d3" containerName="authorino" containerID="cri-o://80239b2b4d7d57e847cf58171e997cae9d5047a767c63c5f1f637659d1f15dfe" gracePeriod=30 Jul 02 15:34:18.187079 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:18.187050 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vvs7z" Jul 02 15:34:18.321513 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:18.321429 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99qtz\" (UniqueName: \"kubernetes.io/projected/17f62fde-946e-4f93-acce-ae5ad94379d3-kube-api-access-99qtz\") pod \"17f62fde-946e-4f93-acce-ae5ad94379d3\" (UID: \"17f62fde-946e-4f93-acce-ae5ad94379d3\") " Jul 02 15:34:18.323588 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:18.323549 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17f62fde-946e-4f93-acce-ae5ad94379d3-kube-api-access-99qtz" (OuterVolumeSpecName: "kube-api-access-99qtz") pod "17f62fde-946e-4f93-acce-ae5ad94379d3" (UID: "17f62fde-946e-4f93-acce-ae5ad94379d3"). InnerVolumeSpecName "kube-api-access-99qtz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:34:18.422960 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:18.422921 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99qtz\" (UniqueName: \"kubernetes.io/projected/17f62fde-946e-4f93-acce-ae5ad94379d3-kube-api-access-99qtz\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:34:18.920175 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:18.920138 2578 generic.go:356] "Generic (PLEG): container finished" podID="17f62fde-946e-4f93-acce-ae5ad94379d3" containerID="80239b2b4d7d57e847cf58171e997cae9d5047a767c63c5f1f637659d1f15dfe" exitCode=0 Jul 02 15:34:18.920175 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:18.920179 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vvs7z" event={"ID":"17f62fde-946e-4f93-acce-ae5ad94379d3","Type":"ContainerDied","Data":"80239b2b4d7d57e847cf58171e997cae9d5047a767c63c5f1f637659d1f15dfe"} Jul 02 15:34:18.920701 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:18.920183 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vvs7z" Jul 02 15:34:18.920701 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:18.920208 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vvs7z" event={"ID":"17f62fde-946e-4f93-acce-ae5ad94379d3","Type":"ContainerDied","Data":"7cefddcf9f8a8b633ae3e354090111c57191f1593ae2ad2665a59332e5570e93"} Jul 02 15:34:18.920701 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:18.920230 2578 scope.go:117] "RemoveContainer" containerID="80239b2b4d7d57e847cf58171e997cae9d5047a767c63c5f1f637659d1f15dfe" Jul 02 15:34:18.930276 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:18.930259 2578 scope.go:117] "RemoveContainer" containerID="80239b2b4d7d57e847cf58171e997cae9d5047a767c63c5f1f637659d1f15dfe" Jul 02 15:34:18.930588 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:34:18.930563 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80239b2b4d7d57e847cf58171e997cae9d5047a767c63c5f1f637659d1f15dfe\": container with ID starting with 80239b2b4d7d57e847cf58171e997cae9d5047a767c63c5f1f637659d1f15dfe not found: ID does not exist" containerID="80239b2b4d7d57e847cf58171e997cae9d5047a767c63c5f1f637659d1f15dfe" Jul 02 15:34:18.930691 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:18.930595 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80239b2b4d7d57e847cf58171e997cae9d5047a767c63c5f1f637659d1f15dfe"} err="failed to get container status \"80239b2b4d7d57e847cf58171e997cae9d5047a767c63c5f1f637659d1f15dfe\": rpc error: code = NotFound desc = could not find container \"80239b2b4d7d57e847cf58171e997cae9d5047a767c63c5f1f637659d1f15dfe\": container with ID starting with 80239b2b4d7d57e847cf58171e997cae9d5047a767c63c5f1f637659d1f15dfe not found: ID does not exist" Jul 02 15:34:18.935171 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:18.935152 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-vvs7z"] Jul 02 15:34:18.937337 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:18.937311 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-vvs7z"] Jul 02 15:34:20.148011 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:20.147977 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:20.254730 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:20.254701 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:20.817303 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:20.817276 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17f62fde-946e-4f93-acce-ae5ad94379d3" path="/var/lib/kubelet/pods/17f62fde-946e-4f93-acce-ae5ad94379d3/volumes" Jul 02 15:34:24.918642 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:24.918603 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:25.417547 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:25.417518 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:25.905186 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:25.905151 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-nlqtn" Jul 02 15:34:31.685288 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:31.685260 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:45.364077 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:45.364043 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:45.611415 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:45.611385 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:34:45.818928 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:34:45.818823 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:10.805095 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:10.805060 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:10.903162 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:10.903132 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:42.395710 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:42.395674 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:42.618617 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:42.618585 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-v8zqv"] Jul 02 15:35:42.618937 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:42.618924 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17f62fde-946e-4f93-acce-ae5ad94379d3" containerName="authorino" Jul 02 15:35:42.618989 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:42.618938 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="17f62fde-946e-4f93-acce-ae5ad94379d3" containerName="authorino" Jul 02 15:35:42.619024 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:42.618989 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="17f62fde-946e-4f93-acce-ae5ad94379d3" containerName="authorino" Jul 02 15:35:42.621927 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:42.621911 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-v8zqv" Jul 02 15:35:42.624019 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:42.624001 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kltg6\"" Jul 02 15:35:42.629586 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:42.629559 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-v8zqv"] Jul 02 15:35:42.667632 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:42.667540 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:42.715214 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:42.715182 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjg48\" (UniqueName: \"kubernetes.io/projected/1ba6c4e8-ff28-4f22-89fd-0edefe0f3e74-kube-api-access-rjg48\") pod \"authorino-5d4b67c446-v8zqv\" (UID: \"1ba6c4e8-ff28-4f22-89fd-0edefe0f3e74\") " pod="kuadrant-system/authorino-5d4b67c446-v8zqv" Jul 02 15:35:42.815964 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:42.815929 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjg48\" (UniqueName: \"kubernetes.io/projected/1ba6c4e8-ff28-4f22-89fd-0edefe0f3e74-kube-api-access-rjg48\") pod \"authorino-5d4b67c446-v8zqv\" (UID: \"1ba6c4e8-ff28-4f22-89fd-0edefe0f3e74\") " pod="kuadrant-system/authorino-5d4b67c446-v8zqv" Jul 02 15:35:42.824981 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:42.824959 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjg48\" (UniqueName: \"kubernetes.io/projected/1ba6c4e8-ff28-4f22-89fd-0edefe0f3e74-kube-api-access-rjg48\") pod \"authorino-5d4b67c446-v8zqv\" (UID: \"1ba6c4e8-ff28-4f22-89fd-0edefe0f3e74\") " pod="kuadrant-system/authorino-5d4b67c446-v8zqv" Jul 02 15:35:42.845746 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:42.845712 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-v8zqv"] Jul 02 15:35:42.846003 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:42.845987 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-v8zqv" Jul 02 15:35:42.871514 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:42.871483 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5464bdfb8b-cpqmq"] Jul 02 15:35:42.875012 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:42.874991 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5464bdfb8b-cpqmq" Jul 02 15:35:42.880916 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:42.880874 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5464bdfb8b-cpqmq"] Jul 02 15:35:42.916723 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:42.916696 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqmlb\" (UniqueName: \"kubernetes.io/projected/a1b0edf7-0739-4262-9f03-fdca269b8b14-kube-api-access-dqmlb\") pod \"authorino-5464bdfb8b-cpqmq\" (UID: \"a1b0edf7-0739-4262-9f03-fdca269b8b14\") " pod="kuadrant-system/authorino-5464bdfb8b-cpqmq" Jul 02 15:35:42.977302 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:42.977279 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-v8zqv"] Jul 02 15:35:42.980076 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:35:42.980045 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ba6c4e8_ff28_4f22_89fd_0edefe0f3e74.slice/crio-a49a06e30567b70dcc0dad6394afffbe6766310877d5d8e69a756f2575e87e5e WatchSource:0}: Error finding container a49a06e30567b70dcc0dad6394afffbe6766310877d5d8e69a756f2575e87e5e: Status 404 returned error can't find the container with id a49a06e30567b70dcc0dad6394afffbe6766310877d5d8e69a756f2575e87e5e Jul 02 15:35:43.017490 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:43.017451 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqmlb\" (UniqueName: \"kubernetes.io/projected/a1b0edf7-0739-4262-9f03-fdca269b8b14-kube-api-access-dqmlb\") pod \"authorino-5464bdfb8b-cpqmq\" (UID: \"a1b0edf7-0739-4262-9f03-fdca269b8b14\") " pod="kuadrant-system/authorino-5464bdfb8b-cpqmq" Jul 02 15:35:43.026068 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:43.026042 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqmlb\" (UniqueName: \"kubernetes.io/projected/a1b0edf7-0739-4262-9f03-fdca269b8b14-kube-api-access-dqmlb\") pod \"authorino-5464bdfb8b-cpqmq\" (UID: \"a1b0edf7-0739-4262-9f03-fdca269b8b14\") " pod="kuadrant-system/authorino-5464bdfb8b-cpqmq" Jul 02 15:35:43.044850 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:43.044825 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5464bdfb8b-cpqmq"] Jul 02 15:35:43.045099 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:43.045087 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5464bdfb8b-cpqmq" Jul 02 15:35:43.072810 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:43.072782 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d59f446bb-vllts"] Jul 02 15:35:43.076204 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:43.076188 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d59f446bb-vllts" Jul 02 15:35:43.078257 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:43.078234 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 02 15:35:43.083220 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:43.083196 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d59f446bb-vllts"] Jul 02 15:35:43.118641 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:43.118612 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8a36418d-0e8b-4893-b282-c391eacb1808-tls-cert\") pod \"authorino-7d59f446bb-vllts\" (UID: \"8a36418d-0e8b-4893-b282-c391eacb1808\") " pod="kuadrant-system/authorino-7d59f446bb-vllts" Jul 02 15:35:43.118641 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:43.118643 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxz2h\" (UniqueName: \"kubernetes.io/projected/8a36418d-0e8b-4893-b282-c391eacb1808-kube-api-access-lxz2h\") pod \"authorino-7d59f446bb-vllts\" (UID: \"8a36418d-0e8b-4893-b282-c391eacb1808\") " pod="kuadrant-system/authorino-7d59f446bb-vllts" Jul 02 15:35:43.172538 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:43.172514 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5464bdfb8b-cpqmq"] Jul 02 15:35:43.174816 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:35:43.174789 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1b0edf7_0739_4262_9f03_fdca269b8b14.slice/crio-c4b8f9d3e0b92bde56eb297ca2950d5aa55f79034f935ec67c00605f4e72186b WatchSource:0}: Error finding container c4b8f9d3e0b92bde56eb297ca2950d5aa55f79034f935ec67c00605f4e72186b: Status 404 returned error can't find the container with id c4b8f9d3e0b92bde56eb297ca2950d5aa55f79034f935ec67c00605f4e72186b Jul 02 15:35:43.220001 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:43.219927 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8a36418d-0e8b-4893-b282-c391eacb1808-tls-cert\") pod \"authorino-7d59f446bb-vllts\" (UID: \"8a36418d-0e8b-4893-b282-c391eacb1808\") " pod="kuadrant-system/authorino-7d59f446bb-vllts" Jul 02 15:35:43.220001 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:43.219961 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxz2h\" (UniqueName: \"kubernetes.io/projected/8a36418d-0e8b-4893-b282-c391eacb1808-kube-api-access-lxz2h\") pod \"authorino-7d59f446bb-vllts\" (UID: \"8a36418d-0e8b-4893-b282-c391eacb1808\") " pod="kuadrant-system/authorino-7d59f446bb-vllts" Jul 02 15:35:43.222313 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:43.222293 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8a36418d-0e8b-4893-b282-c391eacb1808-tls-cert\") pod \"authorino-7d59f446bb-vllts\" (UID: \"8a36418d-0e8b-4893-b282-c391eacb1808\") " pod="kuadrant-system/authorino-7d59f446bb-vllts" Jul 02 15:35:43.226818 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:43.226801 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxz2h\" (UniqueName: \"kubernetes.io/projected/8a36418d-0e8b-4893-b282-c391eacb1808-kube-api-access-lxz2h\") pod \"authorino-7d59f446bb-vllts\" (UID: \"8a36418d-0e8b-4893-b282-c391eacb1808\") " pod="kuadrant-system/authorino-7d59f446bb-vllts" Jul 02 15:35:43.290505 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:43.290469 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5464bdfb8b-cpqmq" event={"ID":"a1b0edf7-0739-4262-9f03-fdca269b8b14","Type":"ContainerStarted","Data":"c4b8f9d3e0b92bde56eb297ca2950d5aa55f79034f935ec67c00605f4e72186b"} Jul 02 15:35:43.291746 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:43.291714 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-v8zqv" event={"ID":"1ba6c4e8-ff28-4f22-89fd-0edefe0f3e74","Type":"ContainerStarted","Data":"a49a06e30567b70dcc0dad6394afffbe6766310877d5d8e69a756f2575e87e5e"} Jul 02 15:35:43.387663 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:43.387633 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d59f446bb-vllts" Jul 02 15:35:43.523358 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:43.523326 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d59f446bb-vllts"] Jul 02 15:35:43.525982 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:35:43.525946 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a36418d_0e8b_4893_b282_c391eacb1808.slice/crio-4d3ee8e72c44439ec697125efc2280c7df6f77937ae6748b1559c11001ea87f4 WatchSource:0}: Error finding container 4d3ee8e72c44439ec697125efc2280c7df6f77937ae6748b1559c11001ea87f4: Status 404 returned error can't find the container with id 4d3ee8e72c44439ec697125efc2280c7df6f77937ae6748b1559c11001ea87f4 Jul 02 15:35:44.298040 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:44.297927 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5464bdfb8b-cpqmq" event={"ID":"a1b0edf7-0739-4262-9f03-fdca269b8b14","Type":"ContainerStarted","Data":"c96b5b58840b3e1dab1493ac27583edf6d495c48dfb57afe3f77fccaa3a9f27d"} Jul 02 15:35:44.298040 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:44.297976 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5464bdfb8b-cpqmq" podUID="a1b0edf7-0739-4262-9f03-fdca269b8b14" containerName="authorino" containerID="cri-o://c96b5b58840b3e1dab1493ac27583edf6d495c48dfb57afe3f77fccaa3a9f27d" gracePeriod=30 Jul 02 15:35:44.299364 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:44.299340 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-v8zqv" event={"ID":"1ba6c4e8-ff28-4f22-89fd-0edefe0f3e74","Type":"ContainerStarted","Data":"5401c9f589fc0afdc8935f00891c2915b72dac30c217ad511d344b1d55dfeb58"} Jul 02 15:35:44.299508 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:44.299385 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-v8zqv" podUID="1ba6c4e8-ff28-4f22-89fd-0edefe0f3e74" containerName="authorino" containerID="cri-o://5401c9f589fc0afdc8935f00891c2915b72dac30c217ad511d344b1d55dfeb58" gracePeriod=30 Jul 02 15:35:44.300943 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:44.300919 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d59f446bb-vllts" event={"ID":"8a36418d-0e8b-4893-b282-c391eacb1808","Type":"ContainerStarted","Data":"335c059529180304aae2fea916f4647971768dbe01c37de45faf2bdc5387e6e0"} Jul 02 15:35:44.301109 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:44.301083 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d59f446bb-vllts" event={"ID":"8a36418d-0e8b-4893-b282-c391eacb1808","Type":"ContainerStarted","Data":"4d3ee8e72c44439ec697125efc2280c7df6f77937ae6748b1559c11001ea87f4"} Jul 02 15:35:44.314580 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:44.314537 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5464bdfb8b-cpqmq" podStartSLOduration=1.570461566 podStartE2EDuration="2.314522776s" totalImagesPullingTime="744.06121ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:35:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:35:44.313539446 +0000 UTC m=+555.943500318" watchObservedRunningTime="2026-07-02 15:35:44.314522776 +0000 UTC m=+555.944483626" Jul 02 15:35:44.329883 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:44.329839 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-v8zqv" podStartSLOduration=1.991914449 podStartE2EDuration="2.329825808s" totalImagesPullingTime="337.911359ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:35:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:35:44.32855025 +0000 UTC m=+555.958511122" watchObservedRunningTime="2026-07-02 15:35:44.329825808 +0000 UTC m=+555.959786685" Jul 02 15:35:44.344678 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:44.344637 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7d59f446bb-vllts" podStartSLOduration=0.929232277 podStartE2EDuration="1.344601437s" totalImagesPullingTime="415.36916ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:35:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:35:44.344312633 +0000 UTC m=+555.974273485" watchObservedRunningTime="2026-07-02 15:35:44.344601437 +0000 UTC m=+555.974562290" Jul 02 15:35:44.541005 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:44.540976 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5464bdfb8b-cpqmq" Jul 02 15:35:44.568095 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:44.568056 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-v8zqv" Jul 02 15:35:44.629764 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:44.629730 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqmlb\" (UniqueName: \"kubernetes.io/projected/a1b0edf7-0739-4262-9f03-fdca269b8b14-kube-api-access-dqmlb\") pod \"a1b0edf7-0739-4262-9f03-fdca269b8b14\" (UID: \"a1b0edf7-0739-4262-9f03-fdca269b8b14\") " Jul 02 15:35:44.629964 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:44.629785 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjg48\" (UniqueName: \"kubernetes.io/projected/1ba6c4e8-ff28-4f22-89fd-0edefe0f3e74-kube-api-access-rjg48\") pod \"1ba6c4e8-ff28-4f22-89fd-0edefe0f3e74\" (UID: \"1ba6c4e8-ff28-4f22-89fd-0edefe0f3e74\") " Jul 02 15:35:44.631799 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:44.631775 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ba6c4e8-ff28-4f22-89fd-0edefe0f3e74-kube-api-access-rjg48" (OuterVolumeSpecName: "kube-api-access-rjg48") pod "1ba6c4e8-ff28-4f22-89fd-0edefe0f3e74" (UID: "1ba6c4e8-ff28-4f22-89fd-0edefe0f3e74"). InnerVolumeSpecName "kube-api-access-rjg48". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:35:44.631862 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:44.631813 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1b0edf7-0739-4262-9f03-fdca269b8b14-kube-api-access-dqmlb" (OuterVolumeSpecName: "kube-api-access-dqmlb") pod "a1b0edf7-0739-4262-9f03-fdca269b8b14" (UID: "a1b0edf7-0739-4262-9f03-fdca269b8b14"). InnerVolumeSpecName "kube-api-access-dqmlb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:35:44.731194 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:44.731159 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqmlb\" (UniqueName: \"kubernetes.io/projected/a1b0edf7-0739-4262-9f03-fdca269b8b14-kube-api-access-dqmlb\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:35:44.731194 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:44.731187 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjg48\" (UniqueName: \"kubernetes.io/projected/1ba6c4e8-ff28-4f22-89fd-0edefe0f3e74-kube-api-access-rjg48\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:35:45.307602 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:45.307567 2578 generic.go:356] "Generic (PLEG): container finished" podID="a1b0edf7-0739-4262-9f03-fdca269b8b14" containerID="c96b5b58840b3e1dab1493ac27583edf6d495c48dfb57afe3f77fccaa3a9f27d" exitCode=0 Jul 02 15:35:45.307776 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:45.307636 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5464bdfb8b-cpqmq" Jul 02 15:35:45.307776 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:45.307640 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5464bdfb8b-cpqmq" event={"ID":"a1b0edf7-0739-4262-9f03-fdca269b8b14","Type":"ContainerDied","Data":"c96b5b58840b3e1dab1493ac27583edf6d495c48dfb57afe3f77fccaa3a9f27d"} Jul 02 15:35:45.307776 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:45.307744 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5464bdfb8b-cpqmq" event={"ID":"a1b0edf7-0739-4262-9f03-fdca269b8b14","Type":"ContainerDied","Data":"c4b8f9d3e0b92bde56eb297ca2950d5aa55f79034f935ec67c00605f4e72186b"} Jul 02 15:35:45.307776 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:45.307770 2578 scope.go:117] "RemoveContainer" containerID="c96b5b58840b3e1dab1493ac27583edf6d495c48dfb57afe3f77fccaa3a9f27d" Jul 02 15:35:45.309244 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:45.309225 2578 generic.go:356] "Generic (PLEG): container finished" podID="1ba6c4e8-ff28-4f22-89fd-0edefe0f3e74" containerID="5401c9f589fc0afdc8935f00891c2915b72dac30c217ad511d344b1d55dfeb58" exitCode=0 Jul 02 15:35:45.309342 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:45.309270 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-v8zqv" Jul 02 15:35:45.309342 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:45.309317 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-v8zqv" event={"ID":"1ba6c4e8-ff28-4f22-89fd-0edefe0f3e74","Type":"ContainerDied","Data":"5401c9f589fc0afdc8935f00891c2915b72dac30c217ad511d344b1d55dfeb58"} Jul 02 15:35:45.309442 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:45.309384 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-v8zqv" event={"ID":"1ba6c4e8-ff28-4f22-89fd-0edefe0f3e74","Type":"ContainerDied","Data":"a49a06e30567b70dcc0dad6394afffbe6766310877d5d8e69a756f2575e87e5e"} Jul 02 15:35:45.315807 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:45.315792 2578 scope.go:117] "RemoveContainer" containerID="c96b5b58840b3e1dab1493ac27583edf6d495c48dfb57afe3f77fccaa3a9f27d" Jul 02 15:35:45.316082 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:35:45.316065 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c96b5b58840b3e1dab1493ac27583edf6d495c48dfb57afe3f77fccaa3a9f27d\": container with ID starting with c96b5b58840b3e1dab1493ac27583edf6d495c48dfb57afe3f77fccaa3a9f27d not found: ID does not exist" containerID="c96b5b58840b3e1dab1493ac27583edf6d495c48dfb57afe3f77fccaa3a9f27d" Jul 02 15:35:45.316138 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:45.316089 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c96b5b58840b3e1dab1493ac27583edf6d495c48dfb57afe3f77fccaa3a9f27d"} err="failed to get container status \"c96b5b58840b3e1dab1493ac27583edf6d495c48dfb57afe3f77fccaa3a9f27d\": rpc error: code = NotFound desc = could not find container \"c96b5b58840b3e1dab1493ac27583edf6d495c48dfb57afe3f77fccaa3a9f27d\": container with ID starting with c96b5b58840b3e1dab1493ac27583edf6d495c48dfb57afe3f77fccaa3a9f27d not found: ID does not exist" Jul 02 15:35:45.316138 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:45.316106 2578 scope.go:117] "RemoveContainer" containerID="5401c9f589fc0afdc8935f00891c2915b72dac30c217ad511d344b1d55dfeb58" Jul 02 15:35:45.323443 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:45.323425 2578 scope.go:117] "RemoveContainer" containerID="5401c9f589fc0afdc8935f00891c2915b72dac30c217ad511d344b1d55dfeb58" Jul 02 15:35:45.323752 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:35:45.323720 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5401c9f589fc0afdc8935f00891c2915b72dac30c217ad511d344b1d55dfeb58\": container with ID starting with 5401c9f589fc0afdc8935f00891c2915b72dac30c217ad511d344b1d55dfeb58 not found: ID does not exist" containerID="5401c9f589fc0afdc8935f00891c2915b72dac30c217ad511d344b1d55dfeb58" Jul 02 15:35:45.323811 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:45.323762 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5401c9f589fc0afdc8935f00891c2915b72dac30c217ad511d344b1d55dfeb58"} err="failed to get container status \"5401c9f589fc0afdc8935f00891c2915b72dac30c217ad511d344b1d55dfeb58\": rpc error: code = NotFound desc = could not find container \"5401c9f589fc0afdc8935f00891c2915b72dac30c217ad511d344b1d55dfeb58\": container with ID starting with 5401c9f589fc0afdc8935f00891c2915b72dac30c217ad511d344b1d55dfeb58 not found: ID does not exist" Jul 02 15:35:45.324850 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:45.324833 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-v8zqv"] Jul 02 15:35:45.328196 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:45.328179 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-v8zqv"] Jul 02 15:35:45.336759 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:45.336741 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5464bdfb8b-cpqmq"] Jul 02 15:35:45.339994 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:45.339975 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5464bdfb8b-cpqmq"] Jul 02 15:35:46.817002 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:46.816976 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ba6c4e8-ff28-4f22-89fd-0edefe0f3e74" path="/var/lib/kubelet/pods/1ba6c4e8-ff28-4f22-89fd-0edefe0f3e74/volumes" Jul 02 15:35:46.817348 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:46.817293 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1b0edf7-0739-4262-9f03-fdca269b8b14" path="/var/lib/kubelet/pods/a1b0edf7-0739-4262-9f03-fdca269b8b14/volumes" Jul 02 15:35:48.947949 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:48.947920 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:49.047371 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:49.047343 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:49.275640 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:49.275556 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:52.629841 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:52.629807 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:35:52.737434 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:35:52.737400 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:36:02.765318 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:36:02.765285 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:36:04.492059 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:36:04.492029 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:36:26.774839 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:36:26.774803 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:36:27.364866 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:36:27.364833 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:36:27.444087 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:36:27.444052 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:36:27.790038 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:36:27.789940 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:36:27.858935 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:36:27.858887 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:36:28.002704 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:36:28.002671 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlqtn"] Jul 02 15:36:28.799112 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:36:28.799084 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2pztp_9a21b8b7-cc97-4782-aa1f-1ebd124c2987/ovn-acl-logging/0.log" Jul 02 15:36:28.799809 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:36:28.799793 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2pztp_9a21b8b7-cc97-4782-aa1f-1ebd124c2987/ovn-acl-logging/0.log" Jul 02 15:36:58.844777 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:36:58.844699 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:37:20.845537 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:20.845503 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:37:20.946473 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:20.946442 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:37:23.741066 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:23.741039 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:37:28.159905 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:28.159874 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c59c96f4d-7mbph"] Jul 02 15:37:28.160472 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:28.160345 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ba6c4e8-ff28-4f22-89fd-0edefe0f3e74" containerName="authorino" Jul 02 15:37:28.160472 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:28.160364 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ba6c4e8-ff28-4f22-89fd-0edefe0f3e74" containerName="authorino" Jul 02 15:37:28.160472 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:28.160383 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1b0edf7-0739-4262-9f03-fdca269b8b14" containerName="authorino" Jul 02 15:37:28.160472 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:28.160393 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1b0edf7-0739-4262-9f03-fdca269b8b14" containerName="authorino" Jul 02 15:37:28.160680 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:28.160506 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1b0edf7-0739-4262-9f03-fdca269b8b14" containerName="authorino" Jul 02 15:37:28.160680 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:28.160521 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ba6c4e8-ff28-4f22-89fd-0edefe0f3e74" containerName="authorino" Jul 02 15:37:28.163518 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:28.163498 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c59c96f4d-7mbph" Jul 02 15:37:28.165708 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:28.165689 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jul 02 15:37:28.172276 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:28.172251 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c59c96f4d-7mbph"] Jul 02 15:37:28.200587 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:28.200561 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dddt\" (UniqueName: \"kubernetes.io/projected/98c198d5-4e00-443d-ad09-51279d3bcb68-kube-api-access-8dddt\") pod \"authorino-7c59c96f4d-7mbph\" (UID: \"98c198d5-4e00-443d-ad09-51279d3bcb68\") " pod="kuadrant-system/authorino-7c59c96f4d-7mbph" Jul 02 15:37:28.200713 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:28.200603 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/98c198d5-4e00-443d-ad09-51279d3bcb68-oidc-ca\") pod \"authorino-7c59c96f4d-7mbph\" (UID: \"98c198d5-4e00-443d-ad09-51279d3bcb68\") " pod="kuadrant-system/authorino-7c59c96f4d-7mbph" Jul 02 15:37:28.200713 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:28.200634 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/98c198d5-4e00-443d-ad09-51279d3bcb68-tls-cert\") pod \"authorino-7c59c96f4d-7mbph\" (UID: \"98c198d5-4e00-443d-ad09-51279d3bcb68\") " pod="kuadrant-system/authorino-7c59c96f4d-7mbph" Jul 02 15:37:28.301939 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:28.301880 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dddt\" (UniqueName: \"kubernetes.io/projected/98c198d5-4e00-443d-ad09-51279d3bcb68-kube-api-access-8dddt\") pod \"authorino-7c59c96f4d-7mbph\" (UID: \"98c198d5-4e00-443d-ad09-51279d3bcb68\") " pod="kuadrant-system/authorino-7c59c96f4d-7mbph" Jul 02 15:37:28.302110 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:28.301971 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/98c198d5-4e00-443d-ad09-51279d3bcb68-oidc-ca\") pod \"authorino-7c59c96f4d-7mbph\" (UID: \"98c198d5-4e00-443d-ad09-51279d3bcb68\") " pod="kuadrant-system/authorino-7c59c96f4d-7mbph" Jul 02 15:37:28.302110 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:28.302025 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/98c198d5-4e00-443d-ad09-51279d3bcb68-tls-cert\") pod \"authorino-7c59c96f4d-7mbph\" (UID: \"98c198d5-4e00-443d-ad09-51279d3bcb68\") " pod="kuadrant-system/authorino-7c59c96f4d-7mbph" Jul 02 15:37:28.302590 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:28.302571 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/98c198d5-4e00-443d-ad09-51279d3bcb68-oidc-ca\") pod \"authorino-7c59c96f4d-7mbph\" (UID: \"98c198d5-4e00-443d-ad09-51279d3bcb68\") " pod="kuadrant-system/authorino-7c59c96f4d-7mbph" Jul 02 15:37:28.304396 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:28.304376 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/98c198d5-4e00-443d-ad09-51279d3bcb68-tls-cert\") pod \"authorino-7c59c96f4d-7mbph\" (UID: \"98c198d5-4e00-443d-ad09-51279d3bcb68\") " pod="kuadrant-system/authorino-7c59c96f4d-7mbph" Jul 02 15:37:28.309325 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:28.309303 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dddt\" (UniqueName: \"kubernetes.io/projected/98c198d5-4e00-443d-ad09-51279d3bcb68-kube-api-access-8dddt\") pod \"authorino-7c59c96f4d-7mbph\" (UID: \"98c198d5-4e00-443d-ad09-51279d3bcb68\") " pod="kuadrant-system/authorino-7c59c96f4d-7mbph" Jul 02 15:37:28.473038 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:28.472955 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c59c96f4d-7mbph" Jul 02 15:37:28.596703 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:28.596679 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c59c96f4d-7mbph"] Jul 02 15:37:28.599323 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:37:28.599299 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod98c198d5_4e00_443d_ad09_51279d3bcb68.slice/crio-85bc18d28f0a31dc375914fb32db87b747bdf8d15289e9be018598fc90b08cde WatchSource:0}: Error finding container 85bc18d28f0a31dc375914fb32db87b747bdf8d15289e9be018598fc90b08cde: Status 404 returned error can't find the container with id 85bc18d28f0a31dc375914fb32db87b747bdf8d15289e9be018598fc90b08cde Jul 02 15:37:28.600819 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:28.600797 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 15:37:28.749955 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:28.749844 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c59c96f4d-7mbph" event={"ID":"98c198d5-4e00-443d-ad09-51279d3bcb68","Type":"ContainerStarted","Data":"85bc18d28f0a31dc375914fb32db87b747bdf8d15289e9be018598fc90b08cde"} Jul 02 15:37:29.755394 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:29.755355 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c59c96f4d-7mbph" event={"ID":"98c198d5-4e00-443d-ad09-51279d3bcb68","Type":"ContainerStarted","Data":"db4fb0d9c13f73aaf156074e6e519120d5297767682662f1f13b159b44707a89"} Jul 02 15:37:29.771297 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:29.771246 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7c59c96f4d-7mbph" podStartSLOduration=1.42449116 podStartE2EDuration="1.771230564s" totalImagesPullingTime="346.739404ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:37:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:37:29.770564845 +0000 UTC m=+661.400525699" watchObservedRunningTime="2026-07-02 15:37:29.771230564 +0000 UTC m=+661.401191414" Jul 02 15:37:29.802297 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:29.802266 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d59f446bb-vllts"] Jul 02 15:37:29.802454 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:29.802425 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7d59f446bb-vllts" podUID="8a36418d-0e8b-4893-b282-c391eacb1808" containerName="authorino" containerID="cri-o://335c059529180304aae2fea916f4647971768dbe01c37de45faf2bdc5387e6e0" gracePeriod=30 Jul 02 15:37:30.045730 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:30.045698 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d59f446bb-vllts" Jul 02 15:37:30.116801 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:30.116764 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8a36418d-0e8b-4893-b282-c391eacb1808-tls-cert\") pod \"8a36418d-0e8b-4893-b282-c391eacb1808\" (UID: \"8a36418d-0e8b-4893-b282-c391eacb1808\") " Jul 02 15:37:30.117008 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:30.116810 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxz2h\" (UniqueName: \"kubernetes.io/projected/8a36418d-0e8b-4893-b282-c391eacb1808-kube-api-access-lxz2h\") pod \"8a36418d-0e8b-4893-b282-c391eacb1808\" (UID: \"8a36418d-0e8b-4893-b282-c391eacb1808\") " Jul 02 15:37:30.118818 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:30.118792 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a36418d-0e8b-4893-b282-c391eacb1808-kube-api-access-lxz2h" (OuterVolumeSpecName: "kube-api-access-lxz2h") pod "8a36418d-0e8b-4893-b282-c391eacb1808" (UID: "8a36418d-0e8b-4893-b282-c391eacb1808"). InnerVolumeSpecName "kube-api-access-lxz2h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:37:30.127253 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:30.127230 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a36418d-0e8b-4893-b282-c391eacb1808-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "8a36418d-0e8b-4893-b282-c391eacb1808" (UID: "8a36418d-0e8b-4893-b282-c391eacb1808"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:37:30.217811 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:30.217777 2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8a36418d-0e8b-4893-b282-c391eacb1808-tls-cert\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:37:30.217811 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:30.217806 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxz2h\" (UniqueName: \"kubernetes.io/projected/8a36418d-0e8b-4893-b282-c391eacb1808-kube-api-access-lxz2h\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:37:30.458342 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:30.458305 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:37:30.556177 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:30.556138 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:37:30.762138 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:30.762101 2578 generic.go:356] "Generic (PLEG): container finished" podID="8a36418d-0e8b-4893-b282-c391eacb1808" containerID="335c059529180304aae2fea916f4647971768dbe01c37de45faf2bdc5387e6e0" exitCode=0 Jul 02 15:37:30.762545 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:30.762158 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d59f446bb-vllts" Jul 02 15:37:30.762545 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:30.762190 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d59f446bb-vllts" event={"ID":"8a36418d-0e8b-4893-b282-c391eacb1808","Type":"ContainerDied","Data":"335c059529180304aae2fea916f4647971768dbe01c37de45faf2bdc5387e6e0"} Jul 02 15:37:30.762545 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:30.762232 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d59f446bb-vllts" event={"ID":"8a36418d-0e8b-4893-b282-c391eacb1808","Type":"ContainerDied","Data":"4d3ee8e72c44439ec697125efc2280c7df6f77937ae6748b1559c11001ea87f4"} Jul 02 15:37:30.762545 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:30.762254 2578 scope.go:117] "RemoveContainer" containerID="335c059529180304aae2fea916f4647971768dbe01c37de45faf2bdc5387e6e0" Jul 02 15:37:30.770592 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:30.770577 2578 scope.go:117] "RemoveContainer" containerID="335c059529180304aae2fea916f4647971768dbe01c37de45faf2bdc5387e6e0" Jul 02 15:37:30.770849 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:37:30.770831 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"335c059529180304aae2fea916f4647971768dbe01c37de45faf2bdc5387e6e0\": container with ID starting with 335c059529180304aae2fea916f4647971768dbe01c37de45faf2bdc5387e6e0 not found: ID does not exist" containerID="335c059529180304aae2fea916f4647971768dbe01c37de45faf2bdc5387e6e0" Jul 02 15:37:30.770927 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:30.770858 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"335c059529180304aae2fea916f4647971768dbe01c37de45faf2bdc5387e6e0"} err="failed to get container status \"335c059529180304aae2fea916f4647971768dbe01c37de45faf2bdc5387e6e0\": rpc error: code = NotFound desc = could not find container \"335c059529180304aae2fea916f4647971768dbe01c37de45faf2bdc5387e6e0\": container with ID starting with 335c059529180304aae2fea916f4647971768dbe01c37de45faf2bdc5387e6e0 not found: ID does not exist" Jul 02 15:37:30.781639 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:30.781614 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d59f446bb-vllts"] Jul 02 15:37:30.784988 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:30.784964 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7d59f446bb-vllts"] Jul 02 15:37:30.817635 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:30.817599 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a36418d-0e8b-4893-b282-c391eacb1808" path="/var/lib/kubelet/pods/8a36418d-0e8b-4893-b282-c391eacb1808/volumes" Jul 02 15:37:49.463073 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:49.463017 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:37:49.906710 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:37:49.906673 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlqtn"] Jul 02 15:38:04.606083 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:04.606051 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:38:05.290888 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:05.290849 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlqtn"] Jul 02 15:38:12.905880 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:12.905848 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:38:13.903486 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:13.903451 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlqtn"] Jul 02 15:38:19.931800 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:19.931765 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:38:21.395766 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:21.395730 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlqtn"] Jul 02 15:38:39.807127 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:39.807088 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:38:41.896130 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:41.896097 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlqtn"] Jul 02 15:38:52.273504 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.273475 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t"] Jul 02 15:38:52.273965 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.273825 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a36418d-0e8b-4893-b282-c391eacb1808" containerName="authorino" Jul 02 15:38:52.273965 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.273836 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a36418d-0e8b-4893-b282-c391eacb1808" containerName="authorino" Jul 02 15:38:52.273965 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.273925 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a36418d-0e8b-4893-b282-c391eacb1808" containerName="authorino" Jul 02 15:38:52.278113 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.278094 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t" Jul 02 15:38:52.280601 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.280580 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 02 15:38:52.280785 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.280584 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 02 15:38:52.280785 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.280582 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 02 15:38:52.280785 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.280718 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5mqnd\"" Jul 02 15:38:52.288331 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.288309 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t"] Jul 02 15:38:52.314133 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.314106 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:38:52.339400 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.339375 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63042f7e-7f2a-498f-a324-faeb1cb53d59-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t\" (UID: \"63042f7e-7f2a-498f-a324-faeb1cb53d59\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t" Jul 02 15:38:52.339570 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.339425 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63042f7e-7f2a-498f-a324-faeb1cb53d59-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t\" (UID: \"63042f7e-7f2a-498f-a324-faeb1cb53d59\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t" Jul 02 15:38:52.339570 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.339469 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63042f7e-7f2a-498f-a324-faeb1cb53d59-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t\" (UID: \"63042f7e-7f2a-498f-a324-faeb1cb53d59\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t" Jul 02 15:38:52.339570 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.339492 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63042f7e-7f2a-498f-a324-faeb1cb53d59-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t\" (UID: \"63042f7e-7f2a-498f-a324-faeb1cb53d59\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t" Jul 02 15:38:52.339570 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.339524 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljbb8\" (UniqueName: \"kubernetes.io/projected/63042f7e-7f2a-498f-a324-faeb1cb53d59-kube-api-access-ljbb8\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t\" (UID: \"63042f7e-7f2a-498f-a324-faeb1cb53d59\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t" Jul 02 15:38:52.339570 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.339560 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63042f7e-7f2a-498f-a324-faeb1cb53d59-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t\" (UID: \"63042f7e-7f2a-498f-a324-faeb1cb53d59\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t" Jul 02 15:38:52.440189 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.440157 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63042f7e-7f2a-498f-a324-faeb1cb53d59-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t\" (UID: \"63042f7e-7f2a-498f-a324-faeb1cb53d59\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t" Jul 02 15:38:52.440189 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.440191 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63042f7e-7f2a-498f-a324-faeb1cb53d59-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t\" (UID: \"63042f7e-7f2a-498f-a324-faeb1cb53d59\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t" Jul 02 15:38:52.440453 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.440217 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljbb8\" (UniqueName: \"kubernetes.io/projected/63042f7e-7f2a-498f-a324-faeb1cb53d59-kube-api-access-ljbb8\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t\" (UID: \"63042f7e-7f2a-498f-a324-faeb1cb53d59\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t" Jul 02 15:38:52.440453 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.440335 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63042f7e-7f2a-498f-a324-faeb1cb53d59-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t\" (UID: \"63042f7e-7f2a-498f-a324-faeb1cb53d59\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t" Jul 02 15:38:52.440453 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.440426 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63042f7e-7f2a-498f-a324-faeb1cb53d59-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t\" (UID: \"63042f7e-7f2a-498f-a324-faeb1cb53d59\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t" Jul 02 15:38:52.440638 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.440471 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63042f7e-7f2a-498f-a324-faeb1cb53d59-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t\" (UID: \"63042f7e-7f2a-498f-a324-faeb1cb53d59\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t" Jul 02 15:38:52.440638 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.440612 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63042f7e-7f2a-498f-a324-faeb1cb53d59-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t\" (UID: \"63042f7e-7f2a-498f-a324-faeb1cb53d59\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t" Jul 02 15:38:52.440638 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.440619 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63042f7e-7f2a-498f-a324-faeb1cb53d59-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t\" (UID: \"63042f7e-7f2a-498f-a324-faeb1cb53d59\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t" Jul 02 15:38:52.440745 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.440701 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63042f7e-7f2a-498f-a324-faeb1cb53d59-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t\" (UID: \"63042f7e-7f2a-498f-a324-faeb1cb53d59\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t" Jul 02 15:38:52.442679 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.442651 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63042f7e-7f2a-498f-a324-faeb1cb53d59-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t\" (UID: \"63042f7e-7f2a-498f-a324-faeb1cb53d59\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t" Jul 02 15:38:52.442800 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.442734 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63042f7e-7f2a-498f-a324-faeb1cb53d59-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t\" (UID: \"63042f7e-7f2a-498f-a324-faeb1cb53d59\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t" Jul 02 15:38:52.447790 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.447768 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljbb8\" (UniqueName: \"kubernetes.io/projected/63042f7e-7f2a-498f-a324-faeb1cb53d59-kube-api-access-ljbb8\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t\" (UID: \"63042f7e-7f2a-498f-a324-faeb1cb53d59\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t" Jul 02 15:38:52.589390 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.589301 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t" Jul 02 15:38:52.715849 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:52.715817 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t"] Jul 02 15:38:52.719024 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:38:52.718999 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63042f7e_7f2a_498f_a324_faeb1cb53d59.slice/crio-9cbd6c4cce7356290ed7376534899d1a9c37ac7adc17f0244738f7bc4f2568d1 WatchSource:0}: Error finding container 9cbd6c4cce7356290ed7376534899d1a9c37ac7adc17f0244738f7bc4f2568d1: Status 404 returned error can't find the container with id 9cbd6c4cce7356290ed7376534899d1a9c37ac7adc17f0244738f7bc4f2568d1 Jul 02 15:38:53.133888 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:53.133818 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t" event={"ID":"63042f7e-7f2a-498f-a324-faeb1cb53d59","Type":"ContainerStarted","Data":"9cbd6c4cce7356290ed7376534899d1a9c37ac7adc17f0244738f7bc4f2568d1"} Jul 02 15:38:54.139359 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:54.139329 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t" event={"ID":"63042f7e-7f2a-498f-a324-faeb1cb53d59","Type":"ContainerStarted","Data":"32864df0dcfd1d6248f4b88229622c9cb1ea011a7e95b8c32d1983bb5ecfdc51"} Jul 02 15:38:54.157800 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:54.157752 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t" podStartSLOduration=1.113098025 podStartE2EDuration="2.15773812s" totalImagesPullingTime="1.044640095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:38:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:38:54.155938349 +0000 UTC m=+745.785899199" watchObservedRunningTime="2026-07-02 15:38:54.15773812 +0000 UTC m=+745.787698970" Jul 02 15:38:54.591131 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:38:54.591046 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nlqtn"] Jul 02 15:39:02.589838 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:39:02.589798 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t" Jul 02 15:39:02.590403 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:39:02.589857 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t" Jul 02 15:39:02.602835 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:39:02.602805 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t" Jul 02 15:39:03.190467 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:39:03.190432 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t" Jul 02 15:39:29.995604 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:39:29.995557 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:39:30.095601 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:39:30.095552 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:40:20.212807 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:20.212773 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bb6b689fc-h97cv"] Jul 02 15:40:20.215655 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:20.215636 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bb6b689fc-h97cv" Jul 02 15:40:20.225187 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:20.225162 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bb6b689fc-h97cv"] Jul 02 15:40:20.390951 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:20.390913 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/0ca58b1b-7e6f-4eb1-a9c3-0069c2baac5a-oidc-ca\") pod \"authorino-7bb6b689fc-h97cv\" (UID: \"0ca58b1b-7e6f-4eb1-a9c3-0069c2baac5a\") " pod="kuadrant-system/authorino-7bb6b689fc-h97cv" Jul 02 15:40:20.390951 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:20.390958 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0ca58b1b-7e6f-4eb1-a9c3-0069c2baac5a-tls-cert\") pod \"authorino-7bb6b689fc-h97cv\" (UID: \"0ca58b1b-7e6f-4eb1-a9c3-0069c2baac5a\") " pod="kuadrant-system/authorino-7bb6b689fc-h97cv" Jul 02 15:40:20.391150 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:20.390988 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcjqt\" (UniqueName: \"kubernetes.io/projected/0ca58b1b-7e6f-4eb1-a9c3-0069c2baac5a-kube-api-access-kcjqt\") pod \"authorino-7bb6b689fc-h97cv\" (UID: \"0ca58b1b-7e6f-4eb1-a9c3-0069c2baac5a\") " pod="kuadrant-system/authorino-7bb6b689fc-h97cv" Jul 02 15:40:20.491830 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:20.491738 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/0ca58b1b-7e6f-4eb1-a9c3-0069c2baac5a-oidc-ca\") pod \"authorino-7bb6b689fc-h97cv\" (UID: \"0ca58b1b-7e6f-4eb1-a9c3-0069c2baac5a\") " pod="kuadrant-system/authorino-7bb6b689fc-h97cv" Jul 02 15:40:20.491830 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:20.491792 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0ca58b1b-7e6f-4eb1-a9c3-0069c2baac5a-tls-cert\") pod \"authorino-7bb6b689fc-h97cv\" (UID: \"0ca58b1b-7e6f-4eb1-a9c3-0069c2baac5a\") " pod="kuadrant-system/authorino-7bb6b689fc-h97cv" Jul 02 15:40:20.491830 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:20.491822 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcjqt\" (UniqueName: \"kubernetes.io/projected/0ca58b1b-7e6f-4eb1-a9c3-0069c2baac5a-kube-api-access-kcjqt\") pod \"authorino-7bb6b689fc-h97cv\" (UID: \"0ca58b1b-7e6f-4eb1-a9c3-0069c2baac5a\") " pod="kuadrant-system/authorino-7bb6b689fc-h97cv" Jul 02 15:40:20.492388 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:20.492365 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/0ca58b1b-7e6f-4eb1-a9c3-0069c2baac5a-oidc-ca\") pod \"authorino-7bb6b689fc-h97cv\" (UID: \"0ca58b1b-7e6f-4eb1-a9c3-0069c2baac5a\") " pod="kuadrant-system/authorino-7bb6b689fc-h97cv" Jul 02 15:40:20.494158 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:20.494140 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0ca58b1b-7e6f-4eb1-a9c3-0069c2baac5a-tls-cert\") pod \"authorino-7bb6b689fc-h97cv\" (UID: \"0ca58b1b-7e6f-4eb1-a9c3-0069c2baac5a\") " pod="kuadrant-system/authorino-7bb6b689fc-h97cv" Jul 02 15:40:20.499963 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:20.499941 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcjqt\" (UniqueName: \"kubernetes.io/projected/0ca58b1b-7e6f-4eb1-a9c3-0069c2baac5a-kube-api-access-kcjqt\") pod \"authorino-7bb6b689fc-h97cv\" (UID: \"0ca58b1b-7e6f-4eb1-a9c3-0069c2baac5a\") " pod="kuadrant-system/authorino-7bb6b689fc-h97cv" Jul 02 15:40:20.524641 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:20.524614 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bb6b689fc-h97cv" Jul 02 15:40:20.656054 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:20.655922 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bb6b689fc-h97cv"] Jul 02 15:40:20.659549 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:40:20.659521 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ca58b1b_7e6f_4eb1_a9c3_0069c2baac5a.slice/crio-0d034c40a9d747e674eb5a4939bb6ec416f213b8bf73adcb81f9d8bf0d4fe7f0 WatchSource:0}: Error finding container 0d034c40a9d747e674eb5a4939bb6ec416f213b8bf73adcb81f9d8bf0d4fe7f0: Status 404 returned error can't find the container with id 0d034c40a9d747e674eb5a4939bb6ec416f213b8bf73adcb81f9d8bf0d4fe7f0 Jul 02 15:40:21.521934 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:21.521844 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bb6b689fc-h97cv" event={"ID":"0ca58b1b-7e6f-4eb1-a9c3-0069c2baac5a","Type":"ContainerStarted","Data":"5b8af4de7fdb648a346cb795ee8399ebbbace464fda4d3611886dbccd9aa3361"} Jul 02 15:40:21.521934 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:21.521890 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bb6b689fc-h97cv" event={"ID":"0ca58b1b-7e6f-4eb1-a9c3-0069c2baac5a","Type":"ContainerStarted","Data":"0d034c40a9d747e674eb5a4939bb6ec416f213b8bf73adcb81f9d8bf0d4fe7f0"} Jul 02 15:40:21.542122 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:21.542019 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bb6b689fc-h97cv" podStartSLOduration=1.158523156 podStartE2EDuration="1.542000269s" totalImagesPullingTime="383.477113ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:40:21.539216088 +0000 UTC m=+833.169176940" watchObservedRunningTime="2026-07-02 15:40:21.542000269 +0000 UTC m=+833.171961121" Jul 02 15:40:21.574502 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:21.574467 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c59c96f4d-7mbph"] Jul 02 15:40:21.574969 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:21.574771 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7c59c96f4d-7mbph" podUID="98c198d5-4e00-443d-ad09-51279d3bcb68" containerName="authorino" containerID="cri-o://db4fb0d9c13f73aaf156074e6e519120d5297767682662f1f13b159b44707a89" gracePeriod=30 Jul 02 15:40:21.830508 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:21.830483 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c59c96f4d-7mbph" Jul 02 15:40:22.008709 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:22.008671 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/98c198d5-4e00-443d-ad09-51279d3bcb68-tls-cert\") pod \"98c198d5-4e00-443d-ad09-51279d3bcb68\" (UID: \"98c198d5-4e00-443d-ad09-51279d3bcb68\") " Jul 02 15:40:22.008918 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:22.008727 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/98c198d5-4e00-443d-ad09-51279d3bcb68-oidc-ca\") pod \"98c198d5-4e00-443d-ad09-51279d3bcb68\" (UID: \"98c198d5-4e00-443d-ad09-51279d3bcb68\") " Jul 02 15:40:22.008918 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:22.008807 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dddt\" (UniqueName: \"kubernetes.io/projected/98c198d5-4e00-443d-ad09-51279d3bcb68-kube-api-access-8dddt\") pod \"98c198d5-4e00-443d-ad09-51279d3bcb68\" (UID: \"98c198d5-4e00-443d-ad09-51279d3bcb68\") " Jul 02 15:40:22.010851 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:22.010804 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98c198d5-4e00-443d-ad09-51279d3bcb68-kube-api-access-8dddt" (OuterVolumeSpecName: "kube-api-access-8dddt") pod "98c198d5-4e00-443d-ad09-51279d3bcb68" (UID: "98c198d5-4e00-443d-ad09-51279d3bcb68"). InnerVolumeSpecName "kube-api-access-8dddt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:40:22.013336 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:22.013305 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98c198d5-4e00-443d-ad09-51279d3bcb68-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "98c198d5-4e00-443d-ad09-51279d3bcb68" (UID: "98c198d5-4e00-443d-ad09-51279d3bcb68"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:40:22.018303 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:22.018268 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98c198d5-4e00-443d-ad09-51279d3bcb68-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "98c198d5-4e00-443d-ad09-51279d3bcb68" (UID: "98c198d5-4e00-443d-ad09-51279d3bcb68"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:40:22.110375 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:22.110344 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dddt\" (UniqueName: \"kubernetes.io/projected/98c198d5-4e00-443d-ad09-51279d3bcb68-kube-api-access-8dddt\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:40:22.110375 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:22.110375 2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/98c198d5-4e00-443d-ad09-51279d3bcb68-tls-cert\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:40:22.110560 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:22.110384 2578 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/98c198d5-4e00-443d-ad09-51279d3bcb68-oidc-ca\") on node \"ip-10-0-135-113.ec2.internal\" DevicePath \"\"" Jul 02 15:40:22.276019 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:22.275983 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:40:22.378016 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:22.377887 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:40:22.527693 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:22.527658 2578 generic.go:356] "Generic (PLEG): container finished" podID="98c198d5-4e00-443d-ad09-51279d3bcb68" containerID="db4fb0d9c13f73aaf156074e6e519120d5297767682662f1f13b159b44707a89" exitCode=0 Jul 02 15:40:22.527693 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:22.527702 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c59c96f4d-7mbph" Jul 02 15:40:22.528242 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:22.527745 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c59c96f4d-7mbph" event={"ID":"98c198d5-4e00-443d-ad09-51279d3bcb68","Type":"ContainerDied","Data":"db4fb0d9c13f73aaf156074e6e519120d5297767682662f1f13b159b44707a89"} Jul 02 15:40:22.528242 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:22.527803 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c59c96f4d-7mbph" event={"ID":"98c198d5-4e00-443d-ad09-51279d3bcb68","Type":"ContainerDied","Data":"85bc18d28f0a31dc375914fb32db87b747bdf8d15289e9be018598fc90b08cde"} Jul 02 15:40:22.528242 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:22.527838 2578 scope.go:117] "RemoveContainer" containerID="db4fb0d9c13f73aaf156074e6e519120d5297767682662f1f13b159b44707a89" Jul 02 15:40:22.537616 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:22.537598 2578 scope.go:117] "RemoveContainer" containerID="db4fb0d9c13f73aaf156074e6e519120d5297767682662f1f13b159b44707a89" Jul 02 15:40:22.537877 ip-10-0-135-113 kubenswrapper[2578]: E0702 15:40:22.537860 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db4fb0d9c13f73aaf156074e6e519120d5297767682662f1f13b159b44707a89\": container with ID starting with db4fb0d9c13f73aaf156074e6e519120d5297767682662f1f13b159b44707a89 not found: ID does not exist" containerID="db4fb0d9c13f73aaf156074e6e519120d5297767682662f1f13b159b44707a89" Jul 02 15:40:22.537964 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:22.537887 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db4fb0d9c13f73aaf156074e6e519120d5297767682662f1f13b159b44707a89"} err="failed to get container status \"db4fb0d9c13f73aaf156074e6e519120d5297767682662f1f13b159b44707a89\": rpc error: code = NotFound desc = could not find container \"db4fb0d9c13f73aaf156074e6e519120d5297767682662f1f13b159b44707a89\": container with ID starting with db4fb0d9c13f73aaf156074e6e519120d5297767682662f1f13b159b44707a89 not found: ID does not exist" Jul 02 15:40:22.550074 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:22.550041 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c59c96f4d-7mbph"] Jul 02 15:40:22.555151 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:22.555129 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7c59c96f4d-7mbph"] Jul 02 15:40:22.817977 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:22.817863 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98c198d5-4e00-443d-ad09-51279d3bcb68" path="/var/lib/kubelet/pods/98c198d5-4e00-443d-ad09-51279d3bcb68/volumes" Jul 02 15:40:23.381575 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:23.381544 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:40:23.478427 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:23.478392 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:40:46.828547 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:40:46.828486 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:41:01.599231 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:01.599201 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7bb6b689fc-h97cv_0ca58b1b-7e6f-4eb1-a9c3-0069c2baac5a/authorino/0.log" Jul 02 15:41:06.732315 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:06.732287 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-dshtn_d7138dfd-4467-4caf-b4d6-2ea79d88ce9c/server/0.log" Jul 02 15:41:06.975250 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:06.975224 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d66c884b7-b8pds_1de9a322-128a-4b24-9a6f-cbd75f3d46d3/copy-manifests/0.log" Jul 02 15:41:06.989244 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:06.989190 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d66c884b7-b8pds_1de9a322-128a-4b24-9a6f-cbd75f3d46d3/manager/0.log" Jul 02 15:41:08.640642 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:08.640612 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7bb6b689fc-h97cv_0ca58b1b-7e6f-4eb1-a9c3-0069c2baac5a/authorino/0.log" Jul 02 15:41:08.754101 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:08.754078 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-cqtzp_364efa7a-6e27-4670-a20a-20fa02f77432/manager/0.log" Jul 02 15:41:08.976828 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:08.976751 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-77mdx_da73cb94-bc90-439f-9ed8-e96b39592203/kuadrant-console-plugin/0.log" Jul 02 15:41:09.376962 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:09.376929 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-nlqtn_ffe192c5-428d-47e9-8ff9-4b8f8e4d73bd/limitador/0.log" Jul 02 15:41:10.180368 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:10.180343 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-655c797d79-kqr8k_23d445b9-5e3c-4ca1-a1e8-5d22a486b73b/kube-auth-proxy/0.log" Jul 02 15:41:11.553116 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:11.553089 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-b8q4t_63042f7e-7f2a-498f-a324-faeb1cb53d59/main/0.log" Jul 02 15:41:15.543110 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:15.543070 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kzv4s/must-gather-grng4"] Jul 02 15:41:15.543577 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:15.543539 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98c198d5-4e00-443d-ad09-51279d3bcb68" containerName="authorino" Jul 02 15:41:15.543577 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:15.543556 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="98c198d5-4e00-443d-ad09-51279d3bcb68" containerName="authorino" Jul 02 15:41:15.543704 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:15.543689 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="98c198d5-4e00-443d-ad09-51279d3bcb68" containerName="authorino" Jul 02 15:41:15.546811 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:15.546789 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kzv4s/must-gather-grng4" Jul 02 15:41:15.549288 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:15.549268 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kzv4s\"/\"kube-root-ca.crt\"" Jul 02 15:41:15.549884 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:15.549865 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kzv4s\"/\"openshift-service-ca.crt\"" Jul 02 15:41:15.549993 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:15.549867 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kzv4s\"/\"default-dockercfg-2tq5g\"" Jul 02 15:41:15.557098 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:15.557076 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kzv4s/must-gather-grng4"] Jul 02 15:41:15.560311 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:15.560284 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:41:15.568462 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:15.568434 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/034eb053-29ea-4ce4-8699-21702f240db8-must-gather-output\") pod \"must-gather-grng4\" (UID: \"034eb053-29ea-4ce4-8699-21702f240db8\") " pod="openshift-must-gather-kzv4s/must-gather-grng4" Jul 02 15:41:15.568593 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:15.568572 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnqrs\" (UniqueName: \"kubernetes.io/projected/034eb053-29ea-4ce4-8699-21702f240db8-kube-api-access-hnqrs\") pod \"must-gather-grng4\" (UID: \"034eb053-29ea-4ce4-8699-21702f240db8\") " pod="openshift-must-gather-kzv4s/must-gather-grng4" Jul 02 15:41:15.669834 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:15.669796 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnqrs\" (UniqueName: \"kubernetes.io/projected/034eb053-29ea-4ce4-8699-21702f240db8-kube-api-access-hnqrs\") pod \"must-gather-grng4\" (UID: \"034eb053-29ea-4ce4-8699-21702f240db8\") " pod="openshift-must-gather-kzv4s/must-gather-grng4" Jul 02 15:41:15.670012 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:15.669863 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/034eb053-29ea-4ce4-8699-21702f240db8-must-gather-output\") pod \"must-gather-grng4\" (UID: \"034eb053-29ea-4ce4-8699-21702f240db8\") " pod="openshift-must-gather-kzv4s/must-gather-grng4" Jul 02 15:41:15.670236 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:15.670217 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/034eb053-29ea-4ce4-8699-21702f240db8-must-gather-output\") pod \"must-gather-grng4\" (UID: \"034eb053-29ea-4ce4-8699-21702f240db8\") " pod="openshift-must-gather-kzv4s/must-gather-grng4" Jul 02 15:41:15.681948 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:15.681914 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnqrs\" (UniqueName: \"kubernetes.io/projected/034eb053-29ea-4ce4-8699-21702f240db8-kube-api-access-hnqrs\") pod \"must-gather-grng4\" (UID: \"034eb053-29ea-4ce4-8699-21702f240db8\") " pod="openshift-must-gather-kzv4s/must-gather-grng4" Jul 02 15:41:15.857837 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:15.857812 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kzv4s/must-gather-grng4" Jul 02 15:41:15.986618 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:15.986592 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kzv4s/must-gather-grng4"] Jul 02 15:41:15.989055 ip-10-0-135-113 kubenswrapper[2578]: W0702 15:41:15.989030 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod034eb053_29ea_4ce4_8699_21702f240db8.slice/crio-302fe4dad1533dd31aad536b64080ada75c0865b52b7deadd94d751d15662e9a WatchSource:0}: Error finding container 302fe4dad1533dd31aad536b64080ada75c0865b52b7deadd94d751d15662e9a: Status 404 returned error can't find the container with id 302fe4dad1533dd31aad536b64080ada75c0865b52b7deadd94d751d15662e9a Jul 02 15:41:16.779661 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:16.779626 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kzv4s/must-gather-grng4" event={"ID":"034eb053-29ea-4ce4-8699-21702f240db8","Type":"ContainerStarted","Data":"302fe4dad1533dd31aad536b64080ada75c0865b52b7deadd94d751d15662e9a"} Jul 02 15:41:17.794216 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:17.794179 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kzv4s/must-gather-grng4" event={"ID":"034eb053-29ea-4ce4-8699-21702f240db8","Type":"ContainerStarted","Data":"16bac5aa4fe53b9c01e621a8e0879c07f086ea577d03468a6b3199f78ff56a4c"} Jul 02 15:41:17.794766 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:17.794722 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kzv4s/must-gather-grng4" event={"ID":"034eb053-29ea-4ce4-8699-21702f240db8","Type":"ContainerStarted","Data":"a9ba3c52483c48ee962c0e83b09be8ffdc528d3a4c5be383ffa3f349bcfbdb9e"} Jul 02 15:41:17.810453 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:17.810361 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kzv4s/must-gather-grng4" podStartSLOduration=1.95843194 podStartE2EDuration="2.810339772s" totalImagesPullingTime="851.907832ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:41:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:41:17.809640779 +0000 UTC m=+889.439601634" watchObservedRunningTime="2026-07-02 15:41:17.810339772 +0000 UTC m=+889.440300623" Jul 02 15:41:18.530112 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:18.530030 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" limit=1024 Jul 02 15:41:18.654086 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:18.654057 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7z5mp_ac822a5a-c97b-4159-ac19-0000a2b4abfb/global-pull-secret-syncer/0.log" Jul 02 15:41:18.781558 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:18.781464 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-97w5x_2e46981c-18a5-46c3-b9d9-994de1e6fb32/konnectivity-agent/0.log" Jul 02 15:41:18.882760 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:18.882729 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-113.ec2.internal_6dfe551c5f5beaf25438e21f19169d54/haproxy/0.log" Jul 02 15:41:23.515498 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:23.515432 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7bb6b689fc-h97cv_0ca58b1b-7e6f-4eb1-a9c3-0069c2baac5a/authorino/0.log" Jul 02 15:41:23.548267 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:23.548066 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-cqtzp_364efa7a-6e27-4670-a20a-20fa02f77432/manager/0.log" Jul 02 15:41:23.616568 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:23.616540 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-77mdx_da73cb94-bc90-439f-9ed8-e96b39592203/kuadrant-console-plugin/0.log" Jul 02 15:41:23.718197 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:23.718002 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-nlqtn_ffe192c5-428d-47e9-8ff9-4b8f8e4d73bd/limitador/0.log" Jul 02 15:41:26.001343 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:26.001269 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-wk52z_f326861e-c941-4521-b3b8-9372a68c5d25/monitoring-plugin/0.log" Jul 02 15:41:26.064482 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:26.064446 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cz2gr_3611668d-85c3-483b-9761-e807dc98ea75/node-exporter/0.log" Jul 02 15:41:26.100166 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:26.100058 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cz2gr_3611668d-85c3-483b-9761-e807dc98ea75/kube-rbac-proxy/0.log" Jul 02 15:41:26.142963 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:26.142930 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cz2gr_3611668d-85c3-483b-9761-e807dc98ea75/init-textfile/0.log" Jul 02 15:41:26.577026 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:26.576986 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7adb4dc4-7629-49a4-bab7-0c07292df168/prometheus/0.log" Jul 02 15:41:26.618823 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:26.618802 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7adb4dc4-7629-49a4-bab7-0c07292df168/config-reloader/0.log" Jul 02 15:41:26.658038 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:26.658009 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7adb4dc4-7629-49a4-bab7-0c07292df168/thanos-sidecar/0.log" Jul 02 15:41:26.701968 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:26.701938 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7adb4dc4-7629-49a4-bab7-0c07292df168/kube-rbac-proxy-web/0.log" Jul 02 15:41:26.740990 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:26.740961 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7adb4dc4-7629-49a4-bab7-0c07292df168/kube-rbac-proxy/0.log" Jul 02 15:41:26.770261 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:26.770222 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7adb4dc4-7629-49a4-bab7-0c07292df168/kube-rbac-proxy-thanos/0.log" Jul 02 15:41:26.797025 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:26.796915 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7adb4dc4-7629-49a4-bab7-0c07292df168/init-config-reloader/0.log" Jul 02 15:41:26.834560 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:26.834533 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-jpcp9_18b267e0-3560-449a-a588-66886974070a/prometheus-operator/0.log" Jul 02 15:41:26.861595 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:26.861564 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-jpcp9_18b267e0-3560-449a-a588-66886974070a/kube-rbac-proxy/0.log" Jul 02 15:41:26.919830 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:26.919744 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75d49746c4-pg77h_3c987e35-1f1d-4a3e-be84-fd9ea022430a/telemeter-client/0.log" Jul 02 15:41:26.945706 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:26.945665 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75d49746c4-pg77h_3c987e35-1f1d-4a3e-be84-fd9ea022430a/reload/0.log" Jul 02 15:41:26.970348 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:26.970324 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75d49746c4-pg77h_3c987e35-1f1d-4a3e-be84-fd9ea022430a/kube-rbac-proxy/0.log" Jul 02 15:41:27.005977 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:27.005942 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b44dfcfc4-hljql_a7251074-9516-49dd-9772-d4167678dac9/thanos-query/0.log" Jul 02 15:41:27.029649 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:27.029621 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b44dfcfc4-hljql_a7251074-9516-49dd-9772-d4167678dac9/kube-rbac-proxy-web/0.log" Jul 02 15:41:27.054283 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:27.054256 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b44dfcfc4-hljql_a7251074-9516-49dd-9772-d4167678dac9/kube-rbac-proxy/0.log" Jul 02 15:41:27.079309 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:27.079286 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b44dfcfc4-hljql_a7251074-9516-49dd-9772-d4167678dac9/prom-label-proxy/0.log" Jul 02 15:41:27.106173 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:27.106145 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b44dfcfc4-hljql_a7251074-9516-49dd-9772-d4167678dac9/kube-rbac-proxy-rules/0.log" Jul 02 15:41:27.131615 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:27.131584 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b44dfcfc4-hljql_a7251074-9516-49dd-9772-d4167678dac9/kube-rbac-proxy-metrics/0.log" Jul 02 15:41:28.858662 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:28.858158 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2pztp_9a21b8b7-cc97-4782-aa1f-1ebd124c2987/ovn-acl-logging/0.log" Jul 02 15:41:28.861938 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:28.861914 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2pztp_9a21b8b7-cc97-4782-aa1f-1ebd124c2987/ovn-acl-logging/0.log" Jul 02 15:41:29.032732 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:29.032698 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kzv4s/perf-node-gather-daemonset-k5w9l"] Jul 02 15:41:29.047493 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:29.046926 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-k5w9l" Jul 02 15:41:29.047680 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:29.047645 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kzv4s/perf-node-gather-daemonset-k5w9l"] Jul 02 15:41:29.124366 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:29.124267 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f008719a-6185-4ff4-aa4c-d25433d86d00-proc\") pod \"perf-node-gather-daemonset-k5w9l\" (UID: \"f008719a-6185-4ff4-aa4c-d25433d86d00\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-k5w9l" Jul 02 15:41:29.124366 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:29.124340 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f008719a-6185-4ff4-aa4c-d25433d86d00-sys\") pod \"perf-node-gather-daemonset-k5w9l\" (UID: \"f008719a-6185-4ff4-aa4c-d25433d86d00\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-k5w9l" Jul 02 15:41:29.124366 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:29.124367 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f008719a-6185-4ff4-aa4c-d25433d86d00-podres\") pod \"perf-node-gather-daemonset-k5w9l\" (UID: \"f008719a-6185-4ff4-aa4c-d25433d86d00\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-k5w9l" Jul 02 15:41:29.124595 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:29.124399 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f008719a-6185-4ff4-aa4c-d25433d86d00-lib-modules\") pod \"perf-node-gather-daemonset-k5w9l\" (UID: \"f008719a-6185-4ff4-aa4c-d25433d86d00\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-k5w9l" Jul 02 15:41:29.124595 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:29.124421 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvp5f\" (UniqueName: \"kubernetes.io/projected/f008719a-6185-4ff4-aa4c-d25433d86d00-kube-api-access-vvp5f\") pod \"perf-node-gather-daemonset-k5w9l\" (UID: \"f008719a-6185-4ff4-aa4c-d25433d86d00\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-k5w9l" Jul 02 15:41:29.225148 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:29.225108 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f008719a-6185-4ff4-aa4c-d25433d86d00-lib-modules\") pod \"perf-node-gather-daemonset-k5w9l\" (UID: \"f008719a-6185-4ff4-aa4c-d25433d86d00\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-k5w9l" Jul 02 15:41:29.225328 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:29.225159 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvp5f\" (UniqueName: \"kubernetes.io/projected/f008719a-6185-4ff4-aa4c-d25433d86d00-kube-api-access-vvp5f\") pod \"perf-node-gather-daemonset-k5w9l\" (UID: \"f008719a-6185-4ff4-aa4c-d25433d86d00\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-k5w9l" Jul 02 15:41:29.225328 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:29.225220 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f008719a-6185-4ff4-aa4c-d25433d86d00-proc\") pod \"perf-node-gather-daemonset-k5w9l\" (UID: \"f008719a-6185-4ff4-aa4c-d25433d86d00\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-k5w9l" Jul 02 15:41:29.225328 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:29.225290 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f008719a-6185-4ff4-aa4c-d25433d86d00-sys\") pod \"perf-node-gather-daemonset-k5w9l\" (UID: \"f008719a-6185-4ff4-aa4c-d25433d86d00\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-k5w9l" Jul 02 15:41:29.225328 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:29.225302 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f008719a-6185-4ff4-aa4c-d25433d86d00-lib-modules\") pod \"perf-node-gather-daemonset-k5w9l\" (UID: \"f008719a-6185-4ff4-aa4c-d25433d86d00\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-k5w9l" Jul 02 15:41:29.225551 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:29.225348 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f008719a-6185-4ff4-aa4c-d25433d86d00-podres\") pod \"perf-node-gather-daemonset-k5w9l\" (UID: \"f008719a-6185-4ff4-aa4c-d25433d86d00\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-k5w9l" Jul 02 15:41:29.225551 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:29.225377 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f008719a-6185-4ff4-aa4c-d25433d86d00-sys\") pod \"perf-node-gather-daemonset-k5w9l\" (UID: \"f008719a-6185-4ff4-aa4c-d25433d86d00\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-k5w9l" Jul 02 15:41:29.225551 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:29.225388 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f008719a-6185-4ff4-aa4c-d25433d86d00-proc\") pod \"perf-node-gather-daemonset-k5w9l\" (UID: \"f008719a-6185-4ff4-aa4c-d25433d86d00\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-k5w9l" Jul 02 15:41:29.225551 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:29.225484 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f008719a-6185-4ff4-aa4c-d25433d86d00-podres\") pod \"perf-node-gather-daemonset-k5w9l\" (UID: \"f008719a-6185-4ff4-aa4c-d25433d86d00\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-k5w9l" Jul 02 15:41:29.233184 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:29.233158 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvp5f\" (UniqueName: \"kubernetes.io/projected/f008719a-6185-4ff4-aa4c-d25433d86d00-kube-api-access-vvp5f\") pod \"perf-node-gather-daemonset-k5w9l\" (UID: \"f008719a-6185-4ff4-aa4c-d25433d86d00\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-k5w9l" Jul 02 15:41:29.364833 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:29.364800 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-k5w9l" Jul 02 15:41:29.529132 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:29.527492 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kzv4s/perf-node-gather-daemonset-k5w9l"] Jul 02 15:41:29.880991 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:29.880952 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-k5w9l" event={"ID":"f008719a-6185-4ff4-aa4c-d25433d86d00","Type":"ContainerStarted","Data":"f1644f0efd277b2a3b0094627901145ee7c3fa93511d296439c7b2092eae6e0c"} Jul 02 15:41:29.881343 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:29.881023 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-k5w9l" event={"ID":"f008719a-6185-4ff4-aa4c-d25433d86d00","Type":"ContainerStarted","Data":"d6ce9bc8fd3344554c474c1057500de3da68975219c1888cc5723510208cda16"} Jul 02 15:41:29.881343 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:29.881078 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-k5w9l" Jul 02 15:41:29.896149 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:29.896064 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-k5w9l" podStartSLOduration=0.896047806 podStartE2EDuration="896.047806ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:41:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:41:29.894943266 +0000 UTC m=+901.524904118" watchObservedRunningTime="2026-07-02 15:41:29.896047806 +0000 UTC m=+901.526008657" Jul 02 15:41:31.178533 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:31.178509 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nd9r4_55bdc49f-63bf-41e4-bd85-c8cbdaa114e2/dns/0.log" Jul 02 15:41:31.201537 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:31.201512 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nd9r4_55bdc49f-63bf-41e4-bd85-c8cbdaa114e2/kube-rbac-proxy/0.log" Jul 02 15:41:31.274296 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:31.274265 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w55cq_c6ab9c6a-2d0b-44aa-bffe-dde4a008d96b/dns-node-resolver/0.log" Jul 02 15:41:31.882553 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:31.882516 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-htbq4_41acdf42-e5fb-4f2c-8316-1c2f1cd993ff/node-ca/0.log" Jul 02 15:41:33.026642 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:33.026611 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-655c797d79-kqr8k_23d445b9-5e3c-4ca1-a1e8-5d22a486b73b/kube-auth-proxy/0.log" Jul 02 15:41:33.789443 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:33.789419 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2w56m_329a2f36-230c-4b1e-a91b-edad15b028ca/serve-healthcheck-canary/0.log" Jul 02 15:41:34.375783 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:34.375748 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-krdd9_0de4f1e9-d2ea-443f-b4f2-27c40d5a889c/kube-rbac-proxy/0.log" Jul 02 15:41:34.397684 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:34.397655 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-krdd9_0de4f1e9-d2ea-443f-b4f2-27c40d5a889c/exporter/0.log" Jul 02 15:41:34.420837 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:34.420807 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-krdd9_0de4f1e9-d2ea-443f-b4f2-27c40d5a889c/extractor/0.log" Jul 02 15:41:35.898920 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:35.898873 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-k5w9l" Jul 02 15:41:36.880163 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:36.880131 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-dshtn_d7138dfd-4467-4caf-b4d6-2ea79d88ce9c/server/0.log" Jul 02 15:41:37.016417 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:37.016390 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d66c884b7-b8pds_1de9a322-128a-4b24-9a6f-cbd75f3d46d3/manager/0.log" Jul 02 15:41:37.035826 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:37.035792 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d66c884b7-b8pds_1de9a322-128a-4b24-9a6f-cbd75f3d46d3/copy-manifests/0.log" Jul 02 15:41:38.696889 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:38.696856 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-578857ff64-r292d_ea88b191-cee6-4b6e-8ac9-b659ff43ee8f/manager/0.log" Jul 02 15:41:39.259098 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:39.259068 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-655c797d79-kqr8k_23d445b9-5e3c-4ca1-a1e8-5d22a486b73b/kube-auth-proxy/0.log" Jul 02 15:41:40.472077 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:40.472040 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-655c797d79-kqr8k_23d445b9-5e3c-4ca1-a1e8-5d22a486b73b/kube-auth-proxy/0.log" Jul 02 15:41:45.115447 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:45.115417 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pxskq_7ef605e3-b6e6-4783-9012-0d29145c81d3/kube-multus-additional-cni-plugins/0.log" Jul 02 15:41:45.139886 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:45.139866 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pxskq_7ef605e3-b6e6-4783-9012-0d29145c81d3/egress-router-binary-copy/0.log" Jul 02 15:41:45.166159 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:45.166121 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pxskq_7ef605e3-b6e6-4783-9012-0d29145c81d3/cni-plugins/0.log" Jul 02 15:41:45.189956 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:45.189926 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pxskq_7ef605e3-b6e6-4783-9012-0d29145c81d3/bond-cni-plugin/0.log" Jul 02 15:41:45.212504 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:45.212477 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pxskq_7ef605e3-b6e6-4783-9012-0d29145c81d3/routeoverride-cni/0.log" Jul 02 15:41:45.237672 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:45.237645 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pxskq_7ef605e3-b6e6-4783-9012-0d29145c81d3/whereabouts-cni-bincopy/0.log" Jul 02 15:41:45.263108 ip-10-0-135-113 kubenswrapper[2578]: I0702 15:41:45.263084 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pxskq_7ef605e3-b6e6-4783-9012-0d29145c81d3/whereabouts-cni/0.log"