Jul 02 18:59:27.156933 ip-10-0-130-197 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 02 18:59:27.156945 ip-10-0-130-197 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 02 18:59:27.156952 ip-10-0-130-197 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 02 18:59:27.157200 ip-10-0-130-197 systemd[1]: Failed to start Kubernetes Kubelet. Jul 02 18:59:37.252338 ip-10-0-130-197 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 02 18:59:37.252358 ip-10-0-130-197 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot aaeb1061130748d9a19ee917ab95469d -- Jul 02 19:01:10.631321 ip-10-0-130-197 systemd[1]: Starting Kubernetes Kubelet... Jul 02 19:01:11.057094 ip-10-0-130-197 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 19:01:11.057094 ip-10-0-130-197 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 19:01:11.057094 ip-10-0-130-197 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 19:01:11.057094 ip-10-0-130-197 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 19:01:11.057094 ip-10-0-130-197 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 19:01:11.058949 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.058853 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 19:01:11.063815 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063797 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:01:11.063815 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063814 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:01:11.063882 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063817 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:01:11.063882 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063821 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:01:11.063882 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063824 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:01:11.063882 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063827 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:01:11.063882 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063830 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:01:11.063882 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063833 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:01:11.063882 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063836 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:01:11.063882 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063839 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:01:11.063882 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063844 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:01:11.063882 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063847 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:01:11.063882 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063850 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:01:11.063882 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063853 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:01:11.063882 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063858 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:01:11.063882 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063861 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:01:11.063882 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063865 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:01:11.063882 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063868 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:01:11.063882 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063871 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:01:11.063882 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063873 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:01:11.063882 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063876 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:01:11.063882 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063879 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:01:11.064380 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063881 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:01:11.064380 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063884 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:01:11.064380 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063886 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:01:11.064380 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063889 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:01:11.064380 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063892 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:01:11.064380 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063895 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:01:11.064380 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063898 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:01:11.064380 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063901 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:01:11.064380 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063903 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:01:11.064380 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063906 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:01:11.064380 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063911 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:01:11.064380 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063914 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:01:11.064380 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063917 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:01:11.064380 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063920 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:01:11.064380 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063922 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:01:11.064380 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063925 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:01:11.064380 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063928 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:01:11.064380 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063931 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:01:11.064380 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063934 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:01:11.064828 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063936 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:01:11.064828 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063939 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:01:11.064828 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063942 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:01:11.064828 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063945 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:01:11.064828 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063948 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:01:11.064828 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063950 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:01:11.064828 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063953 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:01:11.064828 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063955 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:01:11.064828 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063958 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:01:11.064828 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063960 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:01:11.064828 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063963 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:01:11.064828 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063965 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:01:11.064828 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063968 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:01:11.064828 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063970 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:01:11.064828 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063974 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:01:11.064828 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063977 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:01:11.064828 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063980 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:01:11.064828 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063983 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:01:11.064828 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.063997 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:01:11.064828 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064000 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:01:11.065357 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064003 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:01:11.065357 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064006 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:01:11.065357 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064009 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:01:11.065357 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064012 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:01:11.065357 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064014 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:01:11.065357 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064017 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:01:11.065357 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064019 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:01:11.065357 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064023 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:01:11.065357 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064025 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:01:11.065357 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064028 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:01:11.065357 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064030 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:01:11.065357 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064033 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:01:11.065357 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064035 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:01:11.065357 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064038 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:01:11.065357 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064040 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:01:11.065357 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064042 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:01:11.065357 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064046 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:01:11.065357 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064049 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:01:11.065357 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064052 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:01:11.066087 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064055 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:01:11.066087 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064057 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:01:11.066087 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064061 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:01:11.066087 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064065 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:01:11.066087 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064068 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:01:11.066087 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064070 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:01:11.066087 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064073 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:01:11.066087 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064077 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:01:11.066087 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064079 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:01:11.066087 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064082 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:01:11.066087 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064085 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:01:11.066087 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064087 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:01:11.066087 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064090 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:01:11.066087 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064093 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:01:11.066087 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064095 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:01:11.066087 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064098 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:01:11.066087 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064101 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:01:11.066087 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064103 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:01:11.066087 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064106 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:01:11.066087 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064849 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:01:11.066748 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064856 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:01:11.066748 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064859 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:01:11.066748 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064862 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:01:11.066748 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064865 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:01:11.066748 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064868 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:01:11.066748 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064870 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:01:11.066748 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064873 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:01:11.066748 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064876 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:01:11.066748 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064879 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:01:11.066748 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064882 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:01:11.066748 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064884 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:01:11.066748 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064888 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:01:11.066748 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064891 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:01:11.066748 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064894 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:01:11.066748 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064897 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:01:11.066748 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064899 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:01:11.066748 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064902 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:01:11.066748 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064904 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:01:11.066748 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064907 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:01:11.066748 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064910 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:01:11.067247 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064913 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:01:11.067247 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064915 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:01:11.067247 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064918 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:01:11.067247 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064920 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:01:11.067247 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064923 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:01:11.067247 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064925 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:01:11.067247 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064928 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:01:11.067247 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064933 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:01:11.067247 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064936 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:01:11.067247 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064939 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:01:11.067247 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064941 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:01:11.067247 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064944 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:01:11.067247 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064946 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:01:11.067247 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064949 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:01:11.067247 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064951 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:01:11.067247 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064954 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:01:11.067247 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064956 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:01:11.067247 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064959 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:01:11.067247 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064961 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:01:11.067708 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064964 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:01:11.067708 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064966 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:01:11.067708 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064969 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:01:11.067708 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064971 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:01:11.067708 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064974 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:01:11.067708 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064978 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:01:11.067708 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064980 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:01:11.067708 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.064983 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:01:11.067708 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065018 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:01:11.067708 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065023 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:01:11.067708 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065026 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:01:11.067708 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065030 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:01:11.067708 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065035 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:01:11.067708 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065038 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:01:11.067708 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065041 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:01:11.067708 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065044 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:01:11.067708 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065047 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:01:11.067708 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065050 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:01:11.067708 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065053 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:01:11.068190 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065056 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:01:11.068190 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065059 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:01:11.068190 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065062 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:01:11.068190 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065065 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:01:11.068190 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065068 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:01:11.068190 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065071 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:01:11.068190 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065073 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:01:11.068190 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065076 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:01:11.068190 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065078 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:01:11.068190 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065081 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:01:11.068190 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065084 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:01:11.068190 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065086 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:01:11.068190 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065089 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:01:11.068190 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065092 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:01:11.068190 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065094 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:01:11.068190 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065096 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:01:11.068190 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065099 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:01:11.068190 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065103 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:01:11.068190 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065107 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:01:11.068190 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065110 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:01:11.068671 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065113 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:01:11.068671 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065115 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:01:11.068671 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065119 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:01:11.068671 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065123 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:01:11.068671 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065125 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:01:11.068671 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065129 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:01:11.068671 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065132 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:01:11.068671 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065135 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:01:11.068671 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065138 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:01:11.068671 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065140 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:01:11.068671 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065143 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:01:11.068671 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065146 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:01:11.068671 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065150 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:01:11.068671 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065153 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:01:11.068671 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065156 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:01:11.068671 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065158 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:01:11.068671 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065161 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:01:11.068671 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065164 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:01:11.068671 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065167 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:01:11.069158 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.065169 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:01:11.069158 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066360 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:01:11.069158 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066372 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:01:11.069158 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066443 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:01:11.069158 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066460 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:01:11.069158 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066464 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:01:11.069158 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066468 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:01:11.069158 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066473 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:01:11.069158 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066495 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:01:11.069158 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066499 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:01:11.069158 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066625 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:01:11.069158 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066631 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:01:11.069158 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066634 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:01:11.069158 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066637 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:01:11.069158 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066640 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:01:11.069158 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066643 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:01:11.069158 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066646 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:01:11.069158 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066648 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:01:11.069158 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066651 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:01:11.069158 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066654 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:01:11.069635 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066657 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:01:11.069635 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066660 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:01:11.069635 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066663 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:01:11.069635 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066665 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:01:11.069635 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066668 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:01:11.069635 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066670 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:01:11.069635 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066673 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:01:11.069635 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066675 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:01:11.069635 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066678 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:01:11.069635 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066681 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:01:11.069635 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066684 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:01:11.069635 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066686 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:01:11.069635 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066689 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:01:11.069635 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066691 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:01:11.069635 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066694 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:01:11.069635 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066696 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:01:11.069635 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066703 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:01:11.069635 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066706 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:01:11.069635 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066709 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:01:11.069635 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066711 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:01:11.070160 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066714 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:01:11.070160 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066716 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:01:11.070160 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066719 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:01:11.070160 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066722 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:01:11.070160 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066724 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:01:11.070160 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066727 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:01:11.070160 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066729 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:01:11.070160 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066734 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:01:11.070160 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066739 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:01:11.070160 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066742 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:01:11.070160 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066744 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:01:11.070160 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066747 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:01:11.070160 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066750 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:01:11.070160 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066752 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:01:11.070160 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066757 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:01:11.070160 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066763 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:01:11.070160 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066766 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:01:11.070160 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066769 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:01:11.070160 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066771 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:01:11.070665 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066775 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:01:11.070665 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066779 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:01:11.070665 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066783 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:01:11.070665 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066786 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:01:11.070665 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066789 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:01:11.070665 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066792 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:01:11.070665 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066794 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:01:11.070665 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066797 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:01:11.070665 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066799 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:01:11.070665 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066803 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:01:11.070665 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066806 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:01:11.070665 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066809 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:01:11.070665 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066811 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:01:11.070665 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066814 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:01:11.070665 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066817 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:01:11.070665 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066819 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:01:11.070665 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066822 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:01:11.070665 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066824 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:01:11.070665 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066827 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:01:11.071144 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066830 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:01:11.071144 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066832 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:01:11.071144 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066834 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:01:11.071144 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066837 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:01:11.071144 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066839 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:01:11.071144 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066842 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:01:11.071144 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066845 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:01:11.071144 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066849 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:01:11.071144 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066852 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:01:11.071144 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066854 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:01:11.071144 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066857 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:01:11.071144 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066860 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:01:11.071144 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066863 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:01:11.071144 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066865 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:01:11.071144 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066868 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:01:11.071144 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066870 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:01:11.071144 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066873 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:01:11.071144 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066875 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:01:11.071144 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066878 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:01:11.071144 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066880 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:01:11.071659 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066883 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:01:11.071659 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.066885 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:01:11.071659 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.066964 2559 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 19:01:11.071659 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.066973 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 19:01:11.071659 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.066980 2559 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 19:01:11.071659 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.066998 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 19:01:11.071659 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067006 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 19:01:11.071659 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067009 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 19:01:11.071659 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067014 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 19:01:11.071659 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067018 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 19:01:11.071659 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067021 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 19:01:11.071659 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067024 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 19:01:11.071659 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067028 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 19:01:11.071659 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067031 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 19:01:11.071659 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067035 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 19:01:11.071659 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067038 2559 flags.go:64] FLAG: --cgroup-root="" Jul 02 19:01:11.071659 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067041 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 19:01:11.071659 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067044 2559 flags.go:64] FLAG: --client-ca-file="" Jul 02 19:01:11.071659 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067048 2559 flags.go:64] FLAG: --cloud-provider="external" Jul 02 19:01:11.071659 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067052 2559 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 19:01:11.071659 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067056 2559 flags.go:64] FLAG: --cluster-domain="" Jul 02 19:01:11.071659 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067059 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 19:01:11.071659 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067063 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 19:01:11.072224 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067066 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 19:01:11.072224 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067069 2559 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 19:01:11.072224 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067073 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 19:01:11.072224 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067076 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 19:01:11.072224 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067079 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 19:01:11.072224 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067082 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 19:01:11.072224 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067086 2559 flags.go:64] FLAG: --contention-profiling="false" Jul 02 19:01:11.072224 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067089 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 19:01:11.072224 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067092 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 19:01:11.072224 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067095 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 19:01:11.072224 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067098 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 19:01:11.072224 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067102 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 19:01:11.072224 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067105 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 19:01:11.072224 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067108 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 19:01:11.072224 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067111 2559 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 19:01:11.072224 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067114 2559 flags.go:64] FLAG: --enable-server="true" Jul 02 19:01:11.072224 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067117 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 19:01:11.072224 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067122 2559 flags.go:64] FLAG: --event-burst="100" Jul 02 19:01:11.072224 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067125 2559 flags.go:64] FLAG: --event-qps="50" Jul 02 19:01:11.072224 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067128 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 19:01:11.072224 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067131 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 19:01:11.072224 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067134 2559 flags.go:64] FLAG: --eviction-hard="" Jul 02 19:01:11.072224 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067138 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 19:01:11.072224 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067141 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 19:01:11.072778 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067144 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 19:01:11.072778 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067147 2559 flags.go:64] FLAG: --eviction-soft="" Jul 02 19:01:11.072778 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067149 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 19:01:11.072778 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067152 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 19:01:11.072778 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067159 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 19:01:11.072778 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067162 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 19:01:11.072778 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067165 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 19:01:11.072778 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067168 2559 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 19:01:11.072778 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067171 2559 flags.go:64] FLAG: --feature-gates="" Jul 02 19:01:11.072778 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067175 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 19:01:11.072778 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067178 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 19:01:11.072778 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067180 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 19:01:11.072778 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067184 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 19:01:11.072778 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067186 2559 flags.go:64] FLAG: --healthz-port="10248" Jul 02 19:01:11.072778 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067189 2559 flags.go:64] FLAG: --help="false" Jul 02 19:01:11.072778 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067192 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-130-197.ec2.internal" Jul 02 19:01:11.072778 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067195 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 19:01:11.072778 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067198 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 19:01:11.072778 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067201 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 19:01:11.072778 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067206 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 19:01:11.072778 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067209 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 19:01:11.072778 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067212 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 19:01:11.072778 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067215 2559 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 19:01:11.073364 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067218 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 19:01:11.073364 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067221 2559 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 19:01:11.073364 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067224 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 19:01:11.073364 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067227 2559 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 19:01:11.073364 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067230 2559 flags.go:64] FLAG: --kube-reserved="" Jul 02 19:01:11.073364 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067232 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 19:01:11.073364 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067235 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 19:01:11.073364 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067238 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 19:01:11.073364 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067241 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 19:01:11.073364 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067244 2559 flags.go:64] FLAG: --lock-file="" Jul 02 19:01:11.073364 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067247 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 19:01:11.073364 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067250 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 19:01:11.073364 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067253 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 19:01:11.073364 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067260 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 19:01:11.073364 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067263 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 19:01:11.073364 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067266 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 19:01:11.073364 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067269 2559 flags.go:64] FLAG: --logging-format="text" Jul 02 19:01:11.073364 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067272 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 19:01:11.073364 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067276 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 19:01:11.073364 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067278 2559 flags.go:64] FLAG: --manifest-url="" Jul 02 19:01:11.073364 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067281 2559 flags.go:64] FLAG: --manifest-url-header="" Jul 02 19:01:11.073364 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067286 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 19:01:11.073364 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067289 2559 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 19:01:11.073364 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067293 2559 flags.go:64] FLAG: --max-pods="110" Jul 02 19:01:11.073364 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067296 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 19:01:11.073958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067299 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 19:01:11.073958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067302 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 19:01:11.073958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067305 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 19:01:11.073958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067309 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 19:01:11.073958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067313 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 19:01:11.073958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067316 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 19:01:11.073958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067325 2559 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 19:01:11.073958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067328 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 19:01:11.073958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067331 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 19:01:11.073958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067334 2559 flags.go:64] FLAG: --pod-cidr="" Jul 02 19:01:11.073958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067336 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 02 19:01:11.073958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067342 2559 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 19:01:11.073958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067344 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 19:01:11.073958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067347 2559 flags.go:64] FLAG: --pods-per-core="0" Jul 02 19:01:11.073958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067350 2559 flags.go:64] FLAG: --port="10250" Jul 02 19:01:11.073958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067353 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 19:01:11.073958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067356 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b58fbc534f7bab91" Jul 02 19:01:11.073958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067359 2559 flags.go:64] FLAG: --qos-reserved="" Jul 02 19:01:11.073958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067362 2559 flags.go:64] FLAG: --read-only-port="10255" Jul 02 19:01:11.073958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067365 2559 flags.go:64] FLAG: --register-node="true" Jul 02 19:01:11.073958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067370 2559 flags.go:64] FLAG: --register-with-taints="" Jul 02 19:01:11.073958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067373 2559 flags.go:64] FLAG: --registry-burst="10" Jul 02 19:01:11.073958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067377 2559 flags.go:64] FLAG: --registry-qps="5" Jul 02 19:01:11.073958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067380 2559 flags.go:64] FLAG: --reserved-cpus="" Jul 02 19:01:11.074874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067382 2559 flags.go:64] FLAG: --reserved-memory="" Jul 02 19:01:11.074874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067386 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 19:01:11.074874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067389 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 19:01:11.074874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067392 2559 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 19:01:11.074874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067394 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 19:01:11.074874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067397 2559 flags.go:64] FLAG: --runonce="false" Jul 02 19:01:11.074874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067400 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 19:01:11.074874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067403 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 19:01:11.074874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067407 2559 flags.go:64] FLAG: --seccomp-default="false" Jul 02 19:01:11.074874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067409 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 19:01:11.074874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067412 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 19:01:11.074874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067415 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 19:01:11.074874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067419 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 19:01:11.074874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067422 2559 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 19:01:11.074874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067425 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 19:01:11.074874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067428 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 19:01:11.074874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067431 2559 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 19:01:11.074874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067433 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 19:01:11.074874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067436 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 19:01:11.074874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067439 2559 flags.go:64] FLAG: --system-cgroups="" Jul 02 19:01:11.074874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067442 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 19:01:11.074874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067448 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 19:01:11.074874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067450 2559 flags.go:64] FLAG: --tls-cert-file="" Jul 02 19:01:11.074874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067453 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 19:01:11.074874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067457 2559 flags.go:64] FLAG: --tls-min-version="" Jul 02 19:01:11.076010 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067460 2559 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 19:01:11.076010 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067463 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 19:01:11.076010 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067466 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 19:01:11.076010 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067470 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 19:01:11.076010 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067473 2559 flags.go:64] FLAG: --v="2" Jul 02 19:01:11.076010 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067477 2559 flags.go:64] FLAG: --version="false" Jul 02 19:01:11.076010 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067482 2559 flags.go:64] FLAG: --vmodule="" Jul 02 19:01:11.076010 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067489 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 19:01:11.076010 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.067492 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 19:01:11.076010 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067614 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:01:11.076010 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067618 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:01:11.076010 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067621 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:01:11.076010 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067624 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:01:11.076010 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067627 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:01:11.076010 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067630 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:01:11.076010 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067633 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:01:11.076010 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067635 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:01:11.076010 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067638 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:01:11.076010 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067641 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:01:11.076010 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067645 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:01:11.076010 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067648 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:01:11.076905 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067650 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:01:11.076905 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067653 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:01:11.076905 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067656 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:01:11.076905 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067658 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:01:11.076905 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067661 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:01:11.076905 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067664 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:01:11.076905 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067666 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:01:11.076905 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067669 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:01:11.076905 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067672 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:01:11.076905 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067674 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:01:11.076905 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067677 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:01:11.076905 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067679 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:01:11.076905 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067682 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:01:11.076905 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067685 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:01:11.076905 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067688 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:01:11.076905 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067691 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:01:11.076905 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067694 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:01:11.076905 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067696 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:01:11.076905 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067700 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:01:11.076905 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067702 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:01:11.077794 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067705 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:01:11.077794 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067707 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:01:11.077794 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067710 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:01:11.077794 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067712 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:01:11.077794 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067715 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:01:11.077794 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067718 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:01:11.077794 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067721 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:01:11.077794 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067723 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:01:11.077794 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067726 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:01:11.077794 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067729 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:01:11.077794 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067735 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:01:11.077794 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067738 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:01:11.077794 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067740 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:01:11.077794 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067743 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:01:11.077794 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067746 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:01:11.077794 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067748 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:01:11.077794 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067751 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:01:11.077794 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067753 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:01:11.077794 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067756 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:01:11.077794 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067759 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:01:11.078443 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067762 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:01:11.078443 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067764 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:01:11.078443 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067767 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:01:11.078443 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067769 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:01:11.078443 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067772 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:01:11.078443 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067774 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:01:11.078443 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067778 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:01:11.078443 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067781 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:01:11.078443 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067783 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:01:11.078443 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067786 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:01:11.078443 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067788 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:01:11.078443 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067791 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:01:11.078443 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067794 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:01:11.078443 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067797 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:01:11.078443 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067799 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:01:11.078443 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067802 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:01:11.078443 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067804 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:01:11.078443 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067807 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:01:11.078443 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067809 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:01:11.078443 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067812 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:01:11.079259 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067815 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:01:11.079259 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067817 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:01:11.079259 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067821 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:01:11.079259 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067824 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:01:11.079259 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067827 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:01:11.079259 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067831 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:01:11.079259 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067834 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:01:11.079259 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067838 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:01:11.079259 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067841 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:01:11.079259 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067845 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:01:11.079259 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067848 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:01:11.079259 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067851 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:01:11.079259 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067854 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:01:11.079259 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067856 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:01:11.079259 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067859 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:01:11.079259 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067862 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:01:11.079259 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067865 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:01:11.079259 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067868 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:01:11.079259 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067872 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:01:11.080066 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067875 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:01:11.080066 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067877 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:01:11.080066 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067880 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:01:11.080066 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067883 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:01:11.080066 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067885 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:01:11.080066 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067888 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:01:11.080066 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067891 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:01:11.080066 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.067895 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:01:11.080066 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.068925 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 19:01:11.080066 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.076507 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 19:01:11.080066 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.076530 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 19:01:11.080066 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.076556 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 19:01:11.080066 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.076564 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 19:01:11.080066 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076650 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:01:11.080447 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076658 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:01:11.080447 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076665 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:01:11.080447 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076670 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:01:11.080447 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076675 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:01:11.080447 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076679 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:01:11.080447 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076684 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:01:11.080447 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076689 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:01:11.080447 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076693 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:01:11.080447 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076698 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:01:11.080447 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076703 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:01:11.080447 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076708 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:01:11.080447 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076712 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:01:11.080447 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076717 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:01:11.080447 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076722 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:01:11.080447 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076726 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:01:11.080447 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076730 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:01:11.080447 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076734 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:01:11.080447 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076739 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:01:11.080447 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076744 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:01:11.081061 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076748 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:01:11.081061 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076753 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:01:11.081061 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076757 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:01:11.081061 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076761 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:01:11.081061 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076767 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:01:11.081061 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076772 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:01:11.081061 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076776 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:01:11.081061 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076780 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:01:11.081061 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076786 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:01:11.081061 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076791 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:01:11.081061 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076796 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:01:11.081061 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076800 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:01:11.081061 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076804 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:01:11.081061 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076808 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:01:11.081061 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076813 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:01:11.081061 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076817 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:01:11.081061 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076821 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:01:11.081061 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076825 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:01:11.081061 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076830 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:01:11.081061 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076834 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:01:11.081061 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076839 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:01:11.081598 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076843 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:01:11.081598 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076848 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:01:11.081598 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076852 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:01:11.081598 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076856 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:01:11.081598 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076860 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:01:11.081598 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076864 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:01:11.081598 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076868 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:01:11.081598 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076872 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:01:11.081598 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076877 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:01:11.081598 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076881 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:01:11.081598 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076888 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:01:11.081598 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076894 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:01:11.081598 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076900 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:01:11.081598 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076904 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:01:11.081598 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076908 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:01:11.081598 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076913 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:01:11.081598 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076919 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:01:11.081598 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076923 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:01:11.081598 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076929 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:01:11.082080 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076935 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:01:11.082080 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076940 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:01:11.082080 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076946 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:01:11.082080 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076952 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:01:11.082080 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076957 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:01:11.082080 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076962 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:01:11.082080 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076966 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:01:11.082080 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076970 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:01:11.082080 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076974 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:01:11.082080 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076978 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:01:11.082080 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.076982 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:01:11.082080 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077008 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:01:11.082080 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077013 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:01:11.082080 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077017 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:01:11.082080 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077021 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:01:11.082080 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077026 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:01:11.082080 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077030 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:01:11.082080 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077034 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:01:11.082080 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077038 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:01:11.082596 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077042 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:01:11.082596 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077047 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:01:11.082596 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077051 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:01:11.082596 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077055 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:01:11.082596 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077059 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:01:11.082596 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077064 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:01:11.082596 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077069 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:01:11.082596 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077073 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:01:11.082596 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077077 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:01:11.082596 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077081 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:01:11.082596 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077085 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:01:11.082596 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077090 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:01:11.082596 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077095 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:01:11.082596 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077099 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:01:11.082596 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077104 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:01:11.082596 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077108 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:01:11.082596 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077112 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:01:11.082596 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077117 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:01:11.082596 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077121 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:01:11.082596 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077125 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:01:11.083198 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.077133 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 19:01:11.083198 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077323 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:01:11.083198 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077331 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:01:11.083198 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077336 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:01:11.083198 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077341 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:01:11.083198 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077345 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:01:11.083198 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077350 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:01:11.083198 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077354 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:01:11.083198 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077358 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:01:11.083198 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077363 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:01:11.083198 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077367 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:01:11.083198 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077371 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:01:11.083198 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077376 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:01:11.083198 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077380 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:01:11.083198 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077385 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:01:11.083576 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077389 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:01:11.083576 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077394 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:01:11.083576 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077398 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:01:11.083576 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077402 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:01:11.083576 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077409 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:01:11.083576 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077415 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:01:11.083576 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077420 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:01:11.083576 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077425 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:01:11.083576 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077429 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:01:11.083576 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077443 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:01:11.083576 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077448 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:01:11.083576 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077453 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:01:11.083576 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077457 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:01:11.083576 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077462 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:01:11.083576 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077467 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:01:11.083576 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077472 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:01:11.083576 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077477 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:01:11.083576 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077482 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:01:11.083576 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077486 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:01:11.083576 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077491 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:01:11.084101 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077495 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:01:11.084101 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077500 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:01:11.084101 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077504 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:01:11.084101 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077509 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:01:11.084101 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077513 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:01:11.084101 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077518 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:01:11.084101 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077523 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:01:11.084101 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077528 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:01:11.084101 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077532 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:01:11.084101 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077536 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:01:11.084101 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077540 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:01:11.084101 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077544 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:01:11.084101 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077549 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:01:11.084101 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077553 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:01:11.084101 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077557 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:01:11.084101 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077562 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:01:11.084101 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077566 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:01:11.084101 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077571 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:01:11.084101 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077575 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:01:11.084101 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077579 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:01:11.084628 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077583 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:01:11.084628 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077588 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:01:11.084628 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077593 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:01:11.084628 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077598 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:01:11.084628 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077603 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:01:11.084628 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077607 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:01:11.084628 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077611 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:01:11.084628 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077615 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:01:11.084628 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077620 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:01:11.084628 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077623 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:01:11.084628 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077627 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:01:11.084628 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077632 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:01:11.084628 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077636 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:01:11.084628 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077640 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:01:11.084628 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077645 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:01:11.084628 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077649 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:01:11.084628 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077653 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:01:11.084628 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077657 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:01:11.084628 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077661 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:01:11.085091 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077665 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:01:11.085091 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077673 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:01:11.085091 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077678 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:01:11.085091 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077682 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:01:11.085091 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077686 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:01:11.085091 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077693 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:01:11.085091 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077698 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:01:11.085091 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077702 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:01:11.085091 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077707 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:01:11.085091 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077711 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:01:11.085091 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077715 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:01:11.085091 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077719 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:01:11.085091 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077723 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:01:11.085091 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077727 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:01:11.085091 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077732 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:01:11.085091 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077736 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:01:11.085091 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077741 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:01:11.085091 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077745 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:01:11.085091 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077751 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:01:11.085742 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077757 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:01:11.085742 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077762 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:01:11.085742 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077766 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:01:11.085742 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077770 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:01:11.085742 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077774 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:01:11.085742 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077779 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:01:11.085742 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:11.077783 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:01:11.085742 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.077791 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 19:01:11.085742 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.077962 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 19:01:11.085742 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.080618 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 19:01:11.085742 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.082146 2559 server.go:1019] "Starting client certificate rotation" Jul 02 19:01:11.085742 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.082253 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 19:01:11.085742 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.082294 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 19:01:11.086292 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.085980 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 19:01:11.089376 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.089351 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 19:01:11.103159 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.103135 2559 log.go:25] "Validated CRI v1 runtime API" Jul 02 19:01:11.107349 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.107316 2559 log.go:25] "Validated CRI v1 image API" Jul 02 19:01:11.108215 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.108200 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 19:01:11.110696 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.110673 2559 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7b31195f-c433-4f2a-981f-a3a27df14e39:/dev/nvme0n1p4 a7fc4693-3230-4df6-b112-cde46e8c21d8:/dev/nvme0n1p3] Jul 02 19:01:11.110776 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.110694 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 19:01:11.112548 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.112530 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 19:01:11.118740 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.118627 2559 manager.go:216] Machine: {Timestamp:2026-07-02 19:01:11.117162785 +0000 UTC m=+0.360992541 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098862 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a0e74699a299d0657994aee8ce6d7 SystemUUID:ec2a0e74-699a-299d-0657-994aee8ce6d7 BootID:aaeb1061-1307-48d9-a19e-e917ab95469d Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:91:af:d2:79:63 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:91:af:d2:79:63 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:08:4a:a4:79:4b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 19:01:11.118740 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.118728 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 19:01:11.118873 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.118854 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 19:01:11.122386 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.122361 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 19:01:11.122530 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.122389 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-197.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 19:01:11.123821 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.123810 2559 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 19:01:11.123862 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.123823 2559 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 19:01:11.123862 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.123830 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 19:01:11.124639 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.124628 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 19:01:11.125873 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.125863 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 19:01:11.129116 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.129104 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 02 19:01:11.129238 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.129228 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 19:01:11.129281 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.129258 2559 kubelet.go:486] "Attempting to sync node with API server" Jul 02 19:01:11.129281 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.129268 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 19:01:11.129281 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.129281 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 19:01:11.129393 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.129291 2559 kubelet.go:398] "Adding apiserver pod source" Jul 02 19:01:11.129393 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.129300 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 19:01:11.129710 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.129696 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 19:01:11.129765 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.129722 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 19:01:11.132540 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.132523 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 19:01:11.134316 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.134302 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 19:01:11.134358 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.134333 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 19:01:11.135310 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.135294 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 19:01:11.135361 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.135314 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 19:01:11.135361 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.135321 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 19:01:11.135361 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.135328 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 19:01:11.135361 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.135340 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 19:01:11.135361 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.135350 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 19:01:11.135361 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.135362 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 19:01:11.135523 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.135370 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 19:01:11.135523 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.135379 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 19:01:11.135523 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.135388 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 19:01:11.135523 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.135400 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 19:01:11.135523 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.135406 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 19:01:11.136114 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.136099 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 19:01:11.136114 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.136112 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 19:01:11.139455 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.139442 2559 server.go:1268] "Started kubelet" Jul 02 19:01:11.139605 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.139539 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 19:01:11.139700 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.139532 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 19:01:11.139759 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.139739 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 19:01:11.140409 ip-10-0-130-197 systemd[1]: Started Kubernetes Kubelet. Jul 02 19:01:11.140779 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.140761 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-197.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 19:01:11.140950 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:11.140869 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 19:01:11.140950 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:11.140901 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 19:01:11.141445 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.141359 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 19:01:11.142017 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.142002 2559 server.go:310] "Adding debug handlers to kubelet server" Jul 02 19:01:11.145697 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:11.144709 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-197.ec2.internal.18be8e376a15290e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-197.ec2.internal,UID:ip-10-0-130-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-197.ec2.internal,},FirstTimestamp:2026-07-02 19:01:11.139412238 +0000 UTC m=+0.383241997,LastTimestamp:2026-07-02 19:01:11.139412238 +0000 UTC m=+0.383241997,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-197.ec2.internal,}" Jul 02 19:01:11.145950 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:11.145935 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 19:01:11.148334 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.148316 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 19:01:11.148433 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.148332 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 19:01:11.148518 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:11.148498 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-197.ec2.internal\" not found" Jul 02 19:01:11.149079 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.148933 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 19:01:11.149079 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.148943 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 19:01:11.149079 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.148952 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 19:01:11.149258 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.149151 2559 reconstruct.go:97] "Volume reconstruction finished" Jul 02 19:01:11.149258 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.149163 2559 reconciler.go:29] "Reconciler: start to sync state" Jul 02 19:01:11.149410 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.149385 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 19:01:11.149464 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.149412 2559 factory.go:55] Registering systemd factory Jul 02 19:01:11.149464 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.149422 2559 factory.go:223] Registration of the systemd container factory successfully Jul 02 19:01:11.149669 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.149637 2559 factory.go:153] Registering CRI-O factory Jul 02 19:01:11.149669 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.149657 2559 factory.go:223] Registration of the crio container factory successfully Jul 02 19:01:11.149774 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.149682 2559 factory.go:103] Registering Raw factory Jul 02 19:01:11.149774 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.149695 2559 manager.go:1196] Started watching for new ooms in manager Jul 02 19:01:11.150126 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.150111 2559 manager.go:349] Starting recovery of all containers Jul 02 19:01:11.157903 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:11.157797 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 02 19:01:11.158064 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:11.158044 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 19:01:11.162260 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.162233 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hm4zj" Jul 02 19:01:11.163740 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.163718 2559 manager.go:354] Recovery completed Jul 02 19:01:11.168591 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.168477 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hm4zj" Jul 02 19:01:11.168673 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.168619 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:01:11.170522 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.170505 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-197.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:01:11.170610 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.170536 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:01:11.170610 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.170549 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-197.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:01:11.171127 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.171114 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 19:01:11.171127 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.171127 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 19:01:11.171234 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.171134 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:01:11.171234 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.171143 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 02 19:01:11.171799 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.171786 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-197.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:01:11.171853 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.171812 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:01:11.171853 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.171825 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-197.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:01:11.172152 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.172140 2559 policy_none.go:49] "None policy: Start" Jul 02 19:01:11.172194 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.172156 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 19:01:11.172194 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.172166 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 19:01:11.172888 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:11.172825 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-197.ec2.internal.18be8e376befd99b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-197.ec2.internal,UID:ip-10-0-130-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-197.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-197.ec2.internal,},FirstTimestamp:2026-07-02 19:01:11.170521499 +0000 UTC m=+0.414351258,LastTimestamp:2026-07-02 19:01:11.170521499 +0000 UTC m=+0.414351258,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-197.ec2.internal,}" Jul 02 19:01:11.173101 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.173089 2559 policy_none.go:47] "Start" Jul 02 19:01:11.202842 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.202826 2559 manager.go:337] "Starting Device Plugin manager" Jul 02 19:01:11.202937 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:11.202879 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 19:01:11.202937 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.202889 2559 server.go:87] "Starting device plugin registration server" Jul 02 19:01:11.203161 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.203149 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 19:01:11.203218 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.203165 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 19:01:11.203424 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.203252 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 19:01:11.203424 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.203330 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 19:01:11.203424 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.203339 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 19:01:11.203915 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:11.203874 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 19:01:11.204008 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:11.203928 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-197.ec2.internal\" not found" Jul 02 19:01:11.296820 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.296776 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 19:01:11.297969 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.297950 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 19:01:11.298053 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.298004 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 19:01:11.298053 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.298031 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 19:01:11.298149 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:11.298069 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 19:01:11.300680 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.300660 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:01:11.304007 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.303973 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:01:11.304770 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.304756 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-197.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:01:11.304852 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.304783 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:01:11.304852 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.304793 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-197.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:01:11.304852 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.304816 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-197.ec2.internal" Jul 02 19:01:11.313935 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.313889 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-197.ec2.internal" Jul 02 19:01:11.313935 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:11.313910 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-197.ec2.internal\": node \"ip-10-0-130-197.ec2.internal\" not found" Jul 02 19:01:11.335302 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:11.335277 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-197.ec2.internal\" not found" Jul 02 19:01:11.398539 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.398507 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-197.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-197.ec2.internal"] Jul 02 19:01:11.398681 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.398592 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:01:11.401026 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.400983 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-197.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:01:11.401119 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.401032 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:01:11.401119 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.401042 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-197.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:01:11.402515 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.402502 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:01:11.402677 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.402662 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-197.ec2.internal" Jul 02 19:01:11.402716 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.402694 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:01:11.403208 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.403192 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-197.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:01:11.403301 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.403220 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:01:11.403301 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.403234 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-197.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:01:11.403301 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.403254 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-197.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:01:11.403301 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.403277 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:01:11.403301 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.403287 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-197.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:01:11.404531 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.404516 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-197.ec2.internal" Jul 02 19:01:11.404623 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.404539 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:01:11.405232 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.405218 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-197.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:01:11.405305 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.405246 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:01:11.405305 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.405255 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-197.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:01:11.428587 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:11.428566 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-197.ec2.internal\" not found" node="ip-10-0-130-197.ec2.internal" Jul 02 19:01:11.433087 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:11.433070 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-197.ec2.internal\" not found" node="ip-10-0-130-197.ec2.internal" Jul 02 19:01:11.435561 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:11.435546 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-197.ec2.internal\" not found" Jul 02 19:01:11.535948 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:11.535915 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-197.ec2.internal\" not found" Jul 02 19:01:11.550234 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.550210 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/89db45177650e6194fe054377f4724d8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-197.ec2.internal\" (UID: \"89db45177650e6194fe054377f4724d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-197.ec2.internal" Jul 02 19:01:11.550334 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.550242 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89db45177650e6194fe054377f4724d8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-197.ec2.internal\" (UID: \"89db45177650e6194fe054377f4724d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-197.ec2.internal" Jul 02 19:01:11.550334 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.550267 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/05cb7619a8b4cf72df33e4bbdca9093f-config\") pod \"kube-apiserver-proxy-ip-10-0-130-197.ec2.internal\" (UID: \"05cb7619a8b4cf72df33e4bbdca9093f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-197.ec2.internal" Jul 02 19:01:11.636674 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:11.636597 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-197.ec2.internal\" not found" Jul 02 19:01:11.650927 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.650902 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89db45177650e6194fe054377f4724d8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-197.ec2.internal\" (UID: \"89db45177650e6194fe054377f4724d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-197.ec2.internal" Jul 02 19:01:11.651018 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.650945 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/05cb7619a8b4cf72df33e4bbdca9093f-config\") pod \"kube-apiserver-proxy-ip-10-0-130-197.ec2.internal\" (UID: \"05cb7619a8b4cf72df33e4bbdca9093f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-197.ec2.internal" Jul 02 19:01:11.651018 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.650970 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/89db45177650e6194fe054377f4724d8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-197.ec2.internal\" (UID: \"89db45177650e6194fe054377f4724d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-197.ec2.internal" Jul 02 19:01:11.651018 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.651008 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89db45177650e6194fe054377f4724d8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-197.ec2.internal\" (UID: \"89db45177650e6194fe054377f4724d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-197.ec2.internal" Jul 02 19:01:11.651115 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.651025 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/05cb7619a8b4cf72df33e4bbdca9093f-config\") pod \"kube-apiserver-proxy-ip-10-0-130-197.ec2.internal\" (UID: \"05cb7619a8b4cf72df33e4bbdca9093f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-197.ec2.internal" Jul 02 19:01:11.651115 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.651019 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/89db45177650e6194fe054377f4724d8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-197.ec2.internal\" (UID: \"89db45177650e6194fe054377f4724d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-197.ec2.internal" Jul 02 19:01:11.731110 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.731068 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-197.ec2.internal" Jul 02 19:01:11.736058 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:11.736043 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-197.ec2.internal" Jul 02 19:01:11.737133 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:11.737103 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-197.ec2.internal\" not found" Jul 02 19:01:13.419279 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:13.419256 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-197.ec2.internal\" not found" Jul 02 19:01:13.519823 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:13.519747 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-197.ec2.internal\" not found" Jul 02 19:01:13.620236 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:13.620209 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-197.ec2.internal\" not found" Jul 02 19:01:13.663660 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:13.663638 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 19:01:13.664078 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:13.663768 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 19:01:13.721130 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:13.721105 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-197.ec2.internal\" not found" Jul 02 19:01:13.754067 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:13.754034 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 18:56:12 +0000 UTC" deadline="2028-02-15 08:53:27.82227071 +0000 UTC" Jul 02 19:01:13.754067 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:13.754063 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14221h52m14.068210926s" Jul 02 19:01:13.818635 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:13.818594 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89db45177650e6194fe054377f4724d8.slice/crio-d37df10c848cd99c650817705e5617cde8813418485696e771f9b30fd0323f68 WatchSource:0}: Error finding container d37df10c848cd99c650817705e5617cde8813418485696e771f9b30fd0323f68: Status 404 returned error can't find the container with id d37df10c848cd99c650817705e5617cde8813418485696e771f9b30fd0323f68 Jul 02 19:01:13.819071 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:13.819047 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05cb7619a8b4cf72df33e4bbdca9093f.slice/crio-f0d57151f1aa62e3d05b2c3400a04666f4be7294672045ce352a2ec55bc4ffb6 WatchSource:0}: Error finding container f0d57151f1aa62e3d05b2c3400a04666f4be7294672045ce352a2ec55bc4ffb6: Status 404 returned error can't find the container with id f0d57151f1aa62e3d05b2c3400a04666f4be7294672045ce352a2ec55bc4ffb6 Jul 02 19:01:13.821429 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:13.821390 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-197.ec2.internal\" not found" Jul 02 19:01:13.823281 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:13.823267 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 19:01:13.883619 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:13.883564 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-197.ec2.internal" event={"ID":"05cb7619a8b4cf72df33e4bbdca9093f","Type":"ContainerStarted","Data":"f0d57151f1aa62e3d05b2c3400a04666f4be7294672045ce352a2ec55bc4ffb6"} Jul 02 19:01:13.884539 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:13.884522 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-197.ec2.internal" event={"ID":"89db45177650e6194fe054377f4724d8","Type":"ContainerStarted","Data":"d37df10c848cd99c650817705e5617cde8813418485696e771f9b30fd0323f68"} Jul 02 19:01:13.899144 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:13.899127 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:01:13.921797 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:13.921776 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-197.ec2.internal\" not found" Jul 02 19:01:13.947206 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:13.947184 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:01:14.030793 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.030766 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-197.ec2.internal" Jul 02 19:01:14.047186 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.047155 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 19:01:14.049308 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.049290 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-197.ec2.internal" Jul 02 19:01:14.058180 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.058131 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 19:01:14.288900 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.288870 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:01:14.713021 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.712980 2559 apiserver.go:52] "Watching apiserver" Jul 02 19:01:14.718637 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.718605 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 19:01:14.719025 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.719001 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-dk7fw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-197.ec2.internal","openshift-network-diagnostics/network-check-target-b4fq5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w","openshift-dns/node-resolver-wwdxl","openshift-multus/multus-additional-cni-plugins-n79rs","openshift-multus/multus-z7cr2","openshift-multus/network-metrics-daemon-2lpws","openshift-network-operator/iptables-alerter-cf5gs","openshift-ovn-kubernetes/ovnkube-node-5gf2s","kube-system/global-pull-secret-syncer-z4j2p","kube-system/konnectivity-agent-6zv56","kube-system/kube-apiserver-proxy-ip-10-0-130-197.ec2.internal","openshift-cluster-node-tuning-operator/tuned-q9qdf"] Jul 02 19:01:14.720429 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.720403 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n79rs" Jul 02 19:01:14.721654 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.721632 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cf5gs" Jul 02 19:01:14.722501 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.722465 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 19:01:14.722591 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.722576 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 19:01:14.722749 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.722732 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 19:01:14.722834 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.722802 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5gh8j\"" Jul 02 19:01:14.722964 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.722949 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 19:01:14.723089 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.723068 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 19:01:14.723605 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.723586 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:01:14.724184 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.723923 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:01:14.724184 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.724025 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 19:01:14.724184 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:14.724034 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4fq5" podUID="5c664d91-c6bf-47e2-9ab0-4d3bfab4964c" Jul 02 19:01:14.724184 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.723926 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 19:01:14.724184 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.724131 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r92vd\"" Jul 02 19:01:14.725420 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.725399 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.726579 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.726558 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w" Jul 02 19:01:14.727264 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.727247 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 19:01:14.727349 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.727335 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-x7hh9\"" Jul 02 19:01:14.727991 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.727923 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wwdxl" Jul 02 19:01:14.728967 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.728947 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 19:01:14.728967 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.728960 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 19:01:14.729102 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.728947 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 19:01:14.729102 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.729034 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bmwd9\"" Jul 02 19:01:14.729375 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.729357 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dk7fw" Jul 02 19:01:14.729989 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.729969 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 19:01:14.730073 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.730023 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zwf76\"" Jul 02 19:01:14.730123 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.729976 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 19:01:14.730604 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.730511 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 19:01:14.730604 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.730529 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:14.730790 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:14.730598 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lpws" podUID="7d6e7a30-d495-4e43-bba9-c9fda98277d9" Jul 02 19:01:14.732285 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.731982 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 19:01:14.734707 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.734471 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 19:01:14.734707 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.734510 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 19:01:14.734872 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.734759 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nxdpn\"" Jul 02 19:01:14.734872 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.734838 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.736722 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.736677 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:14.736802 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:14.736738 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4j2p" podUID="92b042c6-6b86-452c-8f9f-2341729e81c5" Jul 02 19:01:14.737761 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.737656 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 19:01:14.737761 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.737743 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-26nbb\"" Jul 02 19:01:14.737912 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.737798 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 19:01:14.737912 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.737884 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 19:01:14.738162 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.738144 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 19:01:14.738448 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.738429 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6zv56" Jul 02 19:01:14.738535 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.738488 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 19:01:14.738964 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.738946 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 19:01:14.739729 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.739713 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.739959 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.739933 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxqs2\" (UniqueName: \"kubernetes.io/projected/a95b977b-6b92-411f-a185-ecc012668bff-kube-api-access-jxqs2\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.740054 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.739974 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn6c9\" (UniqueName: \"kubernetes.io/projected/eed6dcf6-1438-4b95-a1e1-410eff54e692-kube-api-access-nn6c9\") pod \"multus-additional-cni-plugins-n79rs\" (UID: \"eed6dcf6-1438-4b95-a1e1-410eff54e692\") " pod="openshift-multus/multus-additional-cni-plugins-n79rs" Jul 02 19:01:14.740054 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740001 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4660d4a5-2ff9-49c1-948d-22fb52579391-host\") pod \"node-ca-dk7fw\" (UID: \"4660d4a5-2ff9-49c1-948d-22fb52579391\") " pod="openshift-image-registry/node-ca-dk7fw" Jul 02 19:01:14.740054 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740024 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-host-kubelet\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.740054 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740052 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-system-cni-dir\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.740230 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740141 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-cnibin\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.740230 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740171 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-etc-kubernetes\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.740230 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740199 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1acbb3a6-a477-4838-a28b-4208436cf0e0-socket-dir\") pod \"aws-ebs-csi-driver-node-qbt6w\" (UID: \"1acbb3a6-a477-4838-a28b-4208436cf0e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w" Jul 02 19:01:14.740230 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740225 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eed6dcf6-1438-4b95-a1e1-410eff54e692-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n79rs\" (UID: \"eed6dcf6-1438-4b95-a1e1-410eff54e692\") " pod="openshift-multus/multus-additional-cni-plugins-n79rs" Jul 02 19:01:14.740373 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740249 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1acbb3a6-a477-4838-a28b-4208436cf0e0-registration-dir\") pod \"aws-ebs-csi-driver-node-qbt6w\" (UID: \"1acbb3a6-a477-4838-a28b-4208436cf0e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w" Jul 02 19:01:14.740373 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740272 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zwjc\" (UniqueName: \"kubernetes.io/projected/d5d80831-45a4-4697-8170-22216f0f591e-kube-api-access-5zwjc\") pod \"iptables-alerter-cf5gs\" (UID: \"d5d80831-45a4-4697-8170-22216f0f591e\") " pod="openshift-network-operator/iptables-alerter-cf5gs" Jul 02 19:01:14.740373 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740308 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-node-log\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.740373 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740330 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-log-socket\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.740373 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740347 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-multus-socket-dir-parent\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.740595 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740362 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlp75\" (UniqueName: \"kubernetes.io/projected/ef58dd71-af47-44a1-8c47-d4e98378651d-kube-api-access-nlp75\") pod \"node-resolver-wwdxl\" (UID: \"ef58dd71-af47-44a1-8c47-d4e98378651d\") " pod="openshift-dns/node-resolver-wwdxl" Jul 02 19:01:14.740595 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740415 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d5d80831-45a4-4697-8170-22216f0f591e-iptables-alerter-script\") pod \"iptables-alerter-cf5gs\" (UID: \"d5d80831-45a4-4697-8170-22216f0f591e\") " pod="openshift-network-operator/iptables-alerter-cf5gs" Jul 02 19:01:14.740595 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740429 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-run-ovn\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.740595 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740467 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/119124a9-adad-4612-a91c-34750c3e9c51-cni-binary-copy\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.740595 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740496 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1acbb3a6-a477-4838-a28b-4208436cf0e0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qbt6w\" (UID: \"1acbb3a6-a477-4838-a28b-4208436cf0e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w" Jul 02 19:01:14.740595 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740527 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-var-lib-openvswitch\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.740595 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740560 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-host-run-multus-certs\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.740595 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740571 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 19:01:14.740595 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740594 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-run-openvswitch\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.740952 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740628 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a95b977b-6b92-411f-a185-ecc012668bff-ovnkube-script-lib\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.740952 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740657 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eed6dcf6-1438-4b95-a1e1-410eff54e692-os-release\") pod \"multus-additional-cni-plugins-n79rs\" (UID: \"eed6dcf6-1438-4b95-a1e1-410eff54e692\") " pod="openshift-multus/multus-additional-cni-plugins-n79rs" Jul 02 19:01:14.740952 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740681 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eed6dcf6-1438-4b95-a1e1-410eff54e692-system-cni-dir\") pod \"multus-additional-cni-plugins-n79rs\" (UID: \"eed6dcf6-1438-4b95-a1e1-410eff54e692\") " pod="openshift-multus/multus-additional-cni-plugins-n79rs" Jul 02 19:01:14.740952 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740722 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eed6dcf6-1438-4b95-a1e1-410eff54e692-cnibin\") pod \"multus-additional-cni-plugins-n79rs\" (UID: \"eed6dcf6-1438-4b95-a1e1-410eff54e692\") " pod="openshift-multus/multus-additional-cni-plugins-n79rs" Jul 02 19:01:14.740952 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740761 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-hostroot\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.740952 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740790 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9zgnk\"" Jul 02 19:01:14.740952 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740793 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-host-slash\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.740952 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740814 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 19:01:14.740952 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740819 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.740952 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740844 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eed6dcf6-1438-4b95-a1e1-410eff54e692-cni-binary-copy\") pod \"multus-additional-cni-plugins-n79rs\" (UID: \"eed6dcf6-1438-4b95-a1e1-410eff54e692\") " pod="openshift-multus/multus-additional-cni-plugins-n79rs" Jul 02 19:01:14.740952 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740884 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5q4m\" (UniqueName: \"kubernetes.io/projected/5c664d91-c6bf-47e2-9ab0-4d3bfab4964c-kube-api-access-w5q4m\") pod \"network-check-target-b4fq5\" (UID: \"5c664d91-c6bf-47e2-9ab0-4d3bfab4964c\") " pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:01:14.740952 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740908 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-host-run-netns\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.740952 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740931 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-host-var-lib-cni-multus\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.740952 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740952 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef58dd71-af47-44a1-8c47-d4e98378651d-tmp-dir\") pod \"node-resolver-wwdxl\" (UID: \"ef58dd71-af47-44a1-8c47-d4e98378651d\") " pod="openshift-dns/node-resolver-wwdxl" Jul 02 19:01:14.741483 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.740987 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-run-systemd\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.741483 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741011 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-host-run-ovn-kubernetes\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.741483 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741034 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eed6dcf6-1438-4b95-a1e1-410eff54e692-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n79rs\" (UID: \"eed6dcf6-1438-4b95-a1e1-410eff54e692\") " pod="openshift-multus/multus-additional-cni-plugins-n79rs" Jul 02 19:01:14.741483 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741057 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eed6dcf6-1438-4b95-a1e1-410eff54e692-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n79rs\" (UID: \"eed6dcf6-1438-4b95-a1e1-410eff54e692\") " pod="openshift-multus/multus-additional-cni-plugins-n79rs" Jul 02 19:01:14.741483 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741092 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ef58dd71-af47-44a1-8c47-d4e98378651d-hosts-file\") pod \"node-resolver-wwdxl\" (UID: \"ef58dd71-af47-44a1-8c47-d4e98378651d\") " pod="openshift-dns/node-resolver-wwdxl" Jul 02 19:01:14.741483 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741120 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-multus-conf-dir\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.741483 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741146 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qc47\" (UniqueName: \"kubernetes.io/projected/119124a9-adad-4612-a91c-34750c3e9c51-kube-api-access-4qc47\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.741483 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741191 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1acbb3a6-a477-4838-a28b-4208436cf0e0-device-dir\") pod \"aws-ebs-csi-driver-node-qbt6w\" (UID: \"1acbb3a6-a477-4838-a28b-4208436cf0e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w" Jul 02 19:01:14.741483 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741215 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-etc-openvswitch\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.741483 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741250 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-multus-cni-dir\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.741483 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741276 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsj57\" (UniqueName: \"kubernetes.io/projected/4660d4a5-2ff9-49c1-948d-22fb52579391-kube-api-access-dsj57\") pod \"node-ca-dk7fw\" (UID: \"4660d4a5-2ff9-49c1-948d-22fb52579391\") " pod="openshift-image-registry/node-ca-dk7fw" Jul 02 19:01:14.741483 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741299 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-host-cni-bin\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.741483 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741333 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-host-var-lib-kubelet\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.741483 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741361 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1acbb3a6-a477-4838-a28b-4208436cf0e0-sys-fs\") pod \"aws-ebs-csi-driver-node-qbt6w\" (UID: \"1acbb3a6-a477-4838-a28b-4208436cf0e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w" Jul 02 19:01:14.741483 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741386 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sb8s\" (UniqueName: \"kubernetes.io/projected/1acbb3a6-a477-4838-a28b-4208436cf0e0-kube-api-access-7sb8s\") pod \"aws-ebs-csi-driver-node-qbt6w\" (UID: \"1acbb3a6-a477-4838-a28b-4208436cf0e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w" Jul 02 19:01:14.741483 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741406 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-systemd-units\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.742249 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741430 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a95b977b-6b92-411f-a185-ecc012668bff-ovnkube-config\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.742249 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741452 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs\") pod \"network-metrics-daemon-2lpws\" (UID: \"7d6e7a30-d495-4e43-bba9-c9fda98277d9\") " pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:14.742249 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741476 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-host-run-netns\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.742249 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741499 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a95b977b-6b92-411f-a185-ecc012668bff-ovn-node-metrics-cert\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.742249 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741521 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-os-release\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.742249 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741562 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-host-var-lib-cni-bin\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.742249 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741586 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1acbb3a6-a477-4838-a28b-4208436cf0e0-etc-selinux\") pod \"aws-ebs-csi-driver-node-qbt6w\" (UID: \"1acbb3a6-a477-4838-a28b-4208436cf0e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w" Jul 02 19:01:14.742249 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741607 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-host-cni-netd\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.742249 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741642 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-host-run-k8s-cni-cncf-io\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.742249 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741665 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/119124a9-adad-4612-a91c-34750c3e9c51-multus-daemon-config\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.742249 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741730 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k9r8\" (UniqueName: \"kubernetes.io/projected/7d6e7a30-d495-4e43-bba9-c9fda98277d9-kube-api-access-4k9r8\") pod \"network-metrics-daemon-2lpws\" (UID: \"7d6e7a30-d495-4e43-bba9-c9fda98277d9\") " pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:14.742249 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741754 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5d80831-45a4-4697-8170-22216f0f591e-host-slash\") pod \"iptables-alerter-cf5gs\" (UID: \"d5d80831-45a4-4697-8170-22216f0f591e\") " pod="openshift-network-operator/iptables-alerter-cf5gs" Jul 02 19:01:14.742249 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741776 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4660d4a5-2ff9-49c1-948d-22fb52579391-serviceca\") pod \"node-ca-dk7fw\" (UID: \"4660d4a5-2ff9-49c1-948d-22fb52579391\") " pod="openshift-image-registry/node-ca-dk7fw" Jul 02 19:01:14.742249 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.741801 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a95b977b-6b92-411f-a185-ecc012668bff-env-overrides\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.742249 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.742136 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:01:14.742249 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.742142 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 19:01:14.743025 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.742352 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-747lx\"" Jul 02 19:01:14.744168 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.744146 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 19:01:14.772162 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.772143 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gxdvq" Jul 02 19:01:14.786275 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.786255 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gxdvq" Jul 02 19:01:14.802460 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.802435 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:01:14.832045 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.832018 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 19:01:14.842861 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.842824 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-os-release\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.842861 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.842861 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-host-var-lib-cni-bin\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.843002 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.842880 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1acbb3a6-a477-4838-a28b-4208436cf0e0-etc-selinux\") pod \"aws-ebs-csi-driver-node-qbt6w\" (UID: \"1acbb3a6-a477-4838-a28b-4208436cf0e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w" Jul 02 19:01:14.843002 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.842955 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-host-var-lib-cni-bin\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.843067 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843001 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-host-cni-netd\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.843067 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843030 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/92b042c6-6b86-452c-8f9f-2341729e81c5-kubelet-config\") pod \"global-pull-secret-syncer-z4j2p\" (UID: \"92b042c6-6b86-452c-8f9f-2341729e81c5\") " pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:14.843067 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843060 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-etc-sysconfig\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.843173 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843069 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1acbb3a6-a477-4838-a28b-4208436cf0e0-etc-selinux\") pod \"aws-ebs-csi-driver-node-qbt6w\" (UID: \"1acbb3a6-a477-4838-a28b-4208436cf0e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w" Jul 02 19:01:14.843173 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843068 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-host-cni-netd\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.843173 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843030 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-os-release\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.843173 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843088 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-run\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.843173 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843131 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-host-run-k8s-cni-cncf-io\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.843353 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843162 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/119124a9-adad-4612-a91c-34750c3e9c51-multus-daemon-config\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.843353 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843184 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-host-run-k8s-cni-cncf-io\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.843353 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843217 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k9r8\" (UniqueName: \"kubernetes.io/projected/7d6e7a30-d495-4e43-bba9-c9fda98277d9-kube-api-access-4k9r8\") pod \"network-metrics-daemon-2lpws\" (UID: \"7d6e7a30-d495-4e43-bba9-c9fda98277d9\") " pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:14.843353 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843239 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5d80831-45a4-4697-8170-22216f0f591e-host-slash\") pod \"iptables-alerter-cf5gs\" (UID: \"d5d80831-45a4-4697-8170-22216f0f591e\") " pod="openshift-network-operator/iptables-alerter-cf5gs" Jul 02 19:01:14.843353 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843282 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4660d4a5-2ff9-49c1-948d-22fb52579391-serviceca\") pod \"node-ca-dk7fw\" (UID: \"4660d4a5-2ff9-49c1-948d-22fb52579391\") " pod="openshift-image-registry/node-ca-dk7fw" Jul 02 19:01:14.843353 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843306 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a95b977b-6b92-411f-a185-ecc012668bff-env-overrides\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.843353 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843343 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5d80831-45a4-4697-8170-22216f0f591e-host-slash\") pod \"iptables-alerter-cf5gs\" (UID: \"d5d80831-45a4-4697-8170-22216f0f591e\") " pod="openshift-network-operator/iptables-alerter-cf5gs" Jul 02 19:01:14.843703 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843384 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxqs2\" (UniqueName: \"kubernetes.io/projected/a95b977b-6b92-411f-a185-ecc012668bff-kube-api-access-jxqs2\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.843703 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843414 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn6c9\" (UniqueName: \"kubernetes.io/projected/eed6dcf6-1438-4b95-a1e1-410eff54e692-kube-api-access-nn6c9\") pod \"multus-additional-cni-plugins-n79rs\" (UID: \"eed6dcf6-1438-4b95-a1e1-410eff54e692\") " pod="openshift-multus/multus-additional-cni-plugins-n79rs" Jul 02 19:01:14.843703 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843440 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4660d4a5-2ff9-49c1-948d-22fb52579391-host\") pod \"node-ca-dk7fw\" (UID: \"4660d4a5-2ff9-49c1-948d-22fb52579391\") " pod="openshift-image-registry/node-ca-dk7fw" Jul 02 19:01:14.843703 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843464 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-host-kubelet\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.843703 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843494 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-etc-modprobe-d\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.843703 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843519 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-etc-systemd\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.843703 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843544 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d2096bb-8e60-4801-badc-eb044d92de9c-etc-tuned\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.843703 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843566 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-system-cni-dir\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.843703 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843617 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-cnibin\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.843703 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843639 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-etc-kubernetes\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.843703 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843664 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1acbb3a6-a477-4838-a28b-4208436cf0e0-socket-dir\") pod \"aws-ebs-csi-driver-node-qbt6w\" (UID: \"1acbb3a6-a477-4838-a28b-4208436cf0e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w" Jul 02 19:01:14.843703 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843688 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4660d4a5-2ff9-49c1-948d-22fb52579391-host\") pod \"node-ca-dk7fw\" (UID: \"4660d4a5-2ff9-49c1-948d-22fb52579391\") " pod="openshift-image-registry/node-ca-dk7fw" Jul 02 19:01:14.843703 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843691 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eed6dcf6-1438-4b95-a1e1-410eff54e692-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n79rs\" (UID: \"eed6dcf6-1438-4b95-a1e1-410eff54e692\") " pod="openshift-multus/multus-additional-cni-plugins-n79rs" Jul 02 19:01:14.844252 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843717 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-host-kubelet\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.844252 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843721 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-etc-sysctl-d\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.844252 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843760 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-system-cni-dir\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.844252 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843763 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4660d4a5-2ff9-49c1-948d-22fb52579391-serviceca\") pod \"node-ca-dk7fw\" (UID: \"4660d4a5-2ff9-49c1-948d-22fb52579391\") " pod="openshift-image-registry/node-ca-dk7fw" Jul 02 19:01:14.844252 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843766 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-host\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.844252 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843784 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-cnibin\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.844252 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843814 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmkkb\" (UniqueName: \"kubernetes.io/projected/4d2096bb-8e60-4801-badc-eb044d92de9c-kube-api-access-qmkkb\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.844252 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843841 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-etc-kubernetes\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.844252 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843866 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/119124a9-adad-4612-a91c-34750c3e9c51-multus-daemon-config\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.844252 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843845 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1acbb3a6-a477-4838-a28b-4208436cf0e0-registration-dir\") pod \"aws-ebs-csi-driver-node-qbt6w\" (UID: \"1acbb3a6-a477-4838-a28b-4208436cf0e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w" Jul 02 19:01:14.844252 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843905 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1acbb3a6-a477-4838-a28b-4208436cf0e0-socket-dir\") pod \"aws-ebs-csi-driver-node-qbt6w\" (UID: \"1acbb3a6-a477-4838-a28b-4208436cf0e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w" Jul 02 19:01:14.844252 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843921 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zwjc\" (UniqueName: \"kubernetes.io/projected/d5d80831-45a4-4697-8170-22216f0f591e-kube-api-access-5zwjc\") pod \"iptables-alerter-cf5gs\" (UID: \"d5d80831-45a4-4697-8170-22216f0f591e\") " pod="openshift-network-operator/iptables-alerter-cf5gs" Jul 02 19:01:14.844252 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843872 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a95b977b-6b92-411f-a185-ecc012668bff-env-overrides\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.844252 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843947 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-node-log\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.844252 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843983 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-node-log\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.844252 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.843981 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-log-socket\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.844252 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.844018 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-log-socket\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.844252 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.844024 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/92b042c6-6b86-452c-8f9f-2341729e81c5-dbus\") pod \"global-pull-secret-syncer-z4j2p\" (UID: \"92b042c6-6b86-452c-8f9f-2341729e81c5\") " pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:14.845032 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.844043 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1acbb3a6-a477-4838-a28b-4208436cf0e0-registration-dir\") pod \"aws-ebs-csi-driver-node-qbt6w\" (UID: \"1acbb3a6-a477-4838-a28b-4208436cf0e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w" Jul 02 19:01:14.845032 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.844051 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-multus-socket-dir-parent\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.845032 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.844077 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlp75\" (UniqueName: \"kubernetes.io/projected/ef58dd71-af47-44a1-8c47-d4e98378651d-kube-api-access-nlp75\") pod \"node-resolver-wwdxl\" (UID: \"ef58dd71-af47-44a1-8c47-d4e98378651d\") " pod="openshift-dns/node-resolver-wwdxl" Jul 02 19:01:14.845032 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.844119 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-multus-socket-dir-parent\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.845032 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.844148 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d5d80831-45a4-4697-8170-22216f0f591e-iptables-alerter-script\") pod \"iptables-alerter-cf5gs\" (UID: \"d5d80831-45a4-4697-8170-22216f0f591e\") " pod="openshift-network-operator/iptables-alerter-cf5gs" Jul 02 19:01:14.845032 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.844165 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-run-ovn\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.845032 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.844195 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-run-ovn\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.845032 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.844214 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/92ce22b9-a9ce-4f08-b4d1-b770c2e317ae-konnectivity-ca\") pod \"konnectivity-agent-6zv56\" (UID: \"92ce22b9-a9ce-4f08-b4d1-b770c2e317ae\") " pod="kube-system/konnectivity-agent-6zv56" Jul 02 19:01:14.845032 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.844244 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/119124a9-adad-4612-a91c-34750c3e9c51-cni-binary-copy\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.845032 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.844262 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1acbb3a6-a477-4838-a28b-4208436cf0e0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qbt6w\" (UID: \"1acbb3a6-a477-4838-a28b-4208436cf0e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w" Jul 02 19:01:14.845032 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.844285 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-var-lib-openvswitch\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.845032 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.844562 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eed6dcf6-1438-4b95-a1e1-410eff54e692-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n79rs\" (UID: \"eed6dcf6-1438-4b95-a1e1-410eff54e692\") " pod="openshift-multus/multus-additional-cni-plugins-n79rs" Jul 02 19:01:14.845032 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.844625 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1acbb3a6-a477-4838-a28b-4208436cf0e0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qbt6w\" (UID: \"1acbb3a6-a477-4838-a28b-4208436cf0e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w" Jul 02 19:01:14.845032 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.844307 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/92ce22b9-a9ce-4f08-b4d1-b770c2e317ae-agent-certs\") pod \"konnectivity-agent-6zv56\" (UID: \"92ce22b9-a9ce-4f08-b4d1-b770c2e317ae\") " pod="kube-system/konnectivity-agent-6zv56" Jul 02 19:01:14.845032 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.844689 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-host-run-multus-certs\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.845032 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.844722 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-run-openvswitch\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.845032 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.844737 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-var-lib-openvswitch\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.845753 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.844752 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a95b977b-6b92-411f-a185-ecc012668bff-ovnkube-script-lib\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.845753 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.844791 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eed6dcf6-1438-4b95-a1e1-410eff54e692-os-release\") pod \"multus-additional-cni-plugins-n79rs\" (UID: \"eed6dcf6-1438-4b95-a1e1-410eff54e692\") " pod="openshift-multus/multus-additional-cni-plugins-n79rs" Jul 02 19:01:14.845753 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.844821 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92b042c6-6b86-452c-8f9f-2341729e81c5-original-pull-secret\") pod \"global-pull-secret-syncer-z4j2p\" (UID: \"92b042c6-6b86-452c-8f9f-2341729e81c5\") " pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:14.845753 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.844872 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-var-lib-kubelet\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.845753 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.844909 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eed6dcf6-1438-4b95-a1e1-410eff54e692-system-cni-dir\") pod \"multus-additional-cni-plugins-n79rs\" (UID: \"eed6dcf6-1438-4b95-a1e1-410eff54e692\") " pod="openshift-multus/multus-additional-cni-plugins-n79rs" Jul 02 19:01:14.845753 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.844943 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eed6dcf6-1438-4b95-a1e1-410eff54e692-cnibin\") pod \"multus-additional-cni-plugins-n79rs\" (UID: \"eed6dcf6-1438-4b95-a1e1-410eff54e692\") " pod="openshift-multus/multus-additional-cni-plugins-n79rs" Jul 02 19:01:14.845753 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.844976 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-hostroot\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.845753 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845000 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/119124a9-adad-4612-a91c-34750c3e9c51-cni-binary-copy\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.845753 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845012 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d5d80831-45a4-4697-8170-22216f0f591e-iptables-alerter-script\") pod \"iptables-alerter-cf5gs\" (UID: \"d5d80831-45a4-4697-8170-22216f0f591e\") " pod="openshift-network-operator/iptables-alerter-cf5gs" Jul 02 19:01:14.845753 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845088 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-hostroot\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.845753 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845097 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eed6dcf6-1438-4b95-a1e1-410eff54e692-system-cni-dir\") pod \"multus-additional-cni-plugins-n79rs\" (UID: \"eed6dcf6-1438-4b95-a1e1-410eff54e692\") " pod="openshift-multus/multus-additional-cni-plugins-n79rs" Jul 02 19:01:14.845753 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845116 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eed6dcf6-1438-4b95-a1e1-410eff54e692-cnibin\") pod \"multus-additional-cni-plugins-n79rs\" (UID: \"eed6dcf6-1438-4b95-a1e1-410eff54e692\") " pod="openshift-multus/multus-additional-cni-plugins-n79rs" Jul 02 19:01:14.845753 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845143 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-run-openvswitch\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.845753 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845162 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-host-run-multus-certs\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.845753 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845006 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-host-slash\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.845753 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845216 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eed6dcf6-1438-4b95-a1e1-410eff54e692-os-release\") pod \"multus-additional-cni-plugins-n79rs\" (UID: \"eed6dcf6-1438-4b95-a1e1-410eff54e692\") " pod="openshift-multus/multus-additional-cni-plugins-n79rs" Jul 02 19:01:14.845753 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845218 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.846482 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845281 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-host-slash\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.846482 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845270 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a95b977b-6b92-411f-a185-ecc012668bff-ovnkube-script-lib\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.846482 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845290 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eed6dcf6-1438-4b95-a1e1-410eff54e692-cni-binary-copy\") pod \"multus-additional-cni-plugins-n79rs\" (UID: \"eed6dcf6-1438-4b95-a1e1-410eff54e692\") " pod="openshift-multus/multus-additional-cni-plugins-n79rs" Jul 02 19:01:14.846482 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845336 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.846482 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845344 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5q4m\" (UniqueName: \"kubernetes.io/projected/5c664d91-c6bf-47e2-9ab0-4d3bfab4964c-kube-api-access-w5q4m\") pod \"network-check-target-b4fq5\" (UID: \"5c664d91-c6bf-47e2-9ab0-4d3bfab4964c\") " pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:01:14.846482 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845377 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d2096bb-8e60-4801-badc-eb044d92de9c-tmp\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.846482 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845433 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-host-run-netns\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.846482 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845478 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-host-var-lib-cni-multus\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.846482 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845506 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef58dd71-af47-44a1-8c47-d4e98378651d-tmp-dir\") pod \"node-resolver-wwdxl\" (UID: \"ef58dd71-af47-44a1-8c47-d4e98378651d\") " pod="openshift-dns/node-resolver-wwdxl" Jul 02 19:01:14.846482 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845534 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-run-systemd\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.846482 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845563 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-host-run-ovn-kubernetes\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.846482 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845579 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-host-run-netns\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.846482 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845614 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eed6dcf6-1438-4b95-a1e1-410eff54e692-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n79rs\" (UID: \"eed6dcf6-1438-4b95-a1e1-410eff54e692\") " pod="openshift-multus/multus-additional-cni-plugins-n79rs" Jul 02 19:01:14.846482 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845658 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eed6dcf6-1438-4b95-a1e1-410eff54e692-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n79rs\" (UID: \"eed6dcf6-1438-4b95-a1e1-410eff54e692\") " pod="openshift-multus/multus-additional-cni-plugins-n79rs" Jul 02 19:01:14.846482 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845687 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-lib-modules\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.846482 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845809 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eed6dcf6-1438-4b95-a1e1-410eff54e692-cni-binary-copy\") pod \"multus-additional-cni-plugins-n79rs\" (UID: \"eed6dcf6-1438-4b95-a1e1-410eff54e692\") " pod="openshift-multus/multus-additional-cni-plugins-n79rs" Jul 02 19:01:14.846482 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845889 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef58dd71-af47-44a1-8c47-d4e98378651d-tmp-dir\") pod \"node-resolver-wwdxl\" (UID: \"ef58dd71-af47-44a1-8c47-d4e98378651d\") " pod="openshift-dns/node-resolver-wwdxl" Jul 02 19:01:14.847258 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845899 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-host-var-lib-cni-multus\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.847258 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845961 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-run-systemd\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.847258 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845966 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-host-run-ovn-kubernetes\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.847258 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.846090 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eed6dcf6-1438-4b95-a1e1-410eff54e692-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n79rs\" (UID: \"eed6dcf6-1438-4b95-a1e1-410eff54e692\") " pod="openshift-multus/multus-additional-cni-plugins-n79rs" Jul 02 19:01:14.847258 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.845714 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ef58dd71-af47-44a1-8c47-d4e98378651d-hosts-file\") pod \"node-resolver-wwdxl\" (UID: \"ef58dd71-af47-44a1-8c47-d4e98378651d\") " pod="openshift-dns/node-resolver-wwdxl" Jul 02 19:01:14.847258 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.846212 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-multus-conf-dir\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.847258 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.846239 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qc47\" (UniqueName: \"kubernetes.io/projected/119124a9-adad-4612-a91c-34750c3e9c51-kube-api-access-4qc47\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.847258 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.846256 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ef58dd71-af47-44a1-8c47-d4e98378651d-hosts-file\") pod \"node-resolver-wwdxl\" (UID: \"ef58dd71-af47-44a1-8c47-d4e98378651d\") " pod="openshift-dns/node-resolver-wwdxl" Jul 02 19:01:14.847258 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.846268 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1acbb3a6-a477-4838-a28b-4208436cf0e0-device-dir\") pod \"aws-ebs-csi-driver-node-qbt6w\" (UID: \"1acbb3a6-a477-4838-a28b-4208436cf0e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w" Jul 02 19:01:14.847258 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.846296 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-etc-openvswitch\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.847258 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.846325 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-multus-conf-dir\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.847258 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.846340 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-multus-cni-dir\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.847258 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.846369 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsj57\" (UniqueName: \"kubernetes.io/projected/4660d4a5-2ff9-49c1-948d-22fb52579391-kube-api-access-dsj57\") pod \"node-ca-dk7fw\" (UID: \"4660d4a5-2ff9-49c1-948d-22fb52579391\") " pod="openshift-image-registry/node-ca-dk7fw" Jul 02 19:01:14.847258 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.846384 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1acbb3a6-a477-4838-a28b-4208436cf0e0-device-dir\") pod \"aws-ebs-csi-driver-node-qbt6w\" (UID: \"1acbb3a6-a477-4838-a28b-4208436cf0e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w" Jul 02 19:01:14.847258 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.846398 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-host-cni-bin\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.847258 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.846407 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eed6dcf6-1438-4b95-a1e1-410eff54e692-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n79rs\" (UID: \"eed6dcf6-1438-4b95-a1e1-410eff54e692\") " pod="openshift-multus/multus-additional-cni-plugins-n79rs" Jul 02 19:01:14.847258 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.846446 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-sys\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.848033 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.846455 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-host-cni-bin\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.848033 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.846497 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-host-var-lib-kubelet\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.848033 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.846527 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1acbb3a6-a477-4838-a28b-4208436cf0e0-sys-fs\") pod \"aws-ebs-csi-driver-node-qbt6w\" (UID: \"1acbb3a6-a477-4838-a28b-4208436cf0e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w" Jul 02 19:01:14.848033 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.846561 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sb8s\" (UniqueName: \"kubernetes.io/projected/1acbb3a6-a477-4838-a28b-4208436cf0e0-kube-api-access-7sb8s\") pod \"aws-ebs-csi-driver-node-qbt6w\" (UID: \"1acbb3a6-a477-4838-a28b-4208436cf0e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w" Jul 02 19:01:14.848033 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.846562 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-multus-cni-dir\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.848033 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.846586 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-systemd-units\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.848033 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.846617 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-etc-openvswitch\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.848033 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.846617 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a95b977b-6b92-411f-a185-ecc012668bff-ovnkube-config\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.848033 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.846657 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-etc-sysctl-conf\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.848033 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.846690 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs\") pod \"network-metrics-daemon-2lpws\" (UID: \"7d6e7a30-d495-4e43-bba9-c9fda98277d9\") " pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:14.848033 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.846731 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-host-run-netns\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.848033 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.846750 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-systemd-units\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.848033 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.846766 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a95b977b-6b92-411f-a185-ecc012668bff-ovn-node-metrics-cert\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.848033 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.846831 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-etc-kubernetes\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.848033 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.846974 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/119124a9-adad-4612-a91c-34750c3e9c51-host-var-lib-kubelet\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.848033 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.847026 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1acbb3a6-a477-4838-a28b-4208436cf0e0-sys-fs\") pod \"aws-ebs-csi-driver-node-qbt6w\" (UID: \"1acbb3a6-a477-4838-a28b-4208436cf0e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w" Jul 02 19:01:14.848033 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.847402 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 19:01:14.848033 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.847404 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a95b977b-6b92-411f-a185-ecc012668bff-ovnkube-config\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.848653 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.847478 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a95b977b-6b92-411f-a185-ecc012668bff-host-run-netns\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.848653 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:14.847495 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:01:14.848653 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:14.847601 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs podName:7d6e7a30-d495-4e43-bba9-c9fda98277d9 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:15.347576215 +0000 UTC m=+3.009545359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs") pod "network-metrics-daemon-2lpws" (UID: "7d6e7a30-d495-4e43-bba9-c9fda98277d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:01:14.850910 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.850895 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a95b977b-6b92-411f-a185-ecc012668bff-ovn-node-metrics-cert\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.857545 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.857526 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k9r8\" (UniqueName: \"kubernetes.io/projected/7d6e7a30-d495-4e43-bba9-c9fda98277d9-kube-api-access-4k9r8\") pod \"network-metrics-daemon-2lpws\" (UID: \"7d6e7a30-d495-4e43-bba9-c9fda98277d9\") " pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:14.859294 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:14.859275 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:01:14.859387 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:14.859298 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:01:14.859387 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:14.859311 2559 projected.go:196] Error preparing data for projected volume kube-api-access-w5q4m for pod openshift-network-diagnostics/network-check-target-b4fq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:01:14.859387 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:14.859369 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c664d91-c6bf-47e2-9ab0-4d3bfab4964c-kube-api-access-w5q4m podName:5c664d91-c6bf-47e2-9ab0-4d3bfab4964c nodeName:}" failed. No retries permitted until 2026-07-02 19:01:15.359354108 +0000 UTC m=+3.021323256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-w5q4m" (UniqueName: "kubernetes.io/projected/5c664d91-c6bf-47e2-9ab0-4d3bfab4964c-kube-api-access-w5q4m") pod "network-check-target-b4fq5" (UID: "5c664d91-c6bf-47e2-9ab0-4d3bfab4964c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:01:14.862298 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.862255 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zwjc\" (UniqueName: \"kubernetes.io/projected/d5d80831-45a4-4697-8170-22216f0f591e-kube-api-access-5zwjc\") pod \"iptables-alerter-cf5gs\" (UID: \"d5d80831-45a4-4697-8170-22216f0f591e\") " pod="openshift-network-operator/iptables-alerter-cf5gs" Jul 02 19:01:14.862298 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.862278 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxqs2\" (UniqueName: \"kubernetes.io/projected/a95b977b-6b92-411f-a185-ecc012668bff-kube-api-access-jxqs2\") pod \"ovnkube-node-5gf2s\" (UID: \"a95b977b-6b92-411f-a185-ecc012668bff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:14.862732 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.862706 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn6c9\" (UniqueName: \"kubernetes.io/projected/eed6dcf6-1438-4b95-a1e1-410eff54e692-kube-api-access-nn6c9\") pod \"multus-additional-cni-plugins-n79rs\" (UID: \"eed6dcf6-1438-4b95-a1e1-410eff54e692\") " pod="openshift-multus/multus-additional-cni-plugins-n79rs" Jul 02 19:01:14.862732 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.862717 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qc47\" (UniqueName: \"kubernetes.io/projected/119124a9-adad-4612-a91c-34750c3e9c51-kube-api-access-4qc47\") pod \"multus-z7cr2\" (UID: \"119124a9-adad-4612-a91c-34750c3e9c51\") " pod="openshift-multus/multus-z7cr2" Jul 02 19:01:14.862732 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.862726 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlp75\" (UniqueName: \"kubernetes.io/projected/ef58dd71-af47-44a1-8c47-d4e98378651d-kube-api-access-nlp75\") pod \"node-resolver-wwdxl\" (UID: \"ef58dd71-af47-44a1-8c47-d4e98378651d\") " pod="openshift-dns/node-resolver-wwdxl" Jul 02 19:01:14.862881 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.862717 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sb8s\" (UniqueName: \"kubernetes.io/projected/1acbb3a6-a477-4838-a28b-4208436cf0e0-kube-api-access-7sb8s\") pod \"aws-ebs-csi-driver-node-qbt6w\" (UID: \"1acbb3a6-a477-4838-a28b-4208436cf0e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w" Jul 02 19:01:14.862881 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.862800 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsj57\" (UniqueName: \"kubernetes.io/projected/4660d4a5-2ff9-49c1-948d-22fb52579391-kube-api-access-dsj57\") pod \"node-ca-dk7fw\" (UID: \"4660d4a5-2ff9-49c1-948d-22fb52579391\") " pod="openshift-image-registry/node-ca-dk7fw" Jul 02 19:01:14.947945 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.947918 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/92b042c6-6b86-452c-8f9f-2341729e81c5-kubelet-config\") pod \"global-pull-secret-syncer-z4j2p\" (UID: \"92b042c6-6b86-452c-8f9f-2341729e81c5\") " pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:14.947945 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.947948 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-etc-sysconfig\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.948165 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.947965 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-run\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.948165 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.947991 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-etc-modprobe-d\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.948165 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948011 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-etc-systemd\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.948165 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948032 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d2096bb-8e60-4801-badc-eb044d92de9c-etc-tuned\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.948165 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948046 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/92b042c6-6b86-452c-8f9f-2341729e81c5-kubelet-config\") pod \"global-pull-secret-syncer-z4j2p\" (UID: \"92b042c6-6b86-452c-8f9f-2341729e81c5\") " pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:14.948165 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948057 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-etc-sysctl-d\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.948165 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948064 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-etc-sysconfig\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.948165 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948078 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-host\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.948165 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948064 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-run\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.948165 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948096 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-etc-systemd\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.948165 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948100 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmkkb\" (UniqueName: \"kubernetes.io/projected/4d2096bb-8e60-4801-badc-eb044d92de9c-kube-api-access-qmkkb\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.948165 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948126 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-host\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.948165 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948144 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-etc-modprobe-d\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.948165 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948155 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/92b042c6-6b86-452c-8f9f-2341729e81c5-dbus\") pod \"global-pull-secret-syncer-z4j2p\" (UID: \"92b042c6-6b86-452c-8f9f-2341729e81c5\") " pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:14.948795 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948173 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-etc-sysctl-d\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.948795 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948182 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/92ce22b9-a9ce-4f08-b4d1-b770c2e317ae-konnectivity-ca\") pod \"konnectivity-agent-6zv56\" (UID: \"92ce22b9-a9ce-4f08-b4d1-b770c2e317ae\") " pod="kube-system/konnectivity-agent-6zv56" Jul 02 19:01:14.948795 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948201 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/92ce22b9-a9ce-4f08-b4d1-b770c2e317ae-agent-certs\") pod \"konnectivity-agent-6zv56\" (UID: \"92ce22b9-a9ce-4f08-b4d1-b770c2e317ae\") " pod="kube-system/konnectivity-agent-6zv56" Jul 02 19:01:14.948795 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948216 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/92b042c6-6b86-452c-8f9f-2341729e81c5-dbus\") pod \"global-pull-secret-syncer-z4j2p\" (UID: \"92b042c6-6b86-452c-8f9f-2341729e81c5\") " pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:14.948795 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948224 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92b042c6-6b86-452c-8f9f-2341729e81c5-original-pull-secret\") pod \"global-pull-secret-syncer-z4j2p\" (UID: \"92b042c6-6b86-452c-8f9f-2341729e81c5\") " pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:14.948795 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948253 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-var-lib-kubelet\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.948795 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948282 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d2096bb-8e60-4801-badc-eb044d92de9c-tmp\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.948795 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:14.948291 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:01:14.948795 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948303 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-lib-modules\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.948795 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948333 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-sys\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.948795 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948338 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-var-lib-kubelet\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.948795 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:14.948346 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92b042c6-6b86-452c-8f9f-2341729e81c5-original-pull-secret podName:92b042c6-6b86-452c-8f9f-2341729e81c5 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:15.448329772 +0000 UTC m=+3.110298901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/92b042c6-6b86-452c-8f9f-2341729e81c5-original-pull-secret") pod "global-pull-secret-syncer-z4j2p" (UID: "92b042c6-6b86-452c-8f9f-2341729e81c5") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:01:14.948795 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948373 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-sys\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.948795 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948395 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-etc-sysctl-conf\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.948795 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948471 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-etc-kubernetes\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.948795 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948483 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-lib-modules\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.948795 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948545 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-etc-kubernetes\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.949314 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948637 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d2096bb-8e60-4801-badc-eb044d92de9c-etc-sysctl-conf\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.949314 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.948760 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/92ce22b9-a9ce-4f08-b4d1-b770c2e317ae-konnectivity-ca\") pod \"konnectivity-agent-6zv56\" (UID: \"92ce22b9-a9ce-4f08-b4d1-b770c2e317ae\") " pod="kube-system/konnectivity-agent-6zv56" Jul 02 19:01:14.950212 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.950187 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d2096bb-8e60-4801-badc-eb044d92de9c-etc-tuned\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.950422 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.950407 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d2096bb-8e60-4801-badc-eb044d92de9c-tmp\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:14.950422 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.950413 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/92ce22b9-a9ce-4f08-b4d1-b770c2e317ae-agent-certs\") pod \"konnectivity-agent-6zv56\" (UID: \"92ce22b9-a9ce-4f08-b4d1-b770c2e317ae\") " pod="kube-system/konnectivity-agent-6zv56" Jul 02 19:01:14.958932 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:14.958917 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmkkb\" (UniqueName: \"kubernetes.io/projected/4d2096bb-8e60-4801-badc-eb044d92de9c-kube-api-access-qmkkb\") pod \"tuned-q9qdf\" (UID: \"4d2096bb-8e60-4801-badc-eb044d92de9c\") " pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:15.032070 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:15.032012 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n79rs" Jul 02 19:01:15.042770 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:15.042750 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cf5gs" Jul 02 19:01:15.050031 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:15.050013 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z7cr2" Jul 02 19:01:15.054552 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:15.054533 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w" Jul 02 19:01:15.058977 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:15.058961 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wwdxl" Jul 02 19:01:15.064537 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:15.064521 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dk7fw" Jul 02 19:01:15.069599 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:15.069584 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:15.075068 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:15.075050 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6zv56" Jul 02 19:01:15.080535 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:15.080517 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" Jul 02 19:01:15.343718 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:15.343596 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeed6dcf6_1438_4b95_a1e1_410eff54e692.slice/crio-5d306f312d18c2b4408cd90f665345fc1ddfb91b1aec324f36b894091dd257aa WatchSource:0}: Error finding container 5d306f312d18c2b4408cd90f665345fc1ddfb91b1aec324f36b894091dd257aa: Status 404 returned error can't find the container with id 5d306f312d18c2b4408cd90f665345fc1ddfb91b1aec324f36b894091dd257aa Jul 02 19:01:15.350580 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:15.350558 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs\") pod \"network-metrics-daemon-2lpws\" (UID: \"7d6e7a30-d495-4e43-bba9-c9fda98277d9\") " pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:15.350702 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:15.350682 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:01:15.350747 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:15.350739 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs podName:7d6e7a30-d495-4e43-bba9-c9fda98277d9 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:16.35072579 +0000 UTC m=+4.012694918 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs") pod "network-metrics-daemon-2lpws" (UID: "7d6e7a30-d495-4e43-bba9-c9fda98277d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:01:15.373275 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:15.373253 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda95b977b_6b92_411f_a185_ecc012668bff.slice/crio-8b84f832e4acc773e98a099fdd2e423e271374fc1299251906714e9eea662f7e WatchSource:0}: Error finding container 8b84f832e4acc773e98a099fdd2e423e271374fc1299251906714e9eea662f7e: Status 404 returned error can't find the container with id 8b84f832e4acc773e98a099fdd2e423e271374fc1299251906714e9eea662f7e Jul 02 19:01:15.374158 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:15.374137 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1acbb3a6_a477_4838_a28b_4208436cf0e0.slice/crio-8d09aea6dc0ede189f15a4ce9336f50f28913970542c7cbb4057fcbda7839335 WatchSource:0}: Error finding container 8d09aea6dc0ede189f15a4ce9336f50f28913970542c7cbb4057fcbda7839335: Status 404 returned error can't find the container with id 8d09aea6dc0ede189f15a4ce9336f50f28913970542c7cbb4057fcbda7839335 Jul 02 19:01:15.375179 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:15.375112 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef58dd71_af47_44a1_8c47_d4e98378651d.slice/crio-ec22865202181fab226dc81731d67d84f09b82215f7e3425d0df012400f01d67 WatchSource:0}: Error finding container ec22865202181fab226dc81731d67d84f09b82215f7e3425d0df012400f01d67: Status 404 returned error can't find the container with id ec22865202181fab226dc81731d67d84f09b82215f7e3425d0df012400f01d67 Jul 02 19:01:15.375828 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:15.375665 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4660d4a5_2ff9_49c1_948d_22fb52579391.slice/crio-13aee37b246fe3b9e3c4fe1f351b103c2b105ea7d5ea78446971070c43078034 WatchSource:0}: Error finding container 13aee37b246fe3b9e3c4fe1f351b103c2b105ea7d5ea78446971070c43078034: Status 404 returned error can't find the container with id 13aee37b246fe3b9e3c4fe1f351b103c2b105ea7d5ea78446971070c43078034 Jul 02 19:01:15.377091 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:15.376737 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92ce22b9_a9ce_4f08_b4d1_b770c2e317ae.slice/crio-7bc55ac508d5874ef60610283e5f9f6c43904e09d80271ba06c9d03a2973171f WatchSource:0}: Error finding container 7bc55ac508d5874ef60610283e5f9f6c43904e09d80271ba06c9d03a2973171f: Status 404 returned error can't find the container with id 7bc55ac508d5874ef60610283e5f9f6c43904e09d80271ba06c9d03a2973171f Jul 02 19:01:15.377752 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:15.377593 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod119124a9_adad_4612_a91c_34750c3e9c51.slice/crio-225d5ad3eadab41b2929af4891ffdaf271f204aa35e97e5d7c369df58246a0eb WatchSource:0}: Error finding container 225d5ad3eadab41b2929af4891ffdaf271f204aa35e97e5d7c369df58246a0eb: Status 404 returned error can't find the container with id 225d5ad3eadab41b2929af4891ffdaf271f204aa35e97e5d7c369df58246a0eb Jul 02 19:01:15.378343 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:15.378323 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d2096bb_8e60_4801_badc_eb044d92de9c.slice/crio-c19cfd608f78d6edb70d937d204fc7131b2e4498172a7fcf51f78049bbbd1e97 WatchSource:0}: Error finding container c19cfd608f78d6edb70d937d204fc7131b2e4498172a7fcf51f78049bbbd1e97: Status 404 returned error can't find the container with id c19cfd608f78d6edb70d937d204fc7131b2e4498172a7fcf51f78049bbbd1e97 Jul 02 19:01:15.451151 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:15.451124 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92b042c6-6b86-452c-8f9f-2341729e81c5-original-pull-secret\") pod \"global-pull-secret-syncer-z4j2p\" (UID: \"92b042c6-6b86-452c-8f9f-2341729e81c5\") " pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:15.451291 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:15.451160 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5q4m\" (UniqueName: \"kubernetes.io/projected/5c664d91-c6bf-47e2-9ab0-4d3bfab4964c-kube-api-access-w5q4m\") pod \"network-check-target-b4fq5\" (UID: \"5c664d91-c6bf-47e2-9ab0-4d3bfab4964c\") " pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:01:15.451291 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:15.451272 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:01:15.451371 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:15.451296 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:01:15.451371 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:15.451314 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:01:15.451371 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:15.451325 2559 projected.go:196] Error preparing data for projected volume kube-api-access-w5q4m for pod openshift-network-diagnostics/network-check-target-b4fq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:01:15.451371 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:15.451340 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92b042c6-6b86-452c-8f9f-2341729e81c5-original-pull-secret podName:92b042c6-6b86-452c-8f9f-2341729e81c5 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:16.451316588 +0000 UTC m=+4.113285735 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/92b042c6-6b86-452c-8f9f-2341729e81c5-original-pull-secret") pod "global-pull-secret-syncer-z4j2p" (UID: "92b042c6-6b86-452c-8f9f-2341729e81c5") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:01:15.451526 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:15.451372 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c664d91-c6bf-47e2-9ab0-4d3bfab4964c-kube-api-access-w5q4m podName:5c664d91-c6bf-47e2-9ab0-4d3bfab4964c nodeName:}" failed. No retries permitted until 2026-07-02 19:01:16.451361815 +0000 UTC m=+4.113330943 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-w5q4m" (UniqueName: "kubernetes.io/projected/5c664d91-c6bf-47e2-9ab0-4d3bfab4964c-kube-api-access-w5q4m") pod "network-check-target-b4fq5" (UID: "5c664d91-c6bf-47e2-9ab0-4d3bfab4964c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:01:15.788633 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:15.788426 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 18:56:14 +0000 UTC" deadline="2028-01-18 17:47:39.817643073 +0000 UTC" Jul 02 19:01:15.788633 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:15.788623 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13558h46m24.029025106s" Jul 02 19:01:15.889528 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:15.889446 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z7cr2" event={"ID":"119124a9-adad-4612-a91c-34750c3e9c51","Type":"ContainerStarted","Data":"225d5ad3eadab41b2929af4891ffdaf271f204aa35e97e5d7c369df58246a0eb"} Jul 02 19:01:15.890589 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:15.890553 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dk7fw" event={"ID":"4660d4a5-2ff9-49c1-948d-22fb52579391","Type":"ContainerStarted","Data":"13aee37b246fe3b9e3c4fe1f351b103c2b105ea7d5ea78446971070c43078034"} Jul 02 19:01:15.891673 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:15.891645 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wwdxl" event={"ID":"ef58dd71-af47-44a1-8c47-d4e98378651d","Type":"ContainerStarted","Data":"ec22865202181fab226dc81731d67d84f09b82215f7e3425d0df012400f01d67"} Jul 02 19:01:15.892782 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:15.892761 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w" event={"ID":"1acbb3a6-a477-4838-a28b-4208436cf0e0","Type":"ContainerStarted","Data":"8d09aea6dc0ede189f15a4ce9336f50f28913970542c7cbb4057fcbda7839335"} Jul 02 19:01:15.894032 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:15.893999 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" event={"ID":"a95b977b-6b92-411f-a185-ecc012668bff","Type":"ContainerStarted","Data":"8b84f832e4acc773e98a099fdd2e423e271374fc1299251906714e9eea662f7e"} Jul 02 19:01:15.896057 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:15.896028 2559 generic.go:356] "Generic (PLEG): container finished" podID="89db45177650e6194fe054377f4724d8" containerID="0c7302873854165a86d35a042020bed18dc1a97f8e7eb146319af3586ea49bde" exitCode=0 Jul 02 19:01:15.896169 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:15.896054 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-197.ec2.internal" event={"ID":"89db45177650e6194fe054377f4724d8","Type":"ContainerDied","Data":"0c7302873854165a86d35a042020bed18dc1a97f8e7eb146319af3586ea49bde"} Jul 02 19:01:15.900087 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:15.900068 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" event={"ID":"4d2096bb-8e60-4801-badc-eb044d92de9c","Type":"ContainerStarted","Data":"c19cfd608f78d6edb70d937d204fc7131b2e4498172a7fcf51f78049bbbd1e97"} Jul 02 19:01:15.901598 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:15.901574 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6zv56" event={"ID":"92ce22b9-a9ce-4f08-b4d1-b770c2e317ae","Type":"ContainerStarted","Data":"7bc55ac508d5874ef60610283e5f9f6c43904e09d80271ba06c9d03a2973171f"} Jul 02 19:01:15.902750 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:15.902727 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cf5gs" event={"ID":"d5d80831-45a4-4697-8170-22216f0f591e","Type":"ContainerStarted","Data":"08324c4310d3270c187556ecc7d3f99ae3ceab13669e4cf5aa6a81ab0afbf438"} Jul 02 19:01:15.903839 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:15.903816 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n79rs" event={"ID":"eed6dcf6-1438-4b95-a1e1-410eff54e692","Type":"ContainerStarted","Data":"5d306f312d18c2b4408cd90f665345fc1ddfb91b1aec324f36b894091dd257aa"} Jul 02 19:01:16.357604 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:16.357494 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs\") pod \"network-metrics-daemon-2lpws\" (UID: \"7d6e7a30-d495-4e43-bba9-c9fda98277d9\") " pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:16.357780 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:16.357689 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:01:16.357780 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:16.357759 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs podName:7d6e7a30-d495-4e43-bba9-c9fda98277d9 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:18.357739941 +0000 UTC m=+6.019709074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs") pod "network-metrics-daemon-2lpws" (UID: "7d6e7a30-d495-4e43-bba9-c9fda98277d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:01:16.458428 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:16.458332 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92b042c6-6b86-452c-8f9f-2341729e81c5-original-pull-secret\") pod \"global-pull-secret-syncer-z4j2p\" (UID: \"92b042c6-6b86-452c-8f9f-2341729e81c5\") " pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:16.458594 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:16.458450 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5q4m\" (UniqueName: \"kubernetes.io/projected/5c664d91-c6bf-47e2-9ab0-4d3bfab4964c-kube-api-access-w5q4m\") pod \"network-check-target-b4fq5\" (UID: \"5c664d91-c6bf-47e2-9ab0-4d3bfab4964c\") " pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:01:16.458662 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:16.458596 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:01:16.458662 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:16.458616 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:01:16.458662 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:16.458632 2559 projected.go:196] Error preparing data for projected volume kube-api-access-w5q4m for pod openshift-network-diagnostics/network-check-target-b4fq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:01:16.458822 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:16.458691 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c664d91-c6bf-47e2-9ab0-4d3bfab4964c-kube-api-access-w5q4m podName:5c664d91-c6bf-47e2-9ab0-4d3bfab4964c nodeName:}" failed. No retries permitted until 2026-07-02 19:01:18.45867236 +0000 UTC m=+6.120641493 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-w5q4m" (UniqueName: "kubernetes.io/projected/5c664d91-c6bf-47e2-9ab0-4d3bfab4964c-kube-api-access-w5q4m") pod "network-check-target-b4fq5" (UID: "5c664d91-c6bf-47e2-9ab0-4d3bfab4964c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:01:16.459125 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:16.459100 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:01:16.459230 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:16.459152 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92b042c6-6b86-452c-8f9f-2341729e81c5-original-pull-secret podName:92b042c6-6b86-452c-8f9f-2341729e81c5 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:18.459137117 +0000 UTC m=+6.121106245 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/92b042c6-6b86-452c-8f9f-2341729e81c5-original-pull-secret") pod "global-pull-secret-syncer-z4j2p" (UID: "92b042c6-6b86-452c-8f9f-2341729e81c5") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:01:16.789292 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:16.789159 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 18:56:14 +0000 UTC" deadline="2028-03-20 14:20:03.173965542 +0000 UTC" Jul 02 19:01:16.789292 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:16.789199 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15043h18m46.384772524s" Jul 02 19:01:16.883455 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:16.882602 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:01:16.883455 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:16.882742 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4fq5" podUID="5c664d91-c6bf-47e2-9ab0-4d3bfab4964c" Jul 02 19:01:16.883455 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:16.883139 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:16.883455 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:16.883259 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lpws" podUID="7d6e7a30-d495-4e43-bba9-c9fda98277d9" Jul 02 19:01:16.883455 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:16.883337 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:16.883455 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:16.883410 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4j2p" podUID="92b042c6-6b86-452c-8f9f-2341729e81c5" Jul 02 19:01:16.917311 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:16.916686 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-197.ec2.internal" event={"ID":"89db45177650e6194fe054377f4724d8","Type":"ContainerStarted","Data":"c9d3846f0bbd1371db7a29b634e3b0bf3808ca12cfde5eac7d41a8163ff4ed37"} Jul 02 19:01:18.377446 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:18.377412 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs\") pod \"network-metrics-daemon-2lpws\" (UID: \"7d6e7a30-d495-4e43-bba9-c9fda98277d9\") " pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:18.377915 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:18.377563 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:01:18.377915 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:18.377630 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs podName:7d6e7a30-d495-4e43-bba9-c9fda98277d9 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:22.377609813 +0000 UTC m=+10.039578946 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs") pod "network-metrics-daemon-2lpws" (UID: "7d6e7a30-d495-4e43-bba9-c9fda98277d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:01:18.477832 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:18.477777 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92b042c6-6b86-452c-8f9f-2341729e81c5-original-pull-secret\") pod \"global-pull-secret-syncer-z4j2p\" (UID: \"92b042c6-6b86-452c-8f9f-2341729e81c5\") " pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:18.477832 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:18.477827 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5q4m\" (UniqueName: \"kubernetes.io/projected/5c664d91-c6bf-47e2-9ab0-4d3bfab4964c-kube-api-access-w5q4m\") pod \"network-check-target-b4fq5\" (UID: \"5c664d91-c6bf-47e2-9ab0-4d3bfab4964c\") " pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:01:18.478078 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:18.478016 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:01:18.478078 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:18.478037 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:01:18.478078 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:18.478051 2559 projected.go:196] Error preparing data for projected volume kube-api-access-w5q4m for pod openshift-network-diagnostics/network-check-target-b4fq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:01:18.478223 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:18.478109 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c664d91-c6bf-47e2-9ab0-4d3bfab4964c-kube-api-access-w5q4m podName:5c664d91-c6bf-47e2-9ab0-4d3bfab4964c nodeName:}" failed. No retries permitted until 2026-07-02 19:01:22.478091755 +0000 UTC m=+10.140060907 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-w5q4m" (UniqueName: "kubernetes.io/projected/5c664d91-c6bf-47e2-9ab0-4d3bfab4964c-kube-api-access-w5q4m") pod "network-check-target-b4fq5" (UID: "5c664d91-c6bf-47e2-9ab0-4d3bfab4964c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:01:18.478533 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:18.478514 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:01:18.478604 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:18.478574 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92b042c6-6b86-452c-8f9f-2341729e81c5-original-pull-secret podName:92b042c6-6b86-452c-8f9f-2341729e81c5 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:22.47855703 +0000 UTC m=+10.140526162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/92b042c6-6b86-452c-8f9f-2341729e81c5-original-pull-secret") pod "global-pull-secret-syncer-z4j2p" (UID: "92b042c6-6b86-452c-8f9f-2341729e81c5") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:01:18.881261 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:18.881231 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:18.881450 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:18.881377 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lpws" podUID="7d6e7a30-d495-4e43-bba9-c9fda98277d9" Jul 02 19:01:18.881765 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:18.881745 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:18.881885 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:18.881842 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4j2p" podUID="92b042c6-6b86-452c-8f9f-2341729e81c5" Jul 02 19:01:18.882890 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:18.882721 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:01:18.882890 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:18.882832 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4fq5" podUID="5c664d91-c6bf-47e2-9ab0-4d3bfab4964c" Jul 02 19:01:20.880880 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:20.880833 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:20.881308 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:20.880833 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:20.881308 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:20.880980 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lpws" podUID="7d6e7a30-d495-4e43-bba9-c9fda98277d9" Jul 02 19:01:20.881308 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:20.881071 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4j2p" podUID="92b042c6-6b86-452c-8f9f-2341729e81c5" Jul 02 19:01:20.881308 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:20.880833 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:01:20.881308 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:20.881161 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4fq5" podUID="5c664d91-c6bf-47e2-9ab0-4d3bfab4964c" Jul 02 19:01:22.410150 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:22.410110 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs\") pod \"network-metrics-daemon-2lpws\" (UID: \"7d6e7a30-d495-4e43-bba9-c9fda98277d9\") " pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:22.410593 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:22.410295 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:01:22.410593 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:22.410368 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs podName:7d6e7a30-d495-4e43-bba9-c9fda98277d9 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:30.410348539 +0000 UTC m=+18.072317681 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs") pod "network-metrics-daemon-2lpws" (UID: "7d6e7a30-d495-4e43-bba9-c9fda98277d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:01:22.511484 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:22.511441 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92b042c6-6b86-452c-8f9f-2341729e81c5-original-pull-secret\") pod \"global-pull-secret-syncer-z4j2p\" (UID: \"92b042c6-6b86-452c-8f9f-2341729e81c5\") " pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:22.511660 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:22.511494 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5q4m\" (UniqueName: \"kubernetes.io/projected/5c664d91-c6bf-47e2-9ab0-4d3bfab4964c-kube-api-access-w5q4m\") pod \"network-check-target-b4fq5\" (UID: \"5c664d91-c6bf-47e2-9ab0-4d3bfab4964c\") " pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:01:22.511740 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:22.511684 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:01:22.511740 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:22.511706 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:01:22.511740 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:22.511720 2559 projected.go:196] Error preparing data for projected volume kube-api-access-w5q4m for pod openshift-network-diagnostics/network-check-target-b4fq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:01:22.511889 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:22.511785 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c664d91-c6bf-47e2-9ab0-4d3bfab4964c-kube-api-access-w5q4m podName:5c664d91-c6bf-47e2-9ab0-4d3bfab4964c nodeName:}" failed. No retries permitted until 2026-07-02 19:01:30.511764054 +0000 UTC m=+18.173733205 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-w5q4m" (UniqueName: "kubernetes.io/projected/5c664d91-c6bf-47e2-9ab0-4d3bfab4964c-kube-api-access-w5q4m") pod "network-check-target-b4fq5" (UID: "5c664d91-c6bf-47e2-9ab0-4d3bfab4964c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:01:22.512098 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:22.512066 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:01:22.512249 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:22.512141 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92b042c6-6b86-452c-8f9f-2341729e81c5-original-pull-secret podName:92b042c6-6b86-452c-8f9f-2341729e81c5 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:30.512121497 +0000 UTC m=+18.174090630 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/92b042c6-6b86-452c-8f9f-2341729e81c5-original-pull-secret") pod "global-pull-secret-syncer-z4j2p" (UID: "92b042c6-6b86-452c-8f9f-2341729e81c5") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:01:22.881956 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:22.881926 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:01:22.882227 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:22.882031 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4fq5" podUID="5c664d91-c6bf-47e2-9ab0-4d3bfab4964c" Jul 02 19:01:22.882454 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:22.882367 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:22.882561 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:22.882503 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:22.882614 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:22.882587 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4j2p" podUID="92b042c6-6b86-452c-8f9f-2341729e81c5" Jul 02 19:01:22.882665 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:22.882630 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lpws" podUID="7d6e7a30-d495-4e43-bba9-c9fda98277d9" Jul 02 19:01:24.880889 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:24.880580 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:24.880889 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:24.880580 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:24.880889 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:24.880762 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:01:24.880889 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:24.880754 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lpws" podUID="7d6e7a30-d495-4e43-bba9-c9fda98277d9" Jul 02 19:01:24.880889 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:24.880889 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4j2p" podUID="92b042c6-6b86-452c-8f9f-2341729e81c5" Jul 02 19:01:24.881528 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:24.880961 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4fq5" podUID="5c664d91-c6bf-47e2-9ab0-4d3bfab4964c" Jul 02 19:01:26.881121 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:26.881089 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:26.881121 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:26.881107 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:26.881121 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:26.881108 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:01:26.881725 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:26.881222 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4j2p" podUID="92b042c6-6b86-452c-8f9f-2341729e81c5" Jul 02 19:01:26.881725 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:26.881311 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4fq5" podUID="5c664d91-c6bf-47e2-9ab0-4d3bfab4964c" Jul 02 19:01:26.881725 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:26.881400 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lpws" podUID="7d6e7a30-d495-4e43-bba9-c9fda98277d9" Jul 02 19:01:28.880426 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:28.880392 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:28.880914 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:28.880393 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:28.880914 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:28.880513 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lpws" podUID="7d6e7a30-d495-4e43-bba9-c9fda98277d9" Jul 02 19:01:28.880914 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:28.880393 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:01:28.880914 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:28.880603 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4j2p" podUID="92b042c6-6b86-452c-8f9f-2341729e81c5" Jul 02 19:01:28.880914 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:28.880668 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4fq5" podUID="5c664d91-c6bf-47e2-9ab0-4d3bfab4964c" Jul 02 19:01:30.469872 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:30.469829 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs\") pod \"network-metrics-daemon-2lpws\" (UID: \"7d6e7a30-d495-4e43-bba9-c9fda98277d9\") " pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:30.470341 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:30.469951 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:01:30.470341 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:30.470022 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs podName:7d6e7a30-d495-4e43-bba9-c9fda98277d9 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:46.470002644 +0000 UTC m=+34.131971775 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs") pod "network-metrics-daemon-2lpws" (UID: "7d6e7a30-d495-4e43-bba9-c9fda98277d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:01:30.570752 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:30.570709 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92b042c6-6b86-452c-8f9f-2341729e81c5-original-pull-secret\") pod \"global-pull-secret-syncer-z4j2p\" (UID: \"92b042c6-6b86-452c-8f9f-2341729e81c5\") " pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:30.570752 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:30.570752 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5q4m\" (UniqueName: \"kubernetes.io/projected/5c664d91-c6bf-47e2-9ab0-4d3bfab4964c-kube-api-access-w5q4m\") pod \"network-check-target-b4fq5\" (UID: \"5c664d91-c6bf-47e2-9ab0-4d3bfab4964c\") " pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:01:30.570998 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:30.570896 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:01:30.570998 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:30.570911 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:01:30.570998 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:30.570925 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:01:30.570998 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:30.570936 2559 projected.go:196] Error preparing data for projected volume kube-api-access-w5q4m for pod openshift-network-diagnostics/network-check-target-b4fq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:01:30.570998 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:30.570966 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92b042c6-6b86-452c-8f9f-2341729e81c5-original-pull-secret podName:92b042c6-6b86-452c-8f9f-2341729e81c5 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:46.570944649 +0000 UTC m=+34.232913800 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/92b042c6-6b86-452c-8f9f-2341729e81c5-original-pull-secret") pod "global-pull-secret-syncer-z4j2p" (UID: "92b042c6-6b86-452c-8f9f-2341729e81c5") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:01:30.570998 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:30.570983 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c664d91-c6bf-47e2-9ab0-4d3bfab4964c-kube-api-access-w5q4m podName:5c664d91-c6bf-47e2-9ab0-4d3bfab4964c nodeName:}" failed. No retries permitted until 2026-07-02 19:01:46.570973824 +0000 UTC m=+34.232942953 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-w5q4m" (UniqueName: "kubernetes.io/projected/5c664d91-c6bf-47e2-9ab0-4d3bfab4964c-kube-api-access-w5q4m") pod "network-check-target-b4fq5" (UID: "5c664d91-c6bf-47e2-9ab0-4d3bfab4964c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:01:30.881095 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:30.881061 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:30.881274 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:30.881061 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:01:30.881274 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:30.881221 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lpws" podUID="7d6e7a30-d495-4e43-bba9-c9fda98277d9" Jul 02 19:01:30.881274 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:30.881061 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:30.881413 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:30.881281 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4fq5" podUID="5c664d91-c6bf-47e2-9ab0-4d3bfab4964c" Jul 02 19:01:30.881413 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:30.881358 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4j2p" podUID="92b042c6-6b86-452c-8f9f-2341729e81c5" Jul 02 19:01:32.881669 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:32.881629 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:32.882153 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:32.881721 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:01:32.882153 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:32.881762 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:32.882153 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:32.881780 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4j2p" podUID="92b042c6-6b86-452c-8f9f-2341729e81c5" Jul 02 19:01:32.882153 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:32.881864 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lpws" podUID="7d6e7a30-d495-4e43-bba9-c9fda98277d9" Jul 02 19:01:32.882153 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:32.881969 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4fq5" podUID="5c664d91-c6bf-47e2-9ab0-4d3bfab4964c" Jul 02 19:01:34.880733 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:34.880614 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:01:34.881249 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:34.880617 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:34.881249 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:34.880805 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4fq5" podUID="5c664d91-c6bf-47e2-9ab0-4d3bfab4964c" Jul 02 19:01:34.881249 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:34.880905 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lpws" podUID="7d6e7a30-d495-4e43-bba9-c9fda98277d9" Jul 02 19:01:34.881249 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:34.880669 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:34.881249 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:34.880985 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4j2p" podUID="92b042c6-6b86-452c-8f9f-2341729e81c5" Jul 02 19:01:34.958958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:34.958935 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" event={"ID":"4d2096bb-8e60-4801-badc-eb044d92de9c","Type":"ContainerStarted","Data":"7dac2e52a682c33c6b0e131d3a4a8491aeb246c1dd362c62dc41db1492f170f6"} Jul 02 19:01:34.960242 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:34.960221 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6zv56" event={"ID":"92ce22b9-a9ce-4f08-b4d1-b770c2e317ae","Type":"ContainerStarted","Data":"5aeb11975d5fcf159f01e24002a0f58d6e9baf5f18f26414ed59943bd5a2e254"} Jul 02 19:01:34.961644 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:34.961622 2559 generic.go:356] "Generic (PLEG): container finished" podID="eed6dcf6-1438-4b95-a1e1-410eff54e692" containerID="99fd25d3fb19a4a0d05673b4653f75a91646c91262c400c959b28c4a4dd90dff" exitCode=0 Jul 02 19:01:34.961728 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:34.961651 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n79rs" event={"ID":"eed6dcf6-1438-4b95-a1e1-410eff54e692","Type":"ContainerDied","Data":"99fd25d3fb19a4a0d05673b4653f75a91646c91262c400c959b28c4a4dd90dff"} Jul 02 19:01:34.963205 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:34.963188 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-197.ec2.internal" event={"ID":"05cb7619a8b4cf72df33e4bbdca9093f","Type":"ContainerStarted","Data":"407b9af3703b9852af6c6cc084c6fa684030313fab57e4d7dd25d6c575018d3f"} Jul 02 19:01:34.964539 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:34.964518 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z7cr2" event={"ID":"119124a9-adad-4612-a91c-34750c3e9c51","Type":"ContainerStarted","Data":"9e4db5d8651b52b30d2811b671020277913e2e9e394e71d87db8c5053809a803"} Jul 02 19:01:34.965938 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:34.965920 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dk7fw" event={"ID":"4660d4a5-2ff9-49c1-948d-22fb52579391","Type":"ContainerStarted","Data":"29c9caa8e4105f9176a6da8f6e9164e05e3373a9285253166b39577bacc2a2b1"} Jul 02 19:01:34.967277 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:34.967198 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wwdxl" event={"ID":"ef58dd71-af47-44a1-8c47-d4e98378651d","Type":"ContainerStarted","Data":"aae5048f56925d5734cd38b4131f52ec3e1539262f37bcb6ab8c7ff277431875"} Jul 02 19:01:34.968529 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:34.968512 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w" event={"ID":"1acbb3a6-a477-4838-a28b-4208436cf0e0","Type":"ContainerStarted","Data":"650159632d515dfd72e8ad9e09ccb91151faf0e33edd7672e63ec4fc7bc7900a"} Jul 02 19:01:34.970196 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:34.970179 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gf2s_a95b977b-6b92-411f-a185-ecc012668bff/ovn-acl-logging/0.log" Jul 02 19:01:34.970506 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:34.970489 2559 generic.go:356] "Generic (PLEG): container finished" podID="a95b977b-6b92-411f-a185-ecc012668bff" containerID="07c2f4d217db122b40474ea845cbf8565497108b836131ceb0a5d2057cc5e030" exitCode=1 Jul 02 19:01:34.970576 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:34.970515 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" event={"ID":"a95b977b-6b92-411f-a185-ecc012668bff","Type":"ContainerStarted","Data":"c94e5ef24158ca39ccd549206a3dc26ccd13b31639f589d70e7ec3f802037def"} Jul 02 19:01:34.970576 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:34.970559 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" event={"ID":"a95b977b-6b92-411f-a185-ecc012668bff","Type":"ContainerDied","Data":"07c2f4d217db122b40474ea845cbf8565497108b836131ceb0a5d2057cc5e030"} Jul 02 19:01:34.970641 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:34.970589 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" event={"ID":"a95b977b-6b92-411f-a185-ecc012668bff","Type":"ContainerStarted","Data":"747e4bdf395d0b6a5539ff40cf9b1f9c79aade13aa811b5e6dab9a74480b584a"} Jul 02 19:01:34.974156 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:34.974120 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-197.ec2.internal" podStartSLOduration=20.974109172 podStartE2EDuration="20.974109172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:16.934991378 +0000 UTC m=+4.596960529" watchObservedRunningTime="2026-07-02 19:01:34.974109172 +0000 UTC m=+22.636078321" Jul 02 19:01:34.991251 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:34.991215 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-q9qdf" podStartSLOduration=2.906095478 podStartE2EDuration="21.991202895s" totalImagesPullingTime="19.085107417s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:34.974325941 +0000 UTC m=+22.636295091" watchObservedRunningTime="2026-07-02 19:01:34.991202895 +0000 UTC m=+22.653172053" Jul 02 19:01:34.991504 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:34.991478 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wwdxl" podStartSLOduration=2.903042438 podStartE2EDuration="21.991471931s" totalImagesPullingTime="19.088429493s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:34.991175309 +0000 UTC m=+22.653144470" watchObservedRunningTime="2026-07-02 19:01:34.991471931 +0000 UTC m=+22.653441081" Jul 02 19:01:35.035825 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:35.035788 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-z7cr2" podStartSLOduration=3.917793242 podStartE2EDuration="23.035773953s" totalImagesPullingTime="19.117980711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:35.035524228 +0000 UTC m=+22.697493378" watchObservedRunningTime="2026-07-02 19:01:35.035773953 +0000 UTC m=+22.697743102" Jul 02 19:01:35.048074 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:35.048040 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dk7fw" podStartSLOduration=7.471673461 podStartE2EDuration="22.048023936s" totalImagesPullingTime="14.576350475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:35.047932274 +0000 UTC m=+22.709901424" watchObservedRunningTime="2026-07-02 19:01:35.048023936 +0000 UTC m=+22.709993085" Jul 02 19:01:35.074514 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:35.074472 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6zv56" podStartSLOduration=7.499256109 podStartE2EDuration="22.074460086s" totalImagesPullingTime="14.575203977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:35.061140716 +0000 UTC m=+22.723109866" watchObservedRunningTime="2026-07-02 19:01:35.074460086 +0000 UTC m=+22.736429236" Jul 02 19:01:35.074600 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:35.074544 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-197.ec2.internal" podStartSLOduration=21.07454011 podStartE2EDuration="21.07454011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:35.074048059 +0000 UTC m=+22.736017213" watchObservedRunningTime="2026-07-02 19:01:35.07454011 +0000 UTC m=+22.736509269" Jul 02 19:01:35.930638 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:35.930604 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6zv56" Jul 02 19:01:35.931353 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:35.931334 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6zv56" Jul 02 19:01:35.973412 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:35.973387 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cf5gs" event={"ID":"d5d80831-45a4-4697-8170-22216f0f591e","Type":"ContainerStarted","Data":"201355d6903023f0e6336b0874446356c1e7361ab9e2d7ac2b41fc836e9fc351"} Jul 02 19:01:35.976026 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:35.976007 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gf2s_a95b977b-6b92-411f-a185-ecc012668bff/ovn-acl-logging/0.log" Jul 02 19:01:35.976461 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:35.976436 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" event={"ID":"a95b977b-6b92-411f-a185-ecc012668bff","Type":"ContainerStarted","Data":"2a59e09e003800bb4197c1d351cac211f7cf175c7370e1ff3a923a5e46e0c2de"} Jul 02 19:01:35.976562 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:35.976494 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" event={"ID":"a95b977b-6b92-411f-a185-ecc012668bff","Type":"ContainerStarted","Data":"fd257e131e85b04f7fe9dff55d6d7feea913ce75b64ea7e59f513dedda8c4562"} Jul 02 19:01:35.976562 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:35.976531 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" event={"ID":"a95b977b-6b92-411f-a185-ecc012668bff","Type":"ContainerStarted","Data":"4d0613c1217131af1c8561df3576a97d8cc89a6018ced4d682310a342fe4c2c3"} Jul 02 19:01:35.977144 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:35.977127 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6zv56" Jul 02 19:01:35.977233 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:35.977172 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6zv56" Jul 02 19:01:35.986150 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:35.986114 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cf5gs" podStartSLOduration=4.868467517 podStartE2EDuration="23.98610333s" totalImagesPullingTime="19.117635813s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:35.985881647 +0000 UTC m=+23.647850793" watchObservedRunningTime="2026-07-02 19:01:35.98610333 +0000 UTC m=+23.648072479" Jul 02 19:01:36.880910 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:36.880877 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:36.881269 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:36.880929 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:01:36.881269 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:36.880876 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:36.881269 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:36.881018 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4j2p" podUID="92b042c6-6b86-452c-8f9f-2341729e81c5" Jul 02 19:01:36.881269 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:36.881162 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lpws" podUID="7d6e7a30-d495-4e43-bba9-c9fda98277d9" Jul 02 19:01:36.881269 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:36.881221 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4fq5" podUID="5c664d91-c6bf-47e2-9ab0-4d3bfab4964c" Jul 02 19:01:37.769089 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:37.768943 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 19:01:37.800823 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:37.800721 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T19:01:37.7690861Z","UUID":"174a9720-a467-497d-8493-49f76dc038c7","Handler":null,"Name":"","Endpoint":""} Jul 02 19:01:37.802286 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:37.802267 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 19:01:37.802388 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:37.802308 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 19:01:37.982654 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:37.982573 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w" event={"ID":"1acbb3a6-a477-4838-a28b-4208436cf0e0","Type":"ContainerStarted","Data":"a0bf89f52cfea296106692cd737fe60b70e08d3add51ed84c6c457bf36fc27dc"} Jul 02 19:01:37.986024 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:37.985997 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gf2s_a95b977b-6b92-411f-a185-ecc012668bff/ovn-acl-logging/0.log" Jul 02 19:01:37.986481 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:37.986455 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" event={"ID":"a95b977b-6b92-411f-a185-ecc012668bff","Type":"ContainerStarted","Data":"499587a5c2e89b270cf3072a5c86f402ba4c829bda684d7e11e6045686a82f3e"} Jul 02 19:01:38.881020 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:38.880983 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:38.881476 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:38.880983 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:38.881476 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:38.881115 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4j2p" podUID="92b042c6-6b86-452c-8f9f-2341729e81c5" Jul 02 19:01:38.881476 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:38.881174 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:01:38.881476 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:38.881271 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lpws" podUID="7d6e7a30-d495-4e43-bba9-c9fda98277d9" Jul 02 19:01:38.881476 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:38.881346 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4fq5" podUID="5c664d91-c6bf-47e2-9ab0-4d3bfab4964c" Jul 02 19:01:39.994582 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:39.994165 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w" event={"ID":"1acbb3a6-a477-4838-a28b-4208436cf0e0","Type":"ContainerStarted","Data":"6bc7b5c4e64e422d97ded62dda53d0b9c9a5ce03d0104753405ddfffe66de10e"} Jul 02 19:01:39.998051 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:39.998028 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gf2s_a95b977b-6b92-411f-a185-ecc012668bff/ovn-acl-logging/0.log" Jul 02 19:01:39.998461 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:39.998440 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" event={"ID":"a95b977b-6b92-411f-a185-ecc012668bff","Type":"ContainerStarted","Data":"e3dc03aacc19186b14ab786e7549cb242db0690b8375f2f98bab307c089efae6"} Jul 02 19:01:39.998747 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:39.998728 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:39.998873 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:39.998801 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:39.998998 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:39.998978 2559 scope.go:117] "RemoveContainer" containerID="07c2f4d217db122b40474ea845cbf8565497108b836131ceb0a5d2057cc5e030" Jul 02 19:01:40.018453 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:40.018429 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:40.041309 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:40.038207 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbt6w" podStartSLOduration=3.538755481 podStartE2EDuration="27.038149588s" totalImagesPullingTime="23.499394107s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:40.012390484 +0000 UTC m=+27.674359635" watchObservedRunningTime="2026-07-02 19:01:40.038149588 +0000 UTC m=+27.700118734" Jul 02 19:01:40.880285 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:40.880245 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:40.880452 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:40.880377 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lpws" podUID="7d6e7a30-d495-4e43-bba9-c9fda98277d9" Jul 02 19:01:40.880452 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:40.880245 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:01:40.880572 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:40.880484 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4fq5" podUID="5c664d91-c6bf-47e2-9ab0-4d3bfab4964c" Jul 02 19:01:40.880572 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:40.880539 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:40.880727 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:40.880605 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4j2p" podUID="92b042c6-6b86-452c-8f9f-2341729e81c5" Jul 02 19:01:41.005706 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:41.005675 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gf2s_a95b977b-6b92-411f-a185-ecc012668bff/ovn-acl-logging/0.log" Jul 02 19:01:41.006313 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:41.006202 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" event={"ID":"a95b977b-6b92-411f-a185-ecc012668bff","Type":"ContainerStarted","Data":"b99e3dd379b719fbdf15670552225289903e40a563ff1de4c9423ea98d59afd6"} Jul 02 19:01:41.007027 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:41.006532 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:41.024167 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:41.024138 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:01:41.036090 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:41.036033 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" podStartSLOduration=8.838962029 podStartE2EDuration="28.036017633s" totalImagesPullingTime="19.197055604s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:41.035545563 +0000 UTC m=+28.697514714" watchObservedRunningTime="2026-07-02 19:01:41.036017633 +0000 UTC m=+28.697986783" Jul 02 19:01:41.853685 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:41.853656 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b4fq5"] Jul 02 19:01:41.853841 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:41.853766 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:01:41.853942 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:41.853888 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4fq5" podUID="5c664d91-c6bf-47e2-9ab0-4d3bfab4964c" Jul 02 19:01:41.857706 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:41.857670 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2lpws"] Jul 02 19:01:41.857876 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:41.857815 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:41.857960 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:41.857938 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lpws" podUID="7d6e7a30-d495-4e43-bba9-c9fda98277d9" Jul 02 19:01:41.858266 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:41.858248 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z4j2p"] Jul 02 19:01:41.858341 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:41.858328 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:41.858447 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:41.858424 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4j2p" podUID="92b042c6-6b86-452c-8f9f-2341729e81c5" Jul 02 19:01:43.014005 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:43.013965 2559 generic.go:356] "Generic (PLEG): container finished" podID="eed6dcf6-1438-4b95-a1e1-410eff54e692" containerID="293e0edb7e6d7ddf7aa4f7d6bb2af151cdbf972cc54ecae9ffaeb0cff6ffa291" exitCode=0 Jul 02 19:01:43.014369 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:43.014044 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n79rs" event={"ID":"eed6dcf6-1438-4b95-a1e1-410eff54e692","Type":"ContainerDied","Data":"293e0edb7e6d7ddf7aa4f7d6bb2af151cdbf972cc54ecae9ffaeb0cff6ffa291"} Jul 02 19:01:43.880525 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:43.880495 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:43.880525 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:43.880514 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:01:43.880711 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:43.880615 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:43.880711 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:43.880643 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4j2p" podUID="92b042c6-6b86-452c-8f9f-2341729e81c5" Jul 02 19:01:43.880814 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:43.880710 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lpws" podUID="7d6e7a30-d495-4e43-bba9-c9fda98277d9" Jul 02 19:01:43.880814 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:43.880773 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4fq5" podUID="5c664d91-c6bf-47e2-9ab0-4d3bfab4964c" Jul 02 19:01:45.020117 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:45.019932 2559 generic.go:356] "Generic (PLEG): container finished" podID="eed6dcf6-1438-4b95-a1e1-410eff54e692" containerID="aa90bdcf062d0ab1f1d3a6dce68f33dda37255540effe5d77d631d6fd2723f2d" exitCode=0 Jul 02 19:01:45.020612 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:45.020009 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n79rs" event={"ID":"eed6dcf6-1438-4b95-a1e1-410eff54e692","Type":"ContainerDied","Data":"aa90bdcf062d0ab1f1d3a6dce68f33dda37255540effe5d77d631d6fd2723f2d"} Jul 02 19:01:45.880867 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:45.880826 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:45.881014 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:45.880826 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:45.881014 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:45.880953 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lpws" podUID="7d6e7a30-d495-4e43-bba9-c9fda98277d9" Jul 02 19:01:45.881014 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:45.880826 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:01:45.881124 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:45.881016 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4j2p" podUID="92b042c6-6b86-452c-8f9f-2341729e81c5" Jul 02 19:01:45.881124 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:45.881071 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4fq5" podUID="5c664d91-c6bf-47e2-9ab0-4d3bfab4964c" Jul 02 19:01:46.026184 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:46.026156 2559 generic.go:356] "Generic (PLEG): container finished" podID="eed6dcf6-1438-4b95-a1e1-410eff54e692" containerID="bcda2f88e772617cf3f7f6b44fdfa0dbdf8a3b7a273a59f47c0e557da612201c" exitCode=0 Jul 02 19:01:46.026529 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:46.026220 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n79rs" event={"ID":"eed6dcf6-1438-4b95-a1e1-410eff54e692","Type":"ContainerDied","Data":"bcda2f88e772617cf3f7f6b44fdfa0dbdf8a3b7a273a59f47c0e557da612201c"} Jul 02 19:01:46.488816 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:46.488778 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs\") pod \"network-metrics-daemon-2lpws\" (UID: \"7d6e7a30-d495-4e43-bba9-c9fda98277d9\") " pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:46.488983 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:46.488944 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:01:46.489018 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:46.489003 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs podName:7d6e7a30-d495-4e43-bba9-c9fda98277d9 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:18.488988758 +0000 UTC m=+66.150957886 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs") pod "network-metrics-daemon-2lpws" (UID: "7d6e7a30-d495-4e43-bba9-c9fda98277d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:01:46.589916 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:46.589884 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92b042c6-6b86-452c-8f9f-2341729e81c5-original-pull-secret\") pod \"global-pull-secret-syncer-z4j2p\" (UID: \"92b042c6-6b86-452c-8f9f-2341729e81c5\") " pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:46.589916 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:46.589921 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5q4m\" (UniqueName: \"kubernetes.io/projected/5c664d91-c6bf-47e2-9ab0-4d3bfab4964c-kube-api-access-w5q4m\") pod \"network-check-target-b4fq5\" (UID: \"5c664d91-c6bf-47e2-9ab0-4d3bfab4964c\") " pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:01:46.590112 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:46.590038 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:01:46.590112 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:46.590039 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:01:46.590112 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:46.590054 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:01:46.590112 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:46.590064 2559 projected.go:196] Error preparing data for projected volume kube-api-access-w5q4m for pod openshift-network-diagnostics/network-check-target-b4fq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:01:46.590112 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:46.590114 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92b042c6-6b86-452c-8f9f-2341729e81c5-original-pull-secret podName:92b042c6-6b86-452c-8f9f-2341729e81c5 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:18.590093964 +0000 UTC m=+66.252063112 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/92b042c6-6b86-452c-8f9f-2341729e81c5-original-pull-secret") pod "global-pull-secret-syncer-z4j2p" (UID: "92b042c6-6b86-452c-8f9f-2341729e81c5") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:01:46.590314 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:46.590135 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c664d91-c6bf-47e2-9ab0-4d3bfab4964c-kube-api-access-w5q4m podName:5c664d91-c6bf-47e2-9ab0-4d3bfab4964c nodeName:}" failed. No retries permitted until 2026-07-02 19:02:18.590125622 +0000 UTC m=+66.252094750 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-w5q4m" (UniqueName: "kubernetes.io/projected/5c664d91-c6bf-47e2-9ab0-4d3bfab4964c-kube-api-access-w5q4m") pod "network-check-target-b4fq5" (UID: "5c664d91-c6bf-47e2-9ab0-4d3bfab4964c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:01:47.880509 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:47.880477 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:01:47.880509 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:47.880506 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:47.881062 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:47.880477 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:47.881062 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:47.880583 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4fq5" podUID="5c664d91-c6bf-47e2-9ab0-4d3bfab4964c" Jul 02 19:01:47.881062 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:47.880640 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4j2p" podUID="92b042c6-6b86-452c-8f9f-2341729e81c5" Jul 02 19:01:47.881062 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:47.880718 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lpws" podUID="7d6e7a30-d495-4e43-bba9-c9fda98277d9" Jul 02 19:01:48.076827 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.076795 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-197.ec2.internal" event="NodeReady" Jul 02 19:01:48.077018 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.076980 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 19:01:48.112097 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.112065 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-5vxtw"] Jul 02 19:01:48.122267 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.122246 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-588b585fb5-84q6s"] Jul 02 19:01:48.122379 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.122364 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5vxtw" Jul 02 19:01:48.124649 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.124626 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 02 19:01:48.124761 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.124695 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-v27zv\"" Jul 02 19:01:48.125105 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.125091 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 02 19:01:48.129572 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.129553 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-5vxtw"] Jul 02 19:01:48.129665 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.129649 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:01:48.132074 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.132017 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5gfh8"] Jul 02 19:01:48.132498 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.132443 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 19:01:48.132571 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.132508 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lsvnr\"" Jul 02 19:01:48.132571 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.132552 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 19:01:48.132678 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.132614 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 19:01:48.137728 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.137709 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-p49mf"] Jul 02 19:01:48.137821 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.137807 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5gfh8" Jul 02 19:01:48.140362 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.140338 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 19:01:48.141445 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.141352 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ntzvv\"" Jul 02 19:01:48.141530 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.141455 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 19:01:48.141581 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.141527 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 19:01:48.141581 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.141526 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 19:01:48.143307 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.143289 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p49mf" Jul 02 19:01:48.145989 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.145930 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 19:01:48.146083 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.145958 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 19:01:48.146483 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.146333 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k2dxc\"" Jul 02 19:01:48.147172 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.147150 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-588b585fb5-84q6s"] Jul 02 19:01:48.150006 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.149989 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5gfh8"] Jul 02 19:01:48.156691 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.156670 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p49mf"] Jul 02 19:01:48.202840 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.202807 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5vxtw\" (UID: \"f062450f-7c16-491d-84f1-445c4b169765\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5vxtw" Jul 02 19:01:48.202840 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.202841 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f062450f-7c16-491d-84f1-445c4b169765-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-5vxtw\" (UID: \"f062450f-7c16-491d-84f1-445c4b169765\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5vxtw" Jul 02 19:01:48.303991 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.303947 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5vxtw\" (UID: \"f062450f-7c16-491d-84f1-445c4b169765\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5vxtw" Jul 02 19:01:48.303991 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.303994 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7946e8f8-ff35-48d0-bb0a-47711451cb36-installation-pull-secrets\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:01:48.304229 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.304013 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls\") pod \"dns-default-p49mf\" (UID: \"70a52588-f819-40d5-9001-04b49d26d494\") " pod="openshift-dns/dns-default-p49mf" Jul 02 19:01:48.304229 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.304066 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f062450f-7c16-491d-84f1-445c4b169765-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-5vxtw\" (UID: \"f062450f-7c16-491d-84f1-445c4b169765\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5vxtw" Jul 02 19:01:48.304229 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.304089 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-bound-sa-token\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:01:48.304229 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.304105 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70a52588-f819-40d5-9001-04b49d26d494-tmp-dir\") pod \"dns-default-p49mf\" (UID: \"70a52588-f819-40d5-9001-04b49d26d494\") " pod="openshift-dns/dns-default-p49mf" Jul 02 19:01:48.304229 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:48.304105 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:01:48.304229 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.304136 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7946e8f8-ff35-48d0-bb0a-47711451cb36-image-registry-private-configuration\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:01:48.304229 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:48.304168 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert podName:f062450f-7c16-491d-84f1-445c4b169765 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:48.804151534 +0000 UTC m=+36.466120661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5vxtw" (UID: "f062450f-7c16-491d-84f1-445c4b169765") : secret "networking-console-plugin-cert" not found Jul 02 19:01:48.304229 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.304224 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2276j\" (UniqueName: \"kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-kube-api-access-2276j\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:01:48.304615 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.304253 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqtdf\" (UniqueName: \"kubernetes.io/projected/70a52588-f819-40d5-9001-04b49d26d494-kube-api-access-zqtdf\") pod \"dns-default-p49mf\" (UID: \"70a52588-f819-40d5-9001-04b49d26d494\") " pod="openshift-dns/dns-default-p49mf" Jul 02 19:01:48.304615 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.304285 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tspvl\" (UniqueName: \"kubernetes.io/projected/69fee9e5-3794-4491-ad5d-47031dedddd5-kube-api-access-tspvl\") pod \"ingress-canary-5gfh8\" (UID: \"69fee9e5-3794-4491-ad5d-47031dedddd5\") " pod="openshift-ingress-canary/ingress-canary-5gfh8" Jul 02 19:01:48.304615 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.304307 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7946e8f8-ff35-48d0-bb0a-47711451cb36-ca-trust-extracted\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:01:48.304615 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.304343 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69fee9e5-3794-4491-ad5d-47031dedddd5-cert\") pod \"ingress-canary-5gfh8\" (UID: \"69fee9e5-3794-4491-ad5d-47031dedddd5\") " pod="openshift-ingress-canary/ingress-canary-5gfh8" Jul 02 19:01:48.304615 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.304364 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-certificates\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:01:48.304615 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.304426 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:01:48.304615 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.304445 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7946e8f8-ff35-48d0-bb0a-47711451cb36-trusted-ca\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:01:48.304615 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.304464 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/70a52588-f819-40d5-9001-04b49d26d494-config-volume\") pod \"dns-default-p49mf\" (UID: \"70a52588-f819-40d5-9001-04b49d26d494\") " pod="openshift-dns/dns-default-p49mf" Jul 02 19:01:48.304975 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.304895 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f062450f-7c16-491d-84f1-445c4b169765-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-5vxtw\" (UID: \"f062450f-7c16-491d-84f1-445c4b169765\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5vxtw" Jul 02 19:01:48.405027 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.404961 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69fee9e5-3794-4491-ad5d-47031dedddd5-cert\") pod \"ingress-canary-5gfh8\" (UID: \"69fee9e5-3794-4491-ad5d-47031dedddd5\") " pod="openshift-ingress-canary/ingress-canary-5gfh8" Jul 02 19:01:48.405027 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.404993 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-certificates\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:01:48.405186 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.405059 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:01:48.405186 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.405086 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7946e8f8-ff35-48d0-bb0a-47711451cb36-trusted-ca\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:01:48.405186 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:48.405158 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:01:48.405186 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:48.405168 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588b585fb5-84q6s: secret "image-registry-tls" not found Jul 02 19:01:48.405370 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:48.405210 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls podName:7946e8f8-ff35-48d0-bb0a-47711451cb36 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:48.90519591 +0000 UTC m=+36.567165038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls") pod "image-registry-588b585fb5-84q6s" (UID: "7946e8f8-ff35-48d0-bb0a-47711451cb36") : secret "image-registry-tls" not found Jul 02 19:01:48.405370 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.405277 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/70a52588-f819-40d5-9001-04b49d26d494-config-volume\") pod \"dns-default-p49mf\" (UID: \"70a52588-f819-40d5-9001-04b49d26d494\") " pod="openshift-dns/dns-default-p49mf" Jul 02 19:01:48.405370 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.405346 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7946e8f8-ff35-48d0-bb0a-47711451cb36-installation-pull-secrets\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:01:48.405505 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.405373 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls\") pod \"dns-default-p49mf\" (UID: \"70a52588-f819-40d5-9001-04b49d26d494\") " pod="openshift-dns/dns-default-p49mf" Jul 02 19:01:48.405505 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.405408 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-bound-sa-token\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:01:48.405505 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.405431 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70a52588-f819-40d5-9001-04b49d26d494-tmp-dir\") pod \"dns-default-p49mf\" (UID: \"70a52588-f819-40d5-9001-04b49d26d494\") " pod="openshift-dns/dns-default-p49mf" Jul 02 19:01:48.405597 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.405535 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7946e8f8-ff35-48d0-bb0a-47711451cb36-image-registry-private-configuration\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:01:48.405597 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.405575 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2276j\" (UniqueName: \"kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-kube-api-access-2276j\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:01:48.405654 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:48.405607 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:01:48.405682 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:48.405672 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls podName:70a52588-f819-40d5-9001-04b49d26d494 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:48.90565562 +0000 UTC m=+36.567624860 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls") pod "dns-default-p49mf" (UID: "70a52588-f819-40d5-9001-04b49d26d494") : secret "dns-default-metrics-tls" not found Jul 02 19:01:48.405718 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.405608 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqtdf\" (UniqueName: \"kubernetes.io/projected/70a52588-f819-40d5-9001-04b49d26d494-kube-api-access-zqtdf\") pod \"dns-default-p49mf\" (UID: \"70a52588-f819-40d5-9001-04b49d26d494\") " pod="openshift-dns/dns-default-p49mf" Jul 02 19:01:48.405758 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.405729 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tspvl\" (UniqueName: \"kubernetes.io/projected/69fee9e5-3794-4491-ad5d-47031dedddd5-kube-api-access-tspvl\") pod \"ingress-canary-5gfh8\" (UID: \"69fee9e5-3794-4491-ad5d-47031dedddd5\") " pod="openshift-ingress-canary/ingress-canary-5gfh8" Jul 02 19:01:48.405793 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.405756 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7946e8f8-ff35-48d0-bb0a-47711451cb36-ca-trust-extracted\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:01:48.406300 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.406160 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-certificates\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:01:48.406300 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.406182 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7946e8f8-ff35-48d0-bb0a-47711451cb36-ca-trust-extracted\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:01:48.406431 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.406275 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70a52588-f819-40d5-9001-04b49d26d494-tmp-dir\") pod \"dns-default-p49mf\" (UID: \"70a52588-f819-40d5-9001-04b49d26d494\") " pod="openshift-dns/dns-default-p49mf" Jul 02 19:01:48.406431 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.406383 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/70a52588-f819-40d5-9001-04b49d26d494-config-volume\") pod \"dns-default-p49mf\" (UID: \"70a52588-f819-40d5-9001-04b49d26d494\") " pod="openshift-dns/dns-default-p49mf" Jul 02 19:01:48.406656 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.406634 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7946e8f8-ff35-48d0-bb0a-47711451cb36-trusted-ca\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:01:48.409338 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.409305 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7946e8f8-ff35-48d0-bb0a-47711451cb36-image-registry-private-configuration\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:01:48.409338 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.409331 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7946e8f8-ff35-48d0-bb0a-47711451cb36-installation-pull-secrets\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:01:48.409469 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.409313 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69fee9e5-3794-4491-ad5d-47031dedddd5-cert\") pod \"ingress-canary-5gfh8\" (UID: \"69fee9e5-3794-4491-ad5d-47031dedddd5\") " pod="openshift-ingress-canary/ingress-canary-5gfh8" Jul 02 19:01:48.413471 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.413348 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-bound-sa-token\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:01:48.413582 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.413563 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqtdf\" (UniqueName: \"kubernetes.io/projected/70a52588-f819-40d5-9001-04b49d26d494-kube-api-access-zqtdf\") pod \"dns-default-p49mf\" (UID: \"70a52588-f819-40d5-9001-04b49d26d494\") " pod="openshift-dns/dns-default-p49mf" Jul 02 19:01:48.414118 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.414102 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2276j\" (UniqueName: \"kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-kube-api-access-2276j\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:01:48.414589 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.414571 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tspvl\" (UniqueName: \"kubernetes.io/projected/69fee9e5-3794-4491-ad5d-47031dedddd5-kube-api-access-tspvl\") pod \"ingress-canary-5gfh8\" (UID: \"69fee9e5-3794-4491-ad5d-47031dedddd5\") " pod="openshift-ingress-canary/ingress-canary-5gfh8" Jul 02 19:01:48.451785 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.451764 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5gfh8" Jul 02 19:01:48.618995 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.618961 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5gfh8"] Jul 02 19:01:48.623823 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:01:48.623788 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69fee9e5_3794_4491_ad5d_47031dedddd5.slice/crio-91e8f4f43a0c2a80e1dd5c8f5b63ed17e2e273162d3a4a97adc1b9ff49e23732 WatchSource:0}: Error finding container 91e8f4f43a0c2a80e1dd5c8f5b63ed17e2e273162d3a4a97adc1b9ff49e23732: Status 404 returned error can't find the container with id 91e8f4f43a0c2a80e1dd5c8f5b63ed17e2e273162d3a4a97adc1b9ff49e23732 Jul 02 19:01:48.809206 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.809093 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5vxtw\" (UID: \"f062450f-7c16-491d-84f1-445c4b169765\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5vxtw" Jul 02 19:01:48.809388 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:48.809222 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:01:48.809388 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:48.809301 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert podName:f062450f-7c16-491d-84f1-445c4b169765 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:49.809277973 +0000 UTC m=+37.471247119 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5vxtw" (UID: "f062450f-7c16-491d-84f1-445c4b169765") : secret "networking-console-plugin-cert" not found Jul 02 19:01:48.909666 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.909639 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:01:48.910191 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:48.909703 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls\") pod \"dns-default-p49mf\" (UID: \"70a52588-f819-40d5-9001-04b49d26d494\") " pod="openshift-dns/dns-default-p49mf" Jul 02 19:01:48.910191 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:48.909819 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:01:48.910191 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:48.909831 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:01:48.910191 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:48.909841 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588b585fb5-84q6s: secret "image-registry-tls" not found Jul 02 19:01:48.910191 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:48.909903 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls podName:70a52588-f819-40d5-9001-04b49d26d494 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:49.909889901 +0000 UTC m=+37.571859028 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls") pod "dns-default-p49mf" (UID: "70a52588-f819-40d5-9001-04b49d26d494") : secret "dns-default-metrics-tls" not found Jul 02 19:01:48.910191 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:48.909916 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls podName:7946e8f8-ff35-48d0-bb0a-47711451cb36 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:49.909910859 +0000 UTC m=+37.571879987 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls") pod "image-registry-588b585fb5-84q6s" (UID: "7946e8f8-ff35-48d0-bb0a-47711451cb36") : secret "image-registry-tls" not found Jul 02 19:01:49.034186 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:49.034154 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5gfh8" event={"ID":"69fee9e5-3794-4491-ad5d-47031dedddd5","Type":"ContainerStarted","Data":"91e8f4f43a0c2a80e1dd5c8f5b63ed17e2e273162d3a4a97adc1b9ff49e23732"} Jul 02 19:01:49.817324 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:49.817288 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5vxtw\" (UID: \"f062450f-7c16-491d-84f1-445c4b169765\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5vxtw" Jul 02 19:01:49.817494 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:49.817447 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:01:49.817539 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:49.817523 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert podName:f062450f-7c16-491d-84f1-445c4b169765 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:51.817501258 +0000 UTC m=+39.479470389 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5vxtw" (UID: "f062450f-7c16-491d-84f1-445c4b169765") : secret "networking-console-plugin-cert" not found Jul 02 19:01:49.880874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:49.880837 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:01:49.880874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:49.880868 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:01:49.881165 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:49.880845 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:01:49.883155 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:49.883136 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5znl7\"" Jul 02 19:01:49.883810 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:49.883791 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h66dc\"" Jul 02 19:01:49.883810 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:49.883806 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 19:01:49.883962 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:49.883797 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 19:01:49.883962 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:49.883800 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 19:01:49.883962 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:49.883881 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 19:01:49.894515 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:49.894490 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:01:49.918106 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:49.918083 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:01:49.918412 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:49.918148 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls\") pod \"dns-default-p49mf\" (UID: \"70a52588-f819-40d5-9001-04b49d26d494\") " pod="openshift-dns/dns-default-p49mf" Jul 02 19:01:49.918412 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:49.918224 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:01:49.918412 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:49.918243 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588b585fb5-84q6s: secret "image-registry-tls" not found Jul 02 19:01:49.918412 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:49.918280 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:01:49.918412 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:49.918295 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls podName:7946e8f8-ff35-48d0-bb0a-47711451cb36 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:51.918278018 +0000 UTC m=+39.580247165 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls") pod "image-registry-588b585fb5-84q6s" (UID: "7946e8f8-ff35-48d0-bb0a-47711451cb36") : secret "image-registry-tls" not found Jul 02 19:01:49.918412 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:49.918319 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls podName:70a52588-f819-40d5-9001-04b49d26d494 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:51.918308036 +0000 UTC m=+39.580277163 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls") pod "dns-default-p49mf" (UID: "70a52588-f819-40d5-9001-04b49d26d494") : secret "dns-default-metrics-tls" not found Jul 02 19:01:49.980731 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:49.980705 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:01:50.919184 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:50.919148 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:01:50.975146 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:50.975114 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:01:51.835425 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:51.835361 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5vxtw\" (UID: \"f062450f-7c16-491d-84f1-445c4b169765\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5vxtw" Jul 02 19:01:51.835623 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:51.835530 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:01:51.835623 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:51.835610 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert podName:f062450f-7c16-491d-84f1-445c4b169765 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:55.835588765 +0000 UTC m=+43.497557897 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5vxtw" (UID: "f062450f-7c16-491d-84f1-445c4b169765") : secret "networking-console-plugin-cert" not found Jul 02 19:01:51.936659 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:51.936615 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls\") pod \"dns-default-p49mf\" (UID: \"70a52588-f819-40d5-9001-04b49d26d494\") " pod="openshift-dns/dns-default-p49mf" Jul 02 19:01:51.937254 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:51.936740 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:01:51.937254 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:51.936786 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:01:51.937254 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:51.936829 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:01:51.937254 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:51.936844 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588b585fb5-84q6s: secret "image-registry-tls" not found Jul 02 19:01:51.937254 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:51.936892 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls podName:70a52588-f819-40d5-9001-04b49d26d494 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:55.936867663 +0000 UTC m=+43.598836807 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls") pod "dns-default-p49mf" (UID: "70a52588-f819-40d5-9001-04b49d26d494") : secret "dns-default-metrics-tls" not found Jul 02 19:01:51.937254 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:51.936914 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls podName:7946e8f8-ff35-48d0-bb0a-47711451cb36 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:55.936905561 +0000 UTC m=+43.598874689 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls") pod "image-registry-588b585fb5-84q6s" (UID: "7946e8f8-ff35-48d0-bb0a-47711451cb36") : secret "image-registry-tls" not found Jul 02 19:01:52.921675 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:52.921640 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:01:52.972869 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:52.972815 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:01:53.658255 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:53.658220 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:01:53.758480 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:53.758456 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:01:54.049530 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:54.049455 2559 generic.go:356] "Generic (PLEG): container finished" podID="eed6dcf6-1438-4b95-a1e1-410eff54e692" containerID="7182e8dd6887a0616b775dd25dbd6794f29cf42cbd881c1e82140434418a76a0" exitCode=0 Jul 02 19:01:54.049993 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:54.049535 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n79rs" event={"ID":"eed6dcf6-1438-4b95-a1e1-410eff54e692","Type":"ContainerDied","Data":"7182e8dd6887a0616b775dd25dbd6794f29cf42cbd881c1e82140434418a76a0"} Jul 02 19:01:54.053985 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:54.053959 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5gfh8" event={"ID":"69fee9e5-3794-4491-ad5d-47031dedddd5","Type":"ContainerStarted","Data":"1fe0a86c58353c294bb5534483f254fe5452f24b780fb0ce73769c235359358a"} Jul 02 19:01:54.085611 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:54.085574 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5gfh8" podStartSLOduration=1.211774224 podStartE2EDuration="6.085561346s" totalImagesPullingTime="4.873787122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:54.08440843 +0000 UTC m=+41.746377577" watchObservedRunningTime="2026-07-02 19:01:54.085561346 +0000 UTC m=+41.747530531" Jul 02 19:01:55.058919 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:55.058880 2559 generic.go:356] "Generic (PLEG): container finished" podID="eed6dcf6-1438-4b95-a1e1-410eff54e692" containerID="3c0056ef248d043c1dcdb3b7bc3824d015e96eae55192460722c4481ce62e365" exitCode=0 Jul 02 19:01:55.059263 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:55.058961 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n79rs" event={"ID":"eed6dcf6-1438-4b95-a1e1-410eff54e692","Type":"ContainerDied","Data":"3c0056ef248d043c1dcdb3b7bc3824d015e96eae55192460722c4481ce62e365"} Jul 02 19:01:55.368208 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:55.368177 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:01:55.468543 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:55.468513 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:01:55.867842 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:55.867809 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5vxtw\" (UID: \"f062450f-7c16-491d-84f1-445c4b169765\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5vxtw" Jul 02 19:01:55.867990 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:55.867963 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:01:55.868046 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:55.868029 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert podName:f062450f-7c16-491d-84f1-445c4b169765 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:03.868013573 +0000 UTC m=+51.529982704 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5vxtw" (UID: "f062450f-7c16-491d-84f1-445c4b169765") : secret "networking-console-plugin-cert" not found Jul 02 19:01:55.968807 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:55.968772 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:01:55.968968 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:55.968825 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls\") pod \"dns-default-p49mf\" (UID: \"70a52588-f819-40d5-9001-04b49d26d494\") " pod="openshift-dns/dns-default-p49mf" Jul 02 19:01:55.968968 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:55.968924 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:01:55.968968 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:55.968928 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:01:55.968968 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:55.968947 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588b585fb5-84q6s: secret "image-registry-tls" not found Jul 02 19:01:55.969097 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:55.968983 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls podName:70a52588-f819-40d5-9001-04b49d26d494 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:03.968970392 +0000 UTC m=+51.630939520 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls") pod "dns-default-p49mf" (UID: "70a52588-f819-40d5-9001-04b49d26d494") : secret "dns-default-metrics-tls" not found Jul 02 19:01:55.969097 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:01:55.968995 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls podName:7946e8f8-ff35-48d0-bb0a-47711451cb36 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:03.9689897 +0000 UTC m=+51.630958828 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls") pod "image-registry-588b585fb5-84q6s" (UID: "7946e8f8-ff35-48d0-bb0a-47711451cb36") : secret "image-registry-tls" not found Jul 02 19:01:56.064449 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:56.064408 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n79rs" event={"ID":"eed6dcf6-1438-4b95-a1e1-410eff54e692","Type":"ContainerStarted","Data":"b4215691319c055dcc94ef8caff481a18a46e6ac69fcce6cacc23e9be225e0c4"} Jul 02 19:01:56.088330 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:56.088290 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-n79rs" podStartSLOduration=8.362654736 podStartE2EDuration="44.088275811s" totalImagesPullingTime="35.725621075s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:56.087467252 +0000 UTC m=+43.749436398" watchObservedRunningTime="2026-07-02 19:01:56.088275811 +0000 UTC m=+43.750244962" Jul 02 19:01:56.336881 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:56.336775 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:01:56.391473 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:56.391431 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:01:58.102075 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:58.102041 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:01:58.180204 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:58.180174 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:01:58.972707 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:58.972667 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:01:59.070137 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:01:59.070098 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:02:03.928078 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:03.928040 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5vxtw\" (UID: \"f062450f-7c16-491d-84f1-445c4b169765\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5vxtw" Jul 02 19:02:03.928530 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:02:03.928208 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:02:03.928530 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:02:03.928309 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert podName:f062450f-7c16-491d-84f1-445c4b169765 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:19.9282873 +0000 UTC m=+67.590256443 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5vxtw" (UID: "f062450f-7c16-491d-84f1-445c4b169765") : secret "networking-console-plugin-cert" not found Jul 02 19:02:04.028352 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:04.028325 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:02:04.028503 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:04.028374 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls\") pod \"dns-default-p49mf\" (UID: \"70a52588-f819-40d5-9001-04b49d26d494\") " pod="openshift-dns/dns-default-p49mf" Jul 02 19:02:04.028503 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:02:04.028459 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:02:04.028503 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:02:04.028481 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:02:04.028503 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:02:04.028501 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588b585fb5-84q6s: secret "image-registry-tls" not found Jul 02 19:02:04.028630 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:02:04.028522 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls podName:70a52588-f819-40d5-9001-04b49d26d494 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:20.028505663 +0000 UTC m=+67.690474797 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls") pod "dns-default-p49mf" (UID: "70a52588-f819-40d5-9001-04b49d26d494") : secret "dns-default-metrics-tls" not found Jul 02 19:02:04.028630 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:02:04.028541 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls podName:7946e8f8-ff35-48d0-bb0a-47711451cb36 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:20.028528812 +0000 UTC m=+67.690497940 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls") pod "image-registry-588b585fb5-84q6s" (UID: "7946e8f8-ff35-48d0-bb0a-47711451cb36") : secret "image-registry-tls" not found Jul 02 19:02:13.032471 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:13.032445 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5gf2s" Jul 02 19:02:13.191892 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:13.191837 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:02:13.248373 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:13.248345 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:02:15.353180 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:15.353154 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:02:15.417751 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:15.417728 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:02:16.045910 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:16.045876 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:02:16.156531 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:16.156503 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:02:17.982105 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:17.982078 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:02:18.044052 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:18.044025 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:02:18.420670 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:18.420637 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:02:18.486363 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:18.486333 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:02:18.535621 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:18.535596 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs\") pod \"network-metrics-daemon-2lpws\" (UID: \"7d6e7a30-d495-4e43-bba9-c9fda98277d9\") " pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:02:18.537831 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:18.537809 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 19:02:18.546731 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:02:18.546711 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 19:02:18.546818 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:02:18.546779 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs podName:7d6e7a30-d495-4e43-bba9-c9fda98277d9 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:22.546759107 +0000 UTC m=+130.208728239 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs") pod "network-metrics-daemon-2lpws" (UID: "7d6e7a30-d495-4e43-bba9-c9fda98277d9") : secret "metrics-daemon-secret" not found Jul 02 19:02:18.636485 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:18.636459 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5q4m\" (UniqueName: \"kubernetes.io/projected/5c664d91-c6bf-47e2-9ab0-4d3bfab4964c-kube-api-access-w5q4m\") pod \"network-check-target-b4fq5\" (UID: \"5c664d91-c6bf-47e2-9ab0-4d3bfab4964c\") " pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:02:18.636562 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:18.636551 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92b042c6-6b86-452c-8f9f-2341729e81c5-original-pull-secret\") pod \"global-pull-secret-syncer-z4j2p\" (UID: \"92b042c6-6b86-452c-8f9f-2341729e81c5\") " pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:02:18.638933 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:18.638914 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 19:02:18.639002 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:18.638932 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 19:02:18.648621 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:18.648602 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 19:02:18.649901 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:18.649886 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92b042c6-6b86-452c-8f9f-2341729e81c5-original-pull-secret\") pod \"global-pull-secret-syncer-z4j2p\" (UID: \"92b042c6-6b86-452c-8f9f-2341729e81c5\") " pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:02:18.659378 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:18.659358 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5q4m\" (UniqueName: \"kubernetes.io/projected/5c664d91-c6bf-47e2-9ab0-4d3bfab4964c-kube-api-access-w5q4m\") pod \"network-check-target-b4fq5\" (UID: \"5c664d91-c6bf-47e2-9ab0-4d3bfab4964c\") " pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:02:18.699682 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:18.699633 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5znl7\"" Jul 02 19:02:18.701252 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:18.701238 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4j2p" Jul 02 19:02:18.707873 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:18.707840 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:02:18.841486 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:18.841447 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z4j2p"] Jul 02 19:02:18.845156 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:02:18.845131 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92b042c6_6b86_452c_8f9f_2341729e81c5.slice/crio-9b59af188ce63c8807b6b809fc8081c7388d8dd579a9d70a29761269a0043555 WatchSource:0}: Error finding container 9b59af188ce63c8807b6b809fc8081c7388d8dd579a9d70a29761269a0043555: Status 404 returned error can't find the container with id 9b59af188ce63c8807b6b809fc8081c7388d8dd579a9d70a29761269a0043555 Jul 02 19:02:18.857176 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:18.857140 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b4fq5"] Jul 02 19:02:18.860692 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:02:18.860669 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c664d91_c6bf_47e2_9ab0_4d3bfab4964c.slice/crio-e00546942afa500333501ec60b49a20e21c2f6eb5d8f4daab4b3f52b7a293e8e WatchSource:0}: Error finding container e00546942afa500333501ec60b49a20e21c2f6eb5d8f4daab4b3f52b7a293e8e: Status 404 returned error can't find the container with id e00546942afa500333501ec60b49a20e21c2f6eb5d8f4daab4b3f52b7a293e8e Jul 02 19:02:19.116016 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:19.115982 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b4fq5" event={"ID":"5c664d91-c6bf-47e2-9ab0-4d3bfab4964c","Type":"ContainerStarted","Data":"e00546942afa500333501ec60b49a20e21c2f6eb5d8f4daab4b3f52b7a293e8e"} Jul 02 19:02:19.117053 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:19.117030 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z4j2p" event={"ID":"92b042c6-6b86-452c-8f9f-2341729e81c5","Type":"ContainerStarted","Data":"9b59af188ce63c8807b6b809fc8081c7388d8dd579a9d70a29761269a0043555"} Jul 02 19:02:19.947180 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:19.947133 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5vxtw\" (UID: \"f062450f-7c16-491d-84f1-445c4b169765\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5vxtw" Jul 02 19:02:19.947369 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:02:19.947302 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:02:19.947440 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:02:19.947385 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert podName:f062450f-7c16-491d-84f1-445c4b169765 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:51.947363677 +0000 UTC m=+99.609332808 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5vxtw" (UID: "f062450f-7c16-491d-84f1-445c4b169765") : secret "networking-console-plugin-cert" not found Jul 02 19:02:20.047936 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:20.047907 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:02:20.048110 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:02:20.048061 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:02:20.048110 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:02:20.048086 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588b585fb5-84q6s: secret "image-registry-tls" not found Jul 02 19:02:20.048231 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:20.048110 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls\") pod \"dns-default-p49mf\" (UID: \"70a52588-f819-40d5-9001-04b49d26d494\") " pod="openshift-dns/dns-default-p49mf" Jul 02 19:02:20.048231 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:02:20.048163 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls podName:7946e8f8-ff35-48d0-bb0a-47711451cb36 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:52.048125852 +0000 UTC m=+99.710094985 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls") pod "image-registry-588b585fb5-84q6s" (UID: "7946e8f8-ff35-48d0-bb0a-47711451cb36") : secret "image-registry-tls" not found Jul 02 19:02:20.048231 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:02:20.048202 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:02:20.048374 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:02:20.048253 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls podName:70a52588-f819-40d5-9001-04b49d26d494 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:52.048236688 +0000 UTC m=+99.710205831 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls") pod "dns-default-p49mf" (UID: "70a52588-f819-40d5-9001-04b49d26d494") : secret "dns-default-metrics-tls" not found Jul 02 19:02:22.849730 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:22.849693 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:02:22.912033 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:22.912000 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:02:25.134372 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:25.134332 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b4fq5" event={"ID":"5c664d91-c6bf-47e2-9ab0-4d3bfab4964c","Type":"ContainerStarted","Data":"baf1932426642d7d403fb5de6ff87bbdc44996831923eb4bdd7e4fdcda96a42b"} Jul 02 19:02:25.134776 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:25.134450 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:02:25.135797 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:25.135776 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z4j2p" event={"ID":"92b042c6-6b86-452c-8f9f-2341729e81c5","Type":"ContainerStarted","Data":"00ca9f4b85ff4d65ef84533d73b73f225acff017b795f3b5ca55e12af68f1a50"} Jul 02 19:02:25.151223 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:25.151178 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-b4fq5" podStartSLOduration=67.742746752 podStartE2EDuration="1m13.151165563s" totalImagesPullingTime="5.408418811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:01:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:02:25.150568204 +0000 UTC m=+72.812537366" watchObservedRunningTime="2026-07-02 19:02:25.151165563 +0000 UTC m=+72.813134713" Jul 02 19:02:42.990297 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:42.990174 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:02:43.091170 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:43.091136 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:02:43.149956 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:43.149923 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:02:51.973355 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:51.973304 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5vxtw\" (UID: \"f062450f-7c16-491d-84f1-445c4b169765\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5vxtw" Jul 02 19:02:51.973730 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:02:51.973448 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:02:51.973730 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:02:51.973527 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert podName:f062450f-7c16-491d-84f1-445c4b169765 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:55.973511137 +0000 UTC m=+163.635480266 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5vxtw" (UID: "f062450f-7c16-491d-84f1-445c4b169765") : secret "networking-console-plugin-cert" not found Jul 02 19:02:52.074391 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:52.074349 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls\") pod \"dns-default-p49mf\" (UID: \"70a52588-f819-40d5-9001-04b49d26d494\") " pod="openshift-dns/dns-default-p49mf" Jul 02 19:02:52.074528 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:52.074420 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:02:52.074528 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:02:52.074488 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:02:52.074528 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:02:52.074509 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:02:52.074528 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:02:52.074520 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588b585fb5-84q6s: secret "image-registry-tls" not found Jul 02 19:02:52.074672 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:02:52.074553 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls podName:70a52588-f819-40d5-9001-04b49d26d494 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:56.074539053 +0000 UTC m=+163.736508181 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls") pod "dns-default-p49mf" (UID: "70a52588-f819-40d5-9001-04b49d26d494") : secret "dns-default-metrics-tls" not found Jul 02 19:02:52.074672 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:02:52.074570 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls podName:7946e8f8-ff35-48d0-bb0a-47711451cb36 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:56.074558239 +0000 UTC m=+163.736527381 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls") pod "image-registry-588b585fb5-84q6s" (UID: "7946e8f8-ff35-48d0-bb0a-47711451cb36") : secret "image-registry-tls" not found Jul 02 19:02:56.139995 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:56.139958 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-b4fq5" Jul 02 19:02:56.156258 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:02:56.156210 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-z4j2p" podStartSLOduration=97.729329532 podStartE2EDuration="1m43.156181376s" totalImagesPullingTime="5.426851844s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:02:25.163595527 +0000 UTC m=+72.825564676" watchObservedRunningTime="2026-07-02 19:02:56.156181376 +0000 UTC m=+103.818150523" Jul 02 19:03:18.830010 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:03:18.829978 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:03:22.592912 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:03:22.592875 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs\") pod \"network-metrics-daemon-2lpws\" (UID: \"7d6e7a30-d495-4e43-bba9-c9fda98277d9\") " pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:03:22.593295 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:03:22.593011 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 19:03:22.593295 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:03:22.593089 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs podName:7d6e7a30-d495-4e43-bba9-c9fda98277d9 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:24.593073391 +0000 UTC m=+252.255042519 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs") pod "network-metrics-daemon-2lpws" (UID: "7d6e7a30-d495-4e43-bba9-c9fda98277d9") : secret "metrics-daemon-secret" not found Jul 02 19:03:51.133352 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:03:51.133307 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5vxtw" podUID="f062450f-7c16-491d-84f1-445c4b169765" Jul 02 19:03:51.143470 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:03:51.143441 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-588b585fb5-84q6s" podUID="7946e8f8-ff35-48d0-bb0a-47711451cb36" Jul 02 19:03:51.157654 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:03:51.157616 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-p49mf" podUID="70a52588-f819-40d5-9001-04b49d26d494" Jul 02 19:03:51.338692 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:03:51.338660 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p49mf" Jul 02 19:03:51.338867 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:03:51.338659 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5vxtw" Jul 02 19:03:51.338867 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:03:51.338664 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:03:52.891184 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:03:52.891149 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2lpws" podUID="7d6e7a30-d495-4e43-bba9-c9fda98277d9" Jul 02 19:03:56.026258 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:03:56.026190 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5vxtw\" (UID: \"f062450f-7c16-491d-84f1-445c4b169765\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5vxtw" Jul 02 19:03:56.026655 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:03:56.026331 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:03:56.026655 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:03:56.026405 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert podName:f062450f-7c16-491d-84f1-445c4b169765 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:58.026387904 +0000 UTC m=+285.688357033 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5vxtw" (UID: "f062450f-7c16-491d-84f1-445c4b169765") : secret "networking-console-plugin-cert" not found Jul 02 19:03:56.126769 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:03:56.126730 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:03:56.126912 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:03:56.126787 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls\") pod \"dns-default-p49mf\" (UID: \"70a52588-f819-40d5-9001-04b49d26d494\") " pod="openshift-dns/dns-default-p49mf" Jul 02 19:03:56.126912 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:03:56.126891 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:03:56.126912 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:03:56.126893 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:03:56.126912 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:03:56.126910 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588b585fb5-84q6s: secret "image-registry-tls" not found Jul 02 19:03:56.127037 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:03:56.126943 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls podName:70a52588-f819-40d5-9001-04b49d26d494 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:58.126931393 +0000 UTC m=+285.788900522 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls") pod "dns-default-p49mf" (UID: "70a52588-f819-40d5-9001-04b49d26d494") : secret "dns-default-metrics-tls" not found Jul 02 19:03:56.127037 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:03:56.126962 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls podName:7946e8f8-ff35-48d0-bb0a-47711451cb36 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:58.126948359 +0000 UTC m=+285.788917500 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls") pod "image-registry-588b585fb5-84q6s" (UID: "7946e8f8-ff35-48d0-bb0a-47711451cb36") : secret "image-registry-tls" not found Jul 02 19:04:06.881015 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:04:06.880935 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:05:24.625909 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:24.625836 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs\") pod \"network-metrics-daemon-2lpws\" (UID: \"7d6e7a30-d495-4e43-bba9-c9fda98277d9\") " pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:05:24.626407 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:05:24.625982 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 19:05:24.626407 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:05:24.626058 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs podName:7d6e7a30-d495-4e43-bba9-c9fda98277d9 nodeName:}" failed. No retries permitted until 2026-07-02 19:07:26.626042891 +0000 UTC m=+374.288012018 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs") pod "network-metrics-daemon-2lpws" (UID: "7d6e7a30-d495-4e43-bba9-c9fda98277d9") : secret "metrics-daemon-secret" not found Jul 02 19:05:29.960980 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:29.960946 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:30.041768 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:30.041741 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:36.222388 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:36.222305 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:39.819793 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:39.819758 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-r622v"] Jul 02 19:05:39.821424 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:39.821408 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-r622v" Jul 02 19:05:39.823930 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:39.823914 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-kr6fh\"" Jul 02 19:05:39.848091 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:39.848068 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-r622v"] Jul 02 19:05:39.928973 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:39.928942 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw4xg\" (UniqueName: \"kubernetes.io/projected/c48aae98-bea6-41fe-a08b-9838a2eb3c36-kube-api-access-dw4xg\") pod \"network-check-source-989f8b8dc-r622v\" (UID: \"c48aae98-bea6-41fe-a08b-9838a2eb3c36\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-r622v" Jul 02 19:05:40.029652 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:40.029570 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw4xg\" (UniqueName: \"kubernetes.io/projected/c48aae98-bea6-41fe-a08b-9838a2eb3c36-kube-api-access-dw4xg\") pod \"network-check-source-989f8b8dc-r622v\" (UID: \"c48aae98-bea6-41fe-a08b-9838a2eb3c36\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-r622v" Jul 02 19:05:40.044529 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:40.044504 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw4xg\" (UniqueName: \"kubernetes.io/projected/c48aae98-bea6-41fe-a08b-9838a2eb3c36-kube-api-access-dw4xg\") pod \"network-check-source-989f8b8dc-r622v\" (UID: \"c48aae98-bea6-41fe-a08b-9838a2eb3c36\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-r622v" Jul 02 19:05:40.129300 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:40.129282 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-r622v" Jul 02 19:05:40.162062 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:40.162030 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:40.246776 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:40.246745 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-r622v"] Jul 02 19:05:40.249981 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:05:40.249953 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc48aae98_bea6_41fe_a08b_9838a2eb3c36.slice/crio-123a836e27ccb2ff204c02e14d7f9af74f190e1fc82dcacf0043e080187469de WatchSource:0}: Error finding container 123a836e27ccb2ff204c02e14d7f9af74f190e1fc82dcacf0043e080187469de: Status 404 returned error can't find the container with id 123a836e27ccb2ff204c02e14d7f9af74f190e1fc82dcacf0043e080187469de Jul 02 19:05:40.252404 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:40.252330 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:40.587786 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:40.587703 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-r622v" event={"ID":"c48aae98-bea6-41fe-a08b-9838a2eb3c36","Type":"ContainerStarted","Data":"9de1b9e7d830d9be01c68c1782da71097a7a73a45c9c8404c2b85f610c6559a2"} Jul 02 19:05:40.587786 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:40.587751 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-r622v" event={"ID":"c48aae98-bea6-41fe-a08b-9838a2eb3c36","Type":"ContainerStarted","Data":"123a836e27ccb2ff204c02e14d7f9af74f190e1fc82dcacf0043e080187469de"} Jul 02 19:05:40.604160 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:40.604107 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-r622v" podStartSLOduration=1.604088266 podStartE2EDuration="1.604088266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:40.603739803 +0000 UTC m=+268.265708960" watchObservedRunningTime="2026-07-02 19:05:40.604088266 +0000 UTC m=+268.266057418" Jul 02 19:05:42.468145 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:42.468114 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:42.518636 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:42.518609 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:44.062889 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:44.062860 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:44.115952 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:44.115924 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:44.294777 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:44.294747 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:44.772715 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:44.772685 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:44.847372 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:44.847339 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:45.059738 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:45.059668 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:45.155718 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:45.155689 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:45.197582 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:45.197554 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9qj2l"] Jul 02 19:05:45.199444 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:45.199430 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9qj2l" Jul 02 19:05:45.201744 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:45.201724 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 19:05:45.201875 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:45.201772 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 19:05:45.203472 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:45.203458 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 19:05:45.203700 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:45.203685 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 19:05:45.203792 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:45.203684 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-969mm\"" Jul 02 19:05:45.215832 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:45.215813 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9qj2l"] Jul 02 19:05:45.299845 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:45.299813 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:45.360675 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:45.360643 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:45.367437 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:45.367410 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-crio-socket\") pod \"insights-runtime-extractor-9qj2l\" (UID: \"cd2bdd50-294e-4ae4-81f7-4c3c556595dd\") " pod="openshift-insights/insights-runtime-extractor-9qj2l" Jul 02 19:05:45.367555 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:45.367442 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9qj2l\" (UID: \"cd2bdd50-294e-4ae4-81f7-4c3c556595dd\") " pod="openshift-insights/insights-runtime-extractor-9qj2l" Jul 02 19:05:45.367555 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:45.367465 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-data-volume\") pod \"insights-runtime-extractor-9qj2l\" (UID: \"cd2bdd50-294e-4ae4-81f7-4c3c556595dd\") " pod="openshift-insights/insights-runtime-extractor-9qj2l" Jul 02 19:05:45.367555 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:45.367518 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9qj2l\" (UID: \"cd2bdd50-294e-4ae4-81f7-4c3c556595dd\") " pod="openshift-insights/insights-runtime-extractor-9qj2l" Jul 02 19:05:45.367671 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:45.367618 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpwrh\" (UniqueName: \"kubernetes.io/projected/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-kube-api-access-fpwrh\") pod \"insights-runtime-extractor-9qj2l\" (UID: \"cd2bdd50-294e-4ae4-81f7-4c3c556595dd\") " pod="openshift-insights/insights-runtime-extractor-9qj2l" Jul 02 19:05:45.468806 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:45.468769 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9qj2l\" (UID: \"cd2bdd50-294e-4ae4-81f7-4c3c556595dd\") " pod="openshift-insights/insights-runtime-extractor-9qj2l" Jul 02 19:05:45.469000 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:45.468891 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpwrh\" (UniqueName: \"kubernetes.io/projected/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-kube-api-access-fpwrh\") pod \"insights-runtime-extractor-9qj2l\" (UID: \"cd2bdd50-294e-4ae4-81f7-4c3c556595dd\") " pod="openshift-insights/insights-runtime-extractor-9qj2l" Jul 02 19:05:45.469000 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:05:45.468908 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 19:05:45.469000 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:45.468920 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-crio-socket\") pod \"insights-runtime-extractor-9qj2l\" (UID: \"cd2bdd50-294e-4ae4-81f7-4c3c556595dd\") " pod="openshift-insights/insights-runtime-extractor-9qj2l" Jul 02 19:05:45.469000 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:45.468941 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9qj2l\" (UID: \"cd2bdd50-294e-4ae4-81f7-4c3c556595dd\") " pod="openshift-insights/insights-runtime-extractor-9qj2l" Jul 02 19:05:45.469000 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:45.468957 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-data-volume\") pod \"insights-runtime-extractor-9qj2l\" (UID: \"cd2bdd50-294e-4ae4-81f7-4c3c556595dd\") " pod="openshift-insights/insights-runtime-extractor-9qj2l" Jul 02 19:05:45.469000 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:05:45.468983 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-kube-rbac-proxy-cm podName:cd2bdd50-294e-4ae4-81f7-4c3c556595dd nodeName:}" failed. No retries permitted until 2026-07-02 19:05:45.968967153 +0000 UTC m=+273.630936281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9qj2l" (UID: "cd2bdd50-294e-4ae4-81f7-4c3c556595dd") : configmap "kube-rbac-proxy" not found Jul 02 19:05:45.469314 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:45.469025 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-crio-socket\") pod \"insights-runtime-extractor-9qj2l\" (UID: \"cd2bdd50-294e-4ae4-81f7-4c3c556595dd\") " pod="openshift-insights/insights-runtime-extractor-9qj2l" Jul 02 19:05:45.469314 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:05:45.469060 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 19:05:45.469314 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:05:45.469120 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-insights-runtime-extractor-tls podName:cd2bdd50-294e-4ae4-81f7-4c3c556595dd nodeName:}" failed. No retries permitted until 2026-07-02 19:05:45.969105052 +0000 UTC m=+273.631074187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9qj2l" (UID: "cd2bdd50-294e-4ae4-81f7-4c3c556595dd") : secret "insights-runtime-extractor-tls" not found Jul 02 19:05:45.469415 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:45.469328 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-data-volume\") pod \"insights-runtime-extractor-9qj2l\" (UID: \"cd2bdd50-294e-4ae4-81f7-4c3c556595dd\") " pod="openshift-insights/insights-runtime-extractor-9qj2l" Jul 02 19:05:45.477006 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:45.476978 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpwrh\" (UniqueName: \"kubernetes.io/projected/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-kube-api-access-fpwrh\") pod \"insights-runtime-extractor-9qj2l\" (UID: \"cd2bdd50-294e-4ae4-81f7-4c3c556595dd\") " pod="openshift-insights/insights-runtime-extractor-9qj2l" Jul 02 19:05:45.971628 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:45.971597 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9qj2l\" (UID: \"cd2bdd50-294e-4ae4-81f7-4c3c556595dd\") " pod="openshift-insights/insights-runtime-extractor-9qj2l" Jul 02 19:05:45.971812 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:45.971636 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9qj2l\" (UID: \"cd2bdd50-294e-4ae4-81f7-4c3c556595dd\") " pod="openshift-insights/insights-runtime-extractor-9qj2l" Jul 02 19:05:45.971812 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:05:45.971733 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 19:05:45.971812 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:05:45.971769 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 19:05:45.971812 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:05:45.971792 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-kube-rbac-proxy-cm podName:cd2bdd50-294e-4ae4-81f7-4c3c556595dd nodeName:}" failed. No retries permitted until 2026-07-02 19:05:46.971778584 +0000 UTC m=+274.633747712 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9qj2l" (UID: "cd2bdd50-294e-4ae4-81f7-4c3c556595dd") : configmap "kube-rbac-proxy" not found Jul 02 19:05:45.971999 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:05:45.971832 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-insights-runtime-extractor-tls podName:cd2bdd50-294e-4ae4-81f7-4c3c556595dd nodeName:}" failed. No retries permitted until 2026-07-02 19:05:46.971815112 +0000 UTC m=+274.633784243 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9qj2l" (UID: "cd2bdd50-294e-4ae4-81f7-4c3c556595dd") : secret "insights-runtime-extractor-tls" not found Jul 02 19:05:46.367482 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:46.367449 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-s97wd"] Jul 02 19:05:46.369345 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:46.369331 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-s97wd" Jul 02 19:05:46.371575 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:46.371553 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 02 19:05:46.371717 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:46.371669 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 02 19:05:46.372387 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:46.372370 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 02 19:05:46.372449 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:46.372387 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-5gkmb\"" Jul 02 19:05:46.372449 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:46.372427 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 02 19:05:46.381802 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:46.381784 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-s97wd"] Jul 02 19:05:46.460741 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:46.460713 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:46.475798 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:46.475778 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2f161699-5cdd-4b11-a971-e1dab74baafd-signing-cabundle\") pod \"service-ca-758f599c5-s97wd\" (UID: \"2f161699-5cdd-4b11-a971-e1dab74baafd\") " pod="openshift-service-ca/service-ca-758f599c5-s97wd" Jul 02 19:05:46.475894 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:46.475879 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2f161699-5cdd-4b11-a971-e1dab74baafd-signing-key\") pod \"service-ca-758f599c5-s97wd\" (UID: \"2f161699-5cdd-4b11-a971-e1dab74baafd\") " pod="openshift-service-ca/service-ca-758f599c5-s97wd" Jul 02 19:05:46.475935 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:46.475923 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmv8j\" (UniqueName: \"kubernetes.io/projected/2f161699-5cdd-4b11-a971-e1dab74baafd-kube-api-access-hmv8j\") pod \"service-ca-758f599c5-s97wd\" (UID: \"2f161699-5cdd-4b11-a971-e1dab74baafd\") " pod="openshift-service-ca/service-ca-758f599c5-s97wd" Jul 02 19:05:46.576324 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:46.576295 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2f161699-5cdd-4b11-a971-e1dab74baafd-signing-key\") pod \"service-ca-758f599c5-s97wd\" (UID: \"2f161699-5cdd-4b11-a971-e1dab74baafd\") " pod="openshift-service-ca/service-ca-758f599c5-s97wd" Jul 02 19:05:46.576403 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:46.576346 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmv8j\" (UniqueName: \"kubernetes.io/projected/2f161699-5cdd-4b11-a971-e1dab74baafd-kube-api-access-hmv8j\") pod \"service-ca-758f599c5-s97wd\" (UID: \"2f161699-5cdd-4b11-a971-e1dab74baafd\") " pod="openshift-service-ca/service-ca-758f599c5-s97wd" Jul 02 19:05:46.576403 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:46.576371 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2f161699-5cdd-4b11-a971-e1dab74baafd-signing-cabundle\") pod \"service-ca-758f599c5-s97wd\" (UID: \"2f161699-5cdd-4b11-a971-e1dab74baafd\") " pod="openshift-service-ca/service-ca-758f599c5-s97wd" Jul 02 19:05:46.576961 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:46.576945 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2f161699-5cdd-4b11-a971-e1dab74baafd-signing-cabundle\") pod \"service-ca-758f599c5-s97wd\" (UID: \"2f161699-5cdd-4b11-a971-e1dab74baafd\") " pod="openshift-service-ca/service-ca-758f599c5-s97wd" Jul 02 19:05:46.578704 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:46.578683 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2f161699-5cdd-4b11-a971-e1dab74baafd-signing-key\") pod \"service-ca-758f599c5-s97wd\" (UID: \"2f161699-5cdd-4b11-a971-e1dab74baafd\") " pod="openshift-service-ca/service-ca-758f599c5-s97wd" Jul 02 19:05:46.583963 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:46.583945 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmv8j\" (UniqueName: \"kubernetes.io/projected/2f161699-5cdd-4b11-a971-e1dab74baafd-kube-api-access-hmv8j\") pod \"service-ca-758f599c5-s97wd\" (UID: \"2f161699-5cdd-4b11-a971-e1dab74baafd\") " pod="openshift-service-ca/service-ca-758f599c5-s97wd" Jul 02 19:05:46.677890 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:46.677802 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-s97wd" Jul 02 19:05:46.796744 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:46.796716 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-s97wd"] Jul 02 19:05:46.799814 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:05:46.799790 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f161699_5cdd_4b11_a971_e1dab74baafd.slice/crio-8b13a7c3891305c6a63246435b6847cbb09db597032b14d29e3e525fd5858184 WatchSource:0}: Error finding container 8b13a7c3891305c6a63246435b6847cbb09db597032b14d29e3e525fd5858184: Status 404 returned error can't find the container with id 8b13a7c3891305c6a63246435b6847cbb09db597032b14d29e3e525fd5858184 Jul 02 19:05:46.978116 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:46.978044 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9qj2l\" (UID: \"cd2bdd50-294e-4ae4-81f7-4c3c556595dd\") " pod="openshift-insights/insights-runtime-extractor-9qj2l" Jul 02 19:05:46.978116 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:46.978085 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9qj2l\" (UID: \"cd2bdd50-294e-4ae4-81f7-4c3c556595dd\") " pod="openshift-insights/insights-runtime-extractor-9qj2l" Jul 02 19:05:46.978294 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:05:46.978181 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 19:05:46.978294 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:05:46.978265 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-insights-runtime-extractor-tls podName:cd2bdd50-294e-4ae4-81f7-4c3c556595dd nodeName:}" failed. No retries permitted until 2026-07-02 19:05:48.978251282 +0000 UTC m=+276.640220414 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9qj2l" (UID: "cd2bdd50-294e-4ae4-81f7-4c3c556595dd") : secret "insights-runtime-extractor-tls" not found Jul 02 19:05:46.978294 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:05:46.978182 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 19:05:46.978426 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:05:46.978345 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-kube-rbac-proxy-cm podName:cd2bdd50-294e-4ae4-81f7-4c3c556595dd nodeName:}" failed. No retries permitted until 2026-07-02 19:05:48.978327319 +0000 UTC m=+276.640296450 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9qj2l" (UID: "cd2bdd50-294e-4ae4-81f7-4c3c556595dd") : configmap "kube-rbac-proxy" not found Jul 02 19:05:47.497624 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:47.497588 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:47.606162 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:47.606118 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-s97wd" event={"ID":"2f161699-5cdd-4b11-a971-e1dab74baafd","Type":"ContainerStarted","Data":"8b13a7c3891305c6a63246435b6847cbb09db597032b14d29e3e525fd5858184"} Jul 02 19:05:48.192324 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:48.192295 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wwdxl_ef58dd71-af47-44a1-8c47-d4e98378651d/dns-node-resolver/0.log" Jul 02 19:05:48.791954 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:48.791927 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dk7fw_4660d4a5-2ff9-49c1-948d-22fb52579391/node-ca/0.log" Jul 02 19:05:48.994704 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:48.994619 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9qj2l\" (UID: \"cd2bdd50-294e-4ae4-81f7-4c3c556595dd\") " pod="openshift-insights/insights-runtime-extractor-9qj2l" Jul 02 19:05:48.994704 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:48.994659 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9qj2l\" (UID: \"cd2bdd50-294e-4ae4-81f7-4c3c556595dd\") " pod="openshift-insights/insights-runtime-extractor-9qj2l" Jul 02 19:05:48.994906 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:05:48.994758 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 19:05:48.994906 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:05:48.994769 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 19:05:48.994906 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:05:48.994819 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-kube-rbac-proxy-cm podName:cd2bdd50-294e-4ae4-81f7-4c3c556595dd nodeName:}" failed. No retries permitted until 2026-07-02 19:05:52.994803737 +0000 UTC m=+280.656772883 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9qj2l" (UID: "cd2bdd50-294e-4ae4-81f7-4c3c556595dd") : configmap "kube-rbac-proxy" not found Jul 02 19:05:48.994906 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:05:48.994835 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-insights-runtime-extractor-tls podName:cd2bdd50-294e-4ae4-81f7-4c3c556595dd nodeName:}" failed. No retries permitted until 2026-07-02 19:05:52.994829381 +0000 UTC m=+280.656798509 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9qj2l" (UID: "cd2bdd50-294e-4ae4-81f7-4c3c556595dd") : secret "insights-runtime-extractor-tls" not found Jul 02 19:05:49.613814 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:49.613781 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-s97wd" event={"ID":"2f161699-5cdd-4b11-a971-e1dab74baafd","Type":"ContainerStarted","Data":"7a5a269c7c118d0b59a5896a146d501190170f8b483c6cfb00a4cbf33dc093cb"} Jul 02 19:05:49.628233 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:49.628185 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-s97wd" podStartSLOduration=1.735717003 podStartE2EDuration="3.628170723s" totalImagesPullingTime="1.89245372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:49.627311482 +0000 UTC m=+277.289280632" watchObservedRunningTime="2026-07-02 19:05:49.628170723 +0000 UTC m=+277.290139873" Jul 02 19:05:49.791841 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:49.791813 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5gfh8_69fee9e5-3794-4491-ad5d-47031dedddd5/serve-healthcheck-canary/0.log" Jul 02 19:05:49.952019 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:49.951950 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:50.403416 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:50.403384 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:50.507030 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:50.507001 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:50.605241 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:50.605196 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:50.710440 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:50.710361 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:50.791049 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:50.791010 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:51.138076 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:51.138043 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:51.699434 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:51.699404 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:52.495719 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:52.495687 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:52.931252 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:52.931225 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:53.027357 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:53.027330 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9qj2l\" (UID: \"cd2bdd50-294e-4ae4-81f7-4c3c556595dd\") " pod="openshift-insights/insights-runtime-extractor-9qj2l" Jul 02 19:05:53.027477 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:53.027406 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9qj2l\" (UID: \"cd2bdd50-294e-4ae4-81f7-4c3c556595dd\") " pod="openshift-insights/insights-runtime-extractor-9qj2l" Jul 02 19:05:53.027477 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:05:53.027439 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 19:05:53.027555 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:05:53.027483 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 19:05:53.027555 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:05:53.027495 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-kube-rbac-proxy-cm podName:cd2bdd50-294e-4ae4-81f7-4c3c556595dd nodeName:}" failed. No retries permitted until 2026-07-02 19:06:01.02748206 +0000 UTC m=+288.689451188 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9qj2l" (UID: "cd2bdd50-294e-4ae4-81f7-4c3c556595dd") : configmap "kube-rbac-proxy" not found Jul 02 19:05:53.027555 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:05:53.027520 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-insights-runtime-extractor-tls podName:cd2bdd50-294e-4ae4-81f7-4c3c556595dd nodeName:}" failed. No retries permitted until 2026-07-02 19:06:01.027509926 +0000 UTC m=+288.689479053 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9qj2l" (UID: "cd2bdd50-294e-4ae4-81f7-4c3c556595dd") : secret "insights-runtime-extractor-tls" not found Jul 02 19:05:53.115028 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:53.115005 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:53.304879 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:53.304797 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:53.500958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:53.500919 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:53.699070 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:53.699037 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:53.753601 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:53.753576 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:54.238242 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:54.238215 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:54.339902 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:05:54.339868 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5vxtw" podUID="f062450f-7c16-491d-84f1-445c4b169765" Jul 02 19:05:54.339902 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:05:54.339876 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-588b585fb5-84q6s" podUID="7946e8f8-ff35-48d0-bb0a-47711451cb36" Jul 02 19:05:54.340075 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:05:54.339910 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-p49mf" podUID="70a52588-f819-40d5-9001-04b49d26d494" Jul 02 19:05:54.508365 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:54.508284 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:54.631397 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:54.631367 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p49mf" Jul 02 19:05:54.631581 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:54.631370 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5vxtw" Jul 02 19:05:54.631581 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:54.631367 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:05:54.702410 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:54.702378 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:55.101069 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:55.101037 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:55.299188 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:55.299163 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:55.901377 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:55.901347 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:56.306562 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:56.306486 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:56.432297 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:56.432267 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:56.700218 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:56.700188 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:56.911999 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:56.911969 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:57.302102 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:57.302079 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:57.497235 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:57.497195 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:57.946728 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:57.946701 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:58.062374 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:58.062346 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5vxtw\" (UID: \"f062450f-7c16-491d-84f1-445c4b169765\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5vxtw" Jul 02 19:05:58.064735 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:58.064707 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f062450f-7c16-491d-84f1-445c4b169765-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5vxtw\" (UID: \"f062450f-7c16-491d-84f1-445c4b169765\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5vxtw" Jul 02 19:05:58.136366 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:58.136340 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:58.163484 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:58.163461 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:05:58.163564 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:58.163496 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls\") pod \"dns-default-p49mf\" (UID: \"70a52588-f819-40d5-9001-04b49d26d494\") " pod="openshift-dns/dns-default-p49mf" Jul 02 19:05:58.165790 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:58.165769 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70a52588-f819-40d5-9001-04b49d26d494-metrics-tls\") pod \"dns-default-p49mf\" (UID: \"70a52588-f819-40d5-9001-04b49d26d494\") " pod="openshift-dns/dns-default-p49mf" Jul 02 19:05:58.165877 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:58.165844 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls\") pod \"image-registry-588b585fb5-84q6s\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:05:58.235305 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:58.235256 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lsvnr\"" Jul 02 19:05:58.235305 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:58.235259 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k2dxc\"" Jul 02 19:05:58.235305 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:58.235259 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-v27zv\"" Jul 02 19:05:58.236631 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:58.236612 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:58.242398 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:58.242377 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p49mf" Jul 02 19:05:58.242398 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:58.242395 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5vxtw" Jul 02 19:05:58.242531 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:58.242387 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:05:58.337304 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:58.337214 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:58.392082 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:58.392053 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p49mf"] Jul 02 19:05:58.395920 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:05:58.395897 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70a52588_f819_40d5_9001_04b49d26d494.slice/crio-ddc785d9cf8ac9bacc2dd1550270868e7e64125a2b587b8e1cda7e739822dd19 WatchSource:0}: Error finding container ddc785d9cf8ac9bacc2dd1550270868e7e64125a2b587b8e1cda7e739822dd19: Status 404 returned error can't find the container with id ddc785d9cf8ac9bacc2dd1550270868e7e64125a2b587b8e1cda7e739822dd19 Jul 02 19:05:58.411168 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:58.411148 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-5vxtw"] Jul 02 19:05:58.413981 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:05:58.413958 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf062450f_7c16_491d_84f1_445c4b169765.slice/crio-8a94f4cbe524640dd8f37c5ddf8e9f9f3975c13f06dd9be5e03e11c8166235bd WatchSource:0}: Error finding container 8a94f4cbe524640dd8f37c5ddf8e9f9f3975c13f06dd9be5e03e11c8166235bd: Status 404 returned error can't find the container with id 8a94f4cbe524640dd8f37c5ddf8e9f9f3975c13f06dd9be5e03e11c8166235bd Jul 02 19:05:58.615969 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:58.615921 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-588b585fb5-84q6s"] Jul 02 19:05:58.618162 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:05:58.618139 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7946e8f8_ff35_48d0_bb0a_47711451cb36.slice/crio-6638ddd66b10e518f5b1aa4ba208f3442d48d6eff4ec99d9177229c2f1e2602d WatchSource:0}: Error finding container 6638ddd66b10e518f5b1aa4ba208f3442d48d6eff4ec99d9177229c2f1e2602d: Status 404 returned error can't find the container with id 6638ddd66b10e518f5b1aa4ba208f3442d48d6eff4ec99d9177229c2f1e2602d Jul 02 19:05:58.643705 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:58.643680 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588b585fb5-84q6s" event={"ID":"7946e8f8-ff35-48d0-bb0a-47711451cb36","Type":"ContainerStarted","Data":"6638ddd66b10e518f5b1aa4ba208f3442d48d6eff4ec99d9177229c2f1e2602d"} Jul 02 19:05:58.644743 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:58.644725 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5vxtw" event={"ID":"f062450f-7c16-491d-84f1-445c4b169765","Type":"ContainerStarted","Data":"8a94f4cbe524640dd8f37c5ddf8e9f9f3975c13f06dd9be5e03e11c8166235bd"} Jul 02 19:05:58.645741 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:58.645713 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p49mf" event={"ID":"70a52588-f819-40d5-9001-04b49d26d494","Type":"ContainerStarted","Data":"ddc785d9cf8ac9bacc2dd1550270868e7e64125a2b587b8e1cda7e739822dd19"} Jul 02 19:05:58.694250 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:58.694213 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:59.100919 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:59.100882 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:59.299300 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:59.299255 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:05:59.651121 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:59.651083 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588b585fb5-84q6s" event={"ID":"7946e8f8-ff35-48d0-bb0a-47711451cb36","Type":"ContainerStarted","Data":"748a5fa05d1c69414ac0f38bbe81b196eeb2e38c110457462c9cf1b4df8dba03"} Jul 02 19:05:59.651313 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:59.651230 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:05:59.672988 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:59.672935 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-588b585fb5-84q6s" podStartSLOduration=286.672915598 podStartE2EDuration="4m46.672915598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:01:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:59.671488789 +0000 UTC m=+287.333457940" watchObservedRunningTime="2026-07-02 19:05:59.672915598 +0000 UTC m=+287.334884749" Jul 02 19:05:59.953142 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:05:59.953069 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:00.507673 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:00.507641 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:00.655299 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:00.655268 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5vxtw" event={"ID":"f062450f-7c16-491d-84f1-445c4b169765","Type":"ContainerStarted","Data":"e22c0e67893d08392fdb81a40dcc4fe8417aa8128616f0a891d53ca7dd52df8b"} Jul 02 19:06:00.672843 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:00.672798 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5vxtw" podStartSLOduration=268.327555286 podStartE2EDuration="4m29.672784718s" totalImagesPullingTime="1.345229432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:01:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:00.671937689 +0000 UTC m=+288.333906840" watchObservedRunningTime="2026-07-02 19:06:00.672784718 +0000 UTC m=+288.334753868" Jul 02 19:06:00.699530 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:00.699416 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:00.950928 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:00.950898 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:01.088780 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:01.088703 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9qj2l\" (UID: \"cd2bdd50-294e-4ae4-81f7-4c3c556595dd\") " pod="openshift-insights/insights-runtime-extractor-9qj2l" Jul 02 19:06:01.088780 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:01.088740 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9qj2l\" (UID: \"cd2bdd50-294e-4ae4-81f7-4c3c556595dd\") " pod="openshift-insights/insights-runtime-extractor-9qj2l" Jul 02 19:06:01.089210 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:01.089185 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9qj2l\" (UID: \"cd2bdd50-294e-4ae4-81f7-4c3c556595dd\") " pod="openshift-insights/insights-runtime-extractor-9qj2l" Jul 02 19:06:01.090842 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:01.090826 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd2bdd50-294e-4ae4-81f7-4c3c556595dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9qj2l\" (UID: \"cd2bdd50-294e-4ae4-81f7-4c3c556595dd\") " pod="openshift-insights/insights-runtime-extractor-9qj2l" Jul 02 19:06:01.104091 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:01.104058 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:01.108015 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:01.107999 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9qj2l" Jul 02 19:06:01.227485 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:01.227455 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9qj2l"] Jul 02 19:06:01.230144 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:06:01.230115 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd2bdd50_294e_4ae4_81f7_4c3c556595dd.slice/crio-028d229a19194bd5e02e389d945d05948011a04cb34c8e8be1d509168dfbd778 WatchSource:0}: Error finding container 028d229a19194bd5e02e389d945d05948011a04cb34c8e8be1d509168dfbd778: Status 404 returned error can't find the container with id 028d229a19194bd5e02e389d945d05948011a04cb34c8e8be1d509168dfbd778 Jul 02 19:06:01.661497 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:01.661449 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9qj2l" event={"ID":"cd2bdd50-294e-4ae4-81f7-4c3c556595dd","Type":"ContainerStarted","Data":"028d229a19194bd5e02e389d945d05948011a04cb34c8e8be1d509168dfbd778"} Jul 02 19:06:01.663161 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:01.663140 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p49mf" event={"ID":"70a52588-f819-40d5-9001-04b49d26d494","Type":"ContainerStarted","Data":"0da2cb61a4f6bf8535a2abf1705f2afa9dbfb639da9daabdd1cdf0ec14c2e79a"} Jul 02 19:06:01.663241 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:01.663188 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p49mf" event={"ID":"70a52588-f819-40d5-9001-04b49d26d494","Type":"ContainerStarted","Data":"17d90636ac3fa338412056aed73b65750ebda708f81a3089fb1af4c24ce68850"} Jul 02 19:06:01.680728 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:01.680675 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-p49mf" podStartSLOduration=251.476216072 podStartE2EDuration="4m13.680657213s" totalImagesPullingTime="2.204441141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:01.679516689 +0000 UTC m=+289.341485850" watchObservedRunningTime="2026-07-02 19:06:01.680657213 +0000 UTC m=+289.342626369" Jul 02 19:06:02.667135 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:02.667102 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-p49mf" Jul 02 19:06:05.678915 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:05.678881 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9qj2l" event={"ID":"cd2bdd50-294e-4ae4-81f7-4c3c556595dd","Type":"ContainerStarted","Data":"a4ed46a478b05dcf12c65c45081aedab14b0943d77feb0627e4c07127943048c"} Jul 02 19:06:05.679272 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:05.678934 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9qj2l" event={"ID":"cd2bdd50-294e-4ae4-81f7-4c3c556595dd","Type":"ContainerStarted","Data":"4d8e21c7f0c109623e98ebe5955e3d058e57cbb3e174ce559a36b597fd1cc4fa"} Jul 02 19:06:05.838570 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:05.838489 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:05.943139 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:05.943096 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:06.146898 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:06.146862 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:06.644034 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:06.643999 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:06.745462 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:06.745428 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:06.938446 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:06.938376 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:07.022219 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:07.022187 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:07.334277 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:07.334170 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:07.419767 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:07.419725 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:07.527837 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:07.527805 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:07.658563 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:07.658532 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:08.451443 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:08.451412 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-pgcqf"] Jul 02 19:06:08.453960 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:08.453937 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-pgcqf" Jul 02 19:06:08.456493 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:08.456464 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-rbnjs\"" Jul 02 19:06:08.456625 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:08.456560 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 19:06:08.456625 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:08.456588 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 19:06:08.466413 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:08.466394 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-pgcqf"] Jul 02 19:06:08.537571 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:08.537546 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:08.550691 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:08.550666 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfswh\" (UniqueName: \"kubernetes.io/projected/357ddcc5-5598-480d-98b3-9a9f5427ba9d-kube-api-access-cfswh\") pod \"downloads-685bfb5f64-pgcqf\" (UID: \"357ddcc5-5598-480d-98b3-9a9f5427ba9d\") " pod="openshift-console/downloads-685bfb5f64-pgcqf" Jul 02 19:06:08.633977 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:08.633952 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:08.651677 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:08.651655 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfswh\" (UniqueName: \"kubernetes.io/projected/357ddcc5-5598-480d-98b3-9a9f5427ba9d-kube-api-access-cfswh\") pod \"downloads-685bfb5f64-pgcqf\" (UID: \"357ddcc5-5598-480d-98b3-9a9f5427ba9d\") " pod="openshift-console/downloads-685bfb5f64-pgcqf" Jul 02 19:06:08.663951 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:08.663927 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfswh\" (UniqueName: \"kubernetes.io/projected/357ddcc5-5598-480d-98b3-9a9f5427ba9d-kube-api-access-cfswh\") pod \"downloads-685bfb5f64-pgcqf\" (UID: \"357ddcc5-5598-480d-98b3-9a9f5427ba9d\") " pod="openshift-console/downloads-685bfb5f64-pgcqf" Jul 02 19:06:08.690155 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:08.690131 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9qj2l" event={"ID":"cd2bdd50-294e-4ae4-81f7-4c3c556595dd","Type":"ContainerStarted","Data":"38d50c80332d503b398f7720b7b90d7191c5743db68b83e0fb573ce00c741568"} Jul 02 19:06:08.711871 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:08.711780 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9qj2l" podStartSLOduration=17.130813178 podStartE2EDuration="23.711767271s" totalImagesPullingTime="6.580954093s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:05:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:08.711471607 +0000 UTC m=+296.373440758" watchObservedRunningTime="2026-07-02 19:06:08.711767271 +0000 UTC m=+296.373736403" Jul 02 19:06:08.717044 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:08.717023 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:08.762394 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:08.762374 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-pgcqf" Jul 02 19:06:08.884597 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:06:08.884567 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod357ddcc5_5598_480d_98b3_9a9f5427ba9d.slice/crio-eea53f0fcce22be090da377a819f7ccb5bfa3755965b814624a6fb7ee3f2b5ed WatchSource:0}: Error finding container eea53f0fcce22be090da377a819f7ccb5bfa3755965b814624a6fb7ee3f2b5ed: Status 404 returned error can't find the container with id eea53f0fcce22be090da377a819f7ccb5bfa3755965b814624a6fb7ee3f2b5ed Jul 02 19:06:08.884707 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:08.884638 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-pgcqf"] Jul 02 19:06:08.972900 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:08.972767 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:09.073757 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:09.073730 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:09.694787 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:09.694759 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-pgcqf" event={"ID":"357ddcc5-5598-480d-98b3-9a9f5427ba9d","Type":"ContainerStarted","Data":"eea53f0fcce22be090da377a819f7ccb5bfa3755965b814624a6fb7ee3f2b5ed"} Jul 02 19:06:09.881652 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:06:09.881603 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2lpws" podUID="7d6e7a30-d495-4e43-bba9-c9fda98277d9" Jul 02 19:06:12.673017 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:12.672984 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-p49mf" Jul 02 19:06:12.751051 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:12.750978 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gf2s_a95b977b-6b92-411f-a185-ecc012668bff/ovn-acl-logging/0.log" Jul 02 19:06:12.751221 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:12.751171 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gf2s_a95b977b-6b92-411f-a185-ecc012668bff/ovn-acl-logging/0.log" Jul 02 19:06:12.757952 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:12.757931 2559 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 19:06:13.780808 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:13.780778 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:13.881335 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:13.881302 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:13.938931 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:13.938899 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pkhb4"] Jul 02 19:06:13.941123 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:13.941096 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pkhb4" Jul 02 19:06:13.943171 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:13.943145 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 02 19:06:13.943352 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:13.943329 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-pjsjt\"" Jul 02 19:06:13.952643 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:13.952617 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pkhb4"] Jul 02 19:06:13.957563 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:13.957538 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:13.989718 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:13.989687 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/373597c2-a645-495b-83b1-d14489fa5ea0-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-pkhb4\" (UID: \"373597c2-a645-495b-83b1-d14489fa5ea0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pkhb4" Jul 02 19:06:14.091077 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:14.091011 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/373597c2-a645-495b-83b1-d14489fa5ea0-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-pkhb4\" (UID: \"373597c2-a645-495b-83b1-d14489fa5ea0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pkhb4" Jul 02 19:06:14.091200 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:06:14.091140 2559 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 02 19:06:14.091200 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:06:14.091198 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/373597c2-a645-495b-83b1-d14489fa5ea0-tls-certificates podName:373597c2-a645-495b-83b1-d14489fa5ea0 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:14.591184362 +0000 UTC m=+302.253153490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/373597c2-a645-495b-83b1-d14489fa5ea0-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-pkhb4" (UID: "373597c2-a645-495b-83b1-d14489fa5ea0") : secret "prometheus-operator-admission-webhook-tls" not found Jul 02 19:06:14.392765 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:14.392705 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:14.550723 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:14.550688 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:14.594926 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:14.594886 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/373597c2-a645-495b-83b1-d14489fa5ea0-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-pkhb4\" (UID: \"373597c2-a645-495b-83b1-d14489fa5ea0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pkhb4" Jul 02 19:06:14.597724 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:14.597699 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/373597c2-a645-495b-83b1-d14489fa5ea0-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-pkhb4\" (UID: \"373597c2-a645-495b-83b1-d14489fa5ea0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pkhb4" Jul 02 19:06:14.857923 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:14.857892 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pkhb4" Jul 02 19:06:15.007056 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:15.007032 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pkhb4"] Jul 02 19:06:15.009429 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:06:15.009404 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod373597c2_a645_495b_83b1_d14489fa5ea0.slice/crio-e26612284569843040dd37fe1c178c49301e0a301a08b8e14fdb349ac539c448 WatchSource:0}: Error finding container e26612284569843040dd37fe1c178c49301e0a301a08b8e14fdb349ac539c448: Status 404 returned error can't find the container with id e26612284569843040dd37fe1c178c49301e0a301a08b8e14fdb349ac539c448 Jul 02 19:06:15.011330 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:15.011315 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 19:06:15.716477 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:15.716410 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pkhb4" event={"ID":"373597c2-a645-495b-83b1-d14489fa5ea0","Type":"ContainerStarted","Data":"e26612284569843040dd37fe1c178c49301e0a301a08b8e14fdb349ac539c448"} Jul 02 19:06:15.852923 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:15.852891 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:16.721220 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:16.721188 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pkhb4" event={"ID":"373597c2-a645-495b-83b1-d14489fa5ea0","Type":"ContainerStarted","Data":"48fd1531c4adad0767a0b7494466f1992b7f0f295464784b1901760072a9ffad"} Jul 02 19:06:16.721658 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:16.721317 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pkhb4" Jul 02 19:06:16.725672 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:16.725651 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pkhb4" Jul 02 19:06:16.735771 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:16.735724 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pkhb4" podStartSLOduration=2.536506608 podStartE2EDuration="3.735712252s" totalImagesPullingTime="1.199205644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:06:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:16.735399907 +0000 UTC m=+304.397369058" watchObservedRunningTime="2026-07-02 19:06:16.735712252 +0000 UTC m=+304.397681402" Jul 02 19:06:16.955900 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:16.955823 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:17.004635 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:17.004563 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-w7xvw"] Jul 02 19:06:17.007110 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:17.007064 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w7xvw" Jul 02 19:06:17.009363 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:17.009345 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 19:06:17.010642 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:17.010488 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 02 19:06:17.010642 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:17.010531 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 19:06:17.010642 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:17.010607 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 19:06:17.010885 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:17.010843 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-qbwvp\"" Jul 02 19:06:17.010996 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:17.010921 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 02 19:06:17.019843 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:17.019819 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-w7xvw"] Jul 02 19:06:17.026983 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:17.026961 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:17.115707 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:17.115682 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa9fa43f-a19d-4c28-827f-2c5b23fcd79d-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-w7xvw\" (UID: \"fa9fa43f-a19d-4c28-827f-2c5b23fcd79d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w7xvw" Jul 02 19:06:17.115828 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:17.115710 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa9fa43f-a19d-4c28-827f-2c5b23fcd79d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-w7xvw\" (UID: \"fa9fa43f-a19d-4c28-827f-2c5b23fcd79d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w7xvw" Jul 02 19:06:17.115828 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:17.115735 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa9fa43f-a19d-4c28-827f-2c5b23fcd79d-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-w7xvw\" (UID: \"fa9fa43f-a19d-4c28-827f-2c5b23fcd79d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w7xvw" Jul 02 19:06:17.115934 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:17.115880 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zztfk\" (UniqueName: \"kubernetes.io/projected/fa9fa43f-a19d-4c28-827f-2c5b23fcd79d-kube-api-access-zztfk\") pod \"prometheus-operator-567f7b8b7c-w7xvw\" (UID: \"fa9fa43f-a19d-4c28-827f-2c5b23fcd79d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w7xvw" Jul 02 19:06:17.216225 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:17.216192 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa9fa43f-a19d-4c28-827f-2c5b23fcd79d-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-w7xvw\" (UID: \"fa9fa43f-a19d-4c28-827f-2c5b23fcd79d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w7xvw" Jul 02 19:06:17.216367 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:17.216231 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa9fa43f-a19d-4c28-827f-2c5b23fcd79d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-w7xvw\" (UID: \"fa9fa43f-a19d-4c28-827f-2c5b23fcd79d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w7xvw" Jul 02 19:06:17.216439 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:17.216385 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa9fa43f-a19d-4c28-827f-2c5b23fcd79d-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-w7xvw\" (UID: \"fa9fa43f-a19d-4c28-827f-2c5b23fcd79d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w7xvw" Jul 02 19:06:17.216538 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:17.216502 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zztfk\" (UniqueName: \"kubernetes.io/projected/fa9fa43f-a19d-4c28-827f-2c5b23fcd79d-kube-api-access-zztfk\") pod \"prometheus-operator-567f7b8b7c-w7xvw\" (UID: \"fa9fa43f-a19d-4c28-827f-2c5b23fcd79d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w7xvw" Jul 02 19:06:17.217023 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:17.217001 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa9fa43f-a19d-4c28-827f-2c5b23fcd79d-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-w7xvw\" (UID: \"fa9fa43f-a19d-4c28-827f-2c5b23fcd79d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w7xvw" Jul 02 19:06:17.218927 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:17.218899 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa9fa43f-a19d-4c28-827f-2c5b23fcd79d-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-w7xvw\" (UID: \"fa9fa43f-a19d-4c28-827f-2c5b23fcd79d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w7xvw" Jul 02 19:06:17.219031 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:17.218944 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa9fa43f-a19d-4c28-827f-2c5b23fcd79d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-w7xvw\" (UID: \"fa9fa43f-a19d-4c28-827f-2c5b23fcd79d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w7xvw" Jul 02 19:06:17.224664 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:17.224640 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zztfk\" (UniqueName: \"kubernetes.io/projected/fa9fa43f-a19d-4c28-827f-2c5b23fcd79d-kube-api-access-zztfk\") pod \"prometheus-operator-567f7b8b7c-w7xvw\" (UID: \"fa9fa43f-a19d-4c28-827f-2c5b23fcd79d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w7xvw" Jul 02 19:06:17.262198 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:17.262141 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:17.318194 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:17.318172 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w7xvw" Jul 02 19:06:17.459678 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:17.459651 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-w7xvw"] Jul 02 19:06:17.464196 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:06:17.464168 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa9fa43f_a19d_4c28_827f_2c5b23fcd79d.slice/crio-ee8770701cf902165e67eaf00cbb18018ce3bf5f9a9a7fa5e3a3091f26fa1163 WatchSource:0}: Error finding container ee8770701cf902165e67eaf00cbb18018ce3bf5f9a9a7fa5e3a3091f26fa1163: Status 404 returned error can't find the container with id ee8770701cf902165e67eaf00cbb18018ce3bf5f9a9a7fa5e3a3091f26fa1163 Jul 02 19:06:17.725605 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:17.725570 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w7xvw" event={"ID":"fa9fa43f-a19d-4c28-827f-2c5b23fcd79d","Type":"ContainerStarted","Data":"ee8770701cf902165e67eaf00cbb18018ce3bf5f9a9a7fa5e3a3091f26fa1163"} Jul 02 19:06:18.249347 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:18.249056 2559 patch_prober.go:28] interesting pod/image-registry-588b585fb5-84q6s container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 02 19:06:18.249347 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:18.249113 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-588b585fb5-84q6s" podUID="7946e8f8-ff35-48d0-bb0a-47711451cb36" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 19:06:19.301719 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:19.301646 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:19.737227 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:19.737188 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w7xvw" event={"ID":"fa9fa43f-a19d-4c28-827f-2c5b23fcd79d","Type":"ContainerStarted","Data":"251c173781e4bd19cd5bf4eba46a72e1999c12dd6512af727128e648fa08a978"} Jul 02 19:06:19.737387 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:19.737281 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w7xvw" event={"ID":"fa9fa43f-a19d-4c28-827f-2c5b23fcd79d","Type":"ContainerStarted","Data":"200fd89196bb82b1de0be2a3cd28feebfb22049720169eb84c75acbe21d77531"} Jul 02 19:06:19.757962 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:19.757896 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-w7xvw" podStartSLOduration=2.237481522 podStartE2EDuration="3.757876061s" totalImagesPullingTime="1.520394539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:06:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:19.757276403 +0000 UTC m=+307.419245555" watchObservedRunningTime="2026-07-02 19:06:19.757876061 +0000 UTC m=+307.419845212" Jul 02 19:06:19.775491 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:19.775451 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:19.899295 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:19.899269 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:20.000422 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:20.000333 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:20.099045 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:20.099013 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:20.660744 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:20.660716 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:06:20.989422 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:20.989341 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:21.099454 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.099417 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:21.193365 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.193331 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:21.301787 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.301686 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:21.393920 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.393814 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-z7ljn"] Jul 02 19:06:21.401718 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.401647 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:21.408489 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.408462 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z7ljn" Jul 02 19:06:21.412277 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.412220 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-pg5g4\"" Jul 02 19:06:21.412519 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.412492 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 02 19:06:21.412688 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.412674 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 02 19:06:21.432109 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.432034 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-z7ljn"] Jul 02 19:06:21.448362 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.447834 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nth4p"] Jul 02 19:06:21.457652 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.457025 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:21.461337 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.461315 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 19:06:21.462325 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.462206 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 19:06:21.463010 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.462994 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jknhs\"" Jul 02 19:06:21.466974 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.466953 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 19:06:21.553479 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.553380 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgqnl\" (UniqueName: \"kubernetes.io/projected/9f104f54-b9ee-4ceb-acc5-01a18ddfebe4-kube-api-access-cgqnl\") pod \"openshift-state-metrics-54cf96dfcf-z7ljn\" (UID: \"9f104f54-b9ee-4ceb-acc5-01a18ddfebe4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z7ljn" Jul 02 19:06:21.553877 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.553659 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a84becc-fd52-4aff-938e-87560dcba2b8-sys\") pod \"node-exporter-nth4p\" (UID: \"2a84becc-fd52-4aff-938e-87560dcba2b8\") " pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:21.553877 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.553704 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a84becc-fd52-4aff-938e-87560dcba2b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nth4p\" (UID: \"2a84becc-fd52-4aff-938e-87560dcba2b8\") " pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:21.553877 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.553736 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f104f54-b9ee-4ceb-acc5-01a18ddfebe4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-z7ljn\" (UID: \"9f104f54-b9ee-4ceb-acc5-01a18ddfebe4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z7ljn" Jul 02 19:06:21.553877 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.553767 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f104f54-b9ee-4ceb-acc5-01a18ddfebe4-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-z7ljn\" (UID: \"9f104f54-b9ee-4ceb-acc5-01a18ddfebe4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z7ljn" Jul 02 19:06:21.553877 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.553795 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a84becc-fd52-4aff-938e-87560dcba2b8-metrics-client-ca\") pod \"node-exporter-nth4p\" (UID: \"2a84becc-fd52-4aff-938e-87560dcba2b8\") " pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:21.553877 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.553823 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f104f54-b9ee-4ceb-acc5-01a18ddfebe4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-z7ljn\" (UID: \"9f104f54-b9ee-4ceb-acc5-01a18ddfebe4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z7ljn" Jul 02 19:06:21.554340 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.554199 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a84becc-fd52-4aff-938e-87560dcba2b8-node-exporter-tls\") pod \"node-exporter-nth4p\" (UID: \"2a84becc-fd52-4aff-938e-87560dcba2b8\") " pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:21.554340 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.554261 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2a84becc-fd52-4aff-938e-87560dcba2b8-node-exporter-textfile\") pod \"node-exporter-nth4p\" (UID: \"2a84becc-fd52-4aff-938e-87560dcba2b8\") " pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:21.554340 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.554284 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2a84becc-fd52-4aff-938e-87560dcba2b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-nth4p\" (UID: \"2a84becc-fd52-4aff-938e-87560dcba2b8\") " pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:21.554340 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.554313 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2a84becc-fd52-4aff-938e-87560dcba2b8-node-exporter-wtmp\") pod \"node-exporter-nth4p\" (UID: \"2a84becc-fd52-4aff-938e-87560dcba2b8\") " pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:21.554665 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.554575 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2a84becc-fd52-4aff-938e-87560dcba2b8-root\") pod \"node-exporter-nth4p\" (UID: \"2a84becc-fd52-4aff-938e-87560dcba2b8\") " pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:21.554665 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.554603 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-675p6\" (UniqueName: \"kubernetes.io/projected/2a84becc-fd52-4aff-938e-87560dcba2b8-kube-api-access-675p6\") pod \"node-exporter-nth4p\" (UID: \"2a84becc-fd52-4aff-938e-87560dcba2b8\") " pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:21.582151 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.582120 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:21.655655 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.655620 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2a84becc-fd52-4aff-938e-87560dcba2b8-node-exporter-textfile\") pod \"node-exporter-nth4p\" (UID: \"2a84becc-fd52-4aff-938e-87560dcba2b8\") " pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:21.655827 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.655666 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2a84becc-fd52-4aff-938e-87560dcba2b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-nth4p\" (UID: \"2a84becc-fd52-4aff-938e-87560dcba2b8\") " pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:21.655827 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.655699 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2a84becc-fd52-4aff-938e-87560dcba2b8-node-exporter-wtmp\") pod \"node-exporter-nth4p\" (UID: \"2a84becc-fd52-4aff-938e-87560dcba2b8\") " pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:21.655827 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.655735 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2a84becc-fd52-4aff-938e-87560dcba2b8-root\") pod \"node-exporter-nth4p\" (UID: \"2a84becc-fd52-4aff-938e-87560dcba2b8\") " pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:21.655827 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.655759 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-675p6\" (UniqueName: \"kubernetes.io/projected/2a84becc-fd52-4aff-938e-87560dcba2b8-kube-api-access-675p6\") pod \"node-exporter-nth4p\" (UID: \"2a84becc-fd52-4aff-938e-87560dcba2b8\") " pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:21.655827 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.655807 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgqnl\" (UniqueName: \"kubernetes.io/projected/9f104f54-b9ee-4ceb-acc5-01a18ddfebe4-kube-api-access-cgqnl\") pod \"openshift-state-metrics-54cf96dfcf-z7ljn\" (UID: \"9f104f54-b9ee-4ceb-acc5-01a18ddfebe4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z7ljn" Jul 02 19:06:21.656100 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.655831 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a84becc-fd52-4aff-938e-87560dcba2b8-sys\") pod \"node-exporter-nth4p\" (UID: \"2a84becc-fd52-4aff-938e-87560dcba2b8\") " pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:21.656100 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.655876 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a84becc-fd52-4aff-938e-87560dcba2b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nth4p\" (UID: \"2a84becc-fd52-4aff-938e-87560dcba2b8\") " pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:21.656100 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.655904 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f104f54-b9ee-4ceb-acc5-01a18ddfebe4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-z7ljn\" (UID: \"9f104f54-b9ee-4ceb-acc5-01a18ddfebe4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z7ljn" Jul 02 19:06:21.656100 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.655935 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f104f54-b9ee-4ceb-acc5-01a18ddfebe4-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-z7ljn\" (UID: \"9f104f54-b9ee-4ceb-acc5-01a18ddfebe4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z7ljn" Jul 02 19:06:21.656100 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.655959 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a84becc-fd52-4aff-938e-87560dcba2b8-metrics-client-ca\") pod \"node-exporter-nth4p\" (UID: \"2a84becc-fd52-4aff-938e-87560dcba2b8\") " pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:21.656100 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.655987 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f104f54-b9ee-4ceb-acc5-01a18ddfebe4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-z7ljn\" (UID: \"9f104f54-b9ee-4ceb-acc5-01a18ddfebe4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z7ljn" Jul 02 19:06:21.656100 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.656013 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a84becc-fd52-4aff-938e-87560dcba2b8-node-exporter-tls\") pod \"node-exporter-nth4p\" (UID: \"2a84becc-fd52-4aff-938e-87560dcba2b8\") " pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:21.656100 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.656015 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2a84becc-fd52-4aff-938e-87560dcba2b8-node-exporter-wtmp\") pod \"node-exporter-nth4p\" (UID: \"2a84becc-fd52-4aff-938e-87560dcba2b8\") " pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:21.656100 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.656095 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2a84becc-fd52-4aff-938e-87560dcba2b8-root\") pod \"node-exporter-nth4p\" (UID: \"2a84becc-fd52-4aff-938e-87560dcba2b8\") " pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:21.656534 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.656349 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2a84becc-fd52-4aff-938e-87560dcba2b8-node-exporter-textfile\") pod \"node-exporter-nth4p\" (UID: \"2a84becc-fd52-4aff-938e-87560dcba2b8\") " pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:21.656638 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.656576 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a84becc-fd52-4aff-938e-87560dcba2b8-sys\") pod \"node-exporter-nth4p\" (UID: \"2a84becc-fd52-4aff-938e-87560dcba2b8\") " pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:21.656863 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.656831 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2a84becc-fd52-4aff-938e-87560dcba2b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-nth4p\" (UID: \"2a84becc-fd52-4aff-938e-87560dcba2b8\") " pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:21.657992 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:06:21.657037 2559 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 02 19:06:21.657992 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:06:21.657099 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f104f54-b9ee-4ceb-acc5-01a18ddfebe4-openshift-state-metrics-tls podName:9f104f54-b9ee-4ceb-acc5-01a18ddfebe4 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:22.157080462 +0000 UTC m=+309.819049606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9f104f54-b9ee-4ceb-acc5-01a18ddfebe4-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-z7ljn" (UID: "9f104f54-b9ee-4ceb-acc5-01a18ddfebe4") : secret "openshift-state-metrics-tls" not found Jul 02 19:06:21.657992 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.657299 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a84becc-fd52-4aff-938e-87560dcba2b8-metrics-client-ca\") pod \"node-exporter-nth4p\" (UID: \"2a84becc-fd52-4aff-938e-87560dcba2b8\") " pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:21.657992 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:06:21.657495 2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 02 19:06:21.657992 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:06:21.657551 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a84becc-fd52-4aff-938e-87560dcba2b8-node-exporter-tls podName:2a84becc-fd52-4aff-938e-87560dcba2b8 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:22.157535334 +0000 UTC m=+309.819504468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2a84becc-fd52-4aff-938e-87560dcba2b8-node-exporter-tls") pod "node-exporter-nth4p" (UID: "2a84becc-fd52-4aff-938e-87560dcba2b8") : secret "node-exporter-tls" not found Jul 02 19:06:21.657992 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.657955 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f104f54-b9ee-4ceb-acc5-01a18ddfebe4-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-z7ljn\" (UID: \"9f104f54-b9ee-4ceb-acc5-01a18ddfebe4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z7ljn" Jul 02 19:06:21.659418 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.659393 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a84becc-fd52-4aff-938e-87560dcba2b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nth4p\" (UID: \"2a84becc-fd52-4aff-938e-87560dcba2b8\") " pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:21.660091 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.660050 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f104f54-b9ee-4ceb-acc5-01a18ddfebe4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-z7ljn\" (UID: \"9f104f54-b9ee-4ceb-acc5-01a18ddfebe4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z7ljn" Jul 02 19:06:21.666149 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.666105 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-675p6\" (UniqueName: \"kubernetes.io/projected/2a84becc-fd52-4aff-938e-87560dcba2b8-kube-api-access-675p6\") pod \"node-exporter-nth4p\" (UID: \"2a84becc-fd52-4aff-938e-87560dcba2b8\") " pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:21.669987 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.669808 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgqnl\" (UniqueName: \"kubernetes.io/projected/9f104f54-b9ee-4ceb-acc5-01a18ddfebe4-kube-api-access-cgqnl\") pod \"openshift-state-metrics-54cf96dfcf-z7ljn\" (UID: \"9f104f54-b9ee-4ceb-acc5-01a18ddfebe4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z7ljn" Jul 02 19:06:21.679440 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.679352 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:21.778732 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.778704 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:21.869258 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.869227 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:21.881261 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.881237 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:06:21.921543 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:21.921462 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:22.160707 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:22.160623 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f104f54-b9ee-4ceb-acc5-01a18ddfebe4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-z7ljn\" (UID: \"9f104f54-b9ee-4ceb-acc5-01a18ddfebe4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z7ljn" Jul 02 19:06:22.160707 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:22.160683 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a84becc-fd52-4aff-938e-87560dcba2b8-node-exporter-tls\") pod \"node-exporter-nth4p\" (UID: \"2a84becc-fd52-4aff-938e-87560dcba2b8\") " pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:22.163336 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:22.163310 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f104f54-b9ee-4ceb-acc5-01a18ddfebe4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-z7ljn\" (UID: \"9f104f54-b9ee-4ceb-acc5-01a18ddfebe4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z7ljn" Jul 02 19:06:22.163645 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:22.163625 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a84becc-fd52-4aff-938e-87560dcba2b8-node-exporter-tls\") pod \"node-exporter-nth4p\" (UID: \"2a84becc-fd52-4aff-938e-87560dcba2b8\") " pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:22.250899 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:22.250867 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:22.323466 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:22.323428 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z7ljn" Jul 02 19:06:22.350750 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:22.350684 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:22.369892 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:22.369457 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nth4p" Jul 02 19:06:22.388875 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:06:22.388789 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a84becc_fd52_4aff_938e_87560dcba2b8.slice/crio-1fffd7d523426af58372458484dacdd64921800a28eaf7d46361bbecd06087a8 WatchSource:0}: Error finding container 1fffd7d523426af58372458484dacdd64921800a28eaf7d46361bbecd06087a8: Status 404 returned error can't find the container with id 1fffd7d523426af58372458484dacdd64921800a28eaf7d46361bbecd06087a8 Jul 02 19:06:22.418725 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:22.418568 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:22.486983 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:22.486953 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-z7ljn"] Jul 02 19:06:22.492889 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:06:22.492842 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f104f54_b9ee_4ceb_acc5_01a18ddfebe4.slice/crio-d01e83fa5dc9072aea7832cf844329939a72d21ebdb48246d79bd846304865a7 WatchSource:0}: Error finding container d01e83fa5dc9072aea7832cf844329939a72d21ebdb48246d79bd846304865a7: Status 404 returned error can't find the container with id d01e83fa5dc9072aea7832cf844329939a72d21ebdb48246d79bd846304865a7 Jul 02 19:06:22.513748 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:22.513706 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:22.752742 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:22.752656 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z7ljn" event={"ID":"9f104f54-b9ee-4ceb-acc5-01a18ddfebe4","Type":"ContainerStarted","Data":"9ca6d13cbfdf1b74a09ddef594baa69d955c28dfdb11e088785fce74e44fb518"} Jul 02 19:06:22.752742 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:22.752719 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z7ljn" event={"ID":"9f104f54-b9ee-4ceb-acc5-01a18ddfebe4","Type":"ContainerStarted","Data":"1e7a6664b5a16f8e4e8691bcf0be974a14cb3cf364ea5b185d889e5879f34d97"} Jul 02 19:06:22.753192 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:22.752750 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z7ljn" event={"ID":"9f104f54-b9ee-4ceb-acc5-01a18ddfebe4","Type":"ContainerStarted","Data":"d01e83fa5dc9072aea7832cf844329939a72d21ebdb48246d79bd846304865a7"} Jul 02 19:06:22.753754 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:22.753732 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nth4p" event={"ID":"2a84becc-fd52-4aff-938e-87560dcba2b8","Type":"ContainerStarted","Data":"1fffd7d523426af58372458484dacdd64921800a28eaf7d46361bbecd06087a8"} Jul 02 19:06:22.938459 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:22.938416 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:23.750951 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:23.750861 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:24.288272 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.288232 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:24.395034 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.395003 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:24.402544 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.402515 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7f7554c578-xwxrn"] Jul 02 19:06:24.405312 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.405270 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" Jul 02 19:06:24.407967 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.407943 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 02 19:06:24.408374 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.408175 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 02 19:06:24.408374 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.408236 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-xlpnk\"" Jul 02 19:06:24.408374 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.408244 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 02 19:06:24.408626 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.408389 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 02 19:06:24.408626 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.408517 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5e8l1namkp6sr\"" Jul 02 19:06:24.408836 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.408793 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 02 19:06:24.419993 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.419942 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f7554c578-xwxrn"] Jul 02 19:06:24.480545 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.480511 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8fe564a4-0d37-4e82-9fa4-c0a979068141-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f7554c578-xwxrn\" (UID: \"8fe564a4-0d37-4e82-9fa4-c0a979068141\") " pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" Jul 02 19:06:24.480726 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.480559 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fe564a4-0d37-4e82-9fa4-c0a979068141-metrics-client-ca\") pod \"thanos-querier-7f7554c578-xwxrn\" (UID: \"8fe564a4-0d37-4e82-9fa4-c0a979068141\") " pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" Jul 02 19:06:24.480726 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.480625 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8fe564a4-0d37-4e82-9fa4-c0a979068141-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f7554c578-xwxrn\" (UID: \"8fe564a4-0d37-4e82-9fa4-c0a979068141\") " pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" Jul 02 19:06:24.480726 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.480659 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8fe564a4-0d37-4e82-9fa4-c0a979068141-secret-grpc-tls\") pod \"thanos-querier-7f7554c578-xwxrn\" (UID: \"8fe564a4-0d37-4e82-9fa4-c0a979068141\") " pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" Jul 02 19:06:24.480726 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.480696 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8fe564a4-0d37-4e82-9fa4-c0a979068141-secret-thanos-querier-tls\") pod \"thanos-querier-7f7554c578-xwxrn\" (UID: \"8fe564a4-0d37-4e82-9fa4-c0a979068141\") " pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" Jul 02 19:06:24.480953 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.480725 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8fe564a4-0d37-4e82-9fa4-c0a979068141-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f7554c578-xwxrn\" (UID: \"8fe564a4-0d37-4e82-9fa4-c0a979068141\") " pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" Jul 02 19:06:24.480953 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.480756 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2p2l\" (UniqueName: \"kubernetes.io/projected/8fe564a4-0d37-4e82-9fa4-c0a979068141-kube-api-access-g2p2l\") pod \"thanos-querier-7f7554c578-xwxrn\" (UID: \"8fe564a4-0d37-4e82-9fa4-c0a979068141\") " pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" Jul 02 19:06:24.480953 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.480784 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8fe564a4-0d37-4e82-9fa4-c0a979068141-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f7554c578-xwxrn\" (UID: \"8fe564a4-0d37-4e82-9fa4-c0a979068141\") " pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" Jul 02 19:06:24.582056 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.581967 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8fe564a4-0d37-4e82-9fa4-c0a979068141-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f7554c578-xwxrn\" (UID: \"8fe564a4-0d37-4e82-9fa4-c0a979068141\") " pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" Jul 02 19:06:24.582056 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.582015 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8fe564a4-0d37-4e82-9fa4-c0a979068141-secret-grpc-tls\") pod \"thanos-querier-7f7554c578-xwxrn\" (UID: \"8fe564a4-0d37-4e82-9fa4-c0a979068141\") " pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" Jul 02 19:06:24.582056 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.582045 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8fe564a4-0d37-4e82-9fa4-c0a979068141-secret-thanos-querier-tls\") pod \"thanos-querier-7f7554c578-xwxrn\" (UID: \"8fe564a4-0d37-4e82-9fa4-c0a979068141\") " pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" Jul 02 19:06:24.582309 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.582069 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8fe564a4-0d37-4e82-9fa4-c0a979068141-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f7554c578-xwxrn\" (UID: \"8fe564a4-0d37-4e82-9fa4-c0a979068141\") " pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" Jul 02 19:06:24.582309 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.582094 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2p2l\" (UniqueName: \"kubernetes.io/projected/8fe564a4-0d37-4e82-9fa4-c0a979068141-kube-api-access-g2p2l\") pod \"thanos-querier-7f7554c578-xwxrn\" (UID: \"8fe564a4-0d37-4e82-9fa4-c0a979068141\") " pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" Jul 02 19:06:24.582309 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.582124 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8fe564a4-0d37-4e82-9fa4-c0a979068141-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f7554c578-xwxrn\" (UID: \"8fe564a4-0d37-4e82-9fa4-c0a979068141\") " pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" Jul 02 19:06:24.582309 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.582181 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8fe564a4-0d37-4e82-9fa4-c0a979068141-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f7554c578-xwxrn\" (UID: \"8fe564a4-0d37-4e82-9fa4-c0a979068141\") " pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" Jul 02 19:06:24.582309 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.582209 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fe564a4-0d37-4e82-9fa4-c0a979068141-metrics-client-ca\") pod \"thanos-querier-7f7554c578-xwxrn\" (UID: \"8fe564a4-0d37-4e82-9fa4-c0a979068141\") " pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" Jul 02 19:06:24.583561 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.583501 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fe564a4-0d37-4e82-9fa4-c0a979068141-metrics-client-ca\") pod \"thanos-querier-7f7554c578-xwxrn\" (UID: \"8fe564a4-0d37-4e82-9fa4-c0a979068141\") " pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" Jul 02 19:06:24.586976 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.586919 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8fe564a4-0d37-4e82-9fa4-c0a979068141-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f7554c578-xwxrn\" (UID: \"8fe564a4-0d37-4e82-9fa4-c0a979068141\") " pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" Jul 02 19:06:24.588481 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.588453 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8fe564a4-0d37-4e82-9fa4-c0a979068141-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f7554c578-xwxrn\" (UID: \"8fe564a4-0d37-4e82-9fa4-c0a979068141\") " pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" Jul 02 19:06:24.588653 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.588628 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8fe564a4-0d37-4e82-9fa4-c0a979068141-secret-thanos-querier-tls\") pod \"thanos-querier-7f7554c578-xwxrn\" (UID: \"8fe564a4-0d37-4e82-9fa4-c0a979068141\") " pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" Jul 02 19:06:24.589105 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.589074 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8fe564a4-0d37-4e82-9fa4-c0a979068141-secret-grpc-tls\") pod \"thanos-querier-7f7554c578-xwxrn\" (UID: \"8fe564a4-0d37-4e82-9fa4-c0a979068141\") " pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" Jul 02 19:06:24.589199 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.589117 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8fe564a4-0d37-4e82-9fa4-c0a979068141-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f7554c578-xwxrn\" (UID: \"8fe564a4-0d37-4e82-9fa4-c0a979068141\") " pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" Jul 02 19:06:24.589329 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.589303 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8fe564a4-0d37-4e82-9fa4-c0a979068141-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f7554c578-xwxrn\" (UID: \"8fe564a4-0d37-4e82-9fa4-c0a979068141\") " pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" Jul 02 19:06:24.592630 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.592606 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2p2l\" (UniqueName: \"kubernetes.io/projected/8fe564a4-0d37-4e82-9fa4-c0a979068141-kube-api-access-g2p2l\") pod \"thanos-querier-7f7554c578-xwxrn\" (UID: \"8fe564a4-0d37-4e82-9fa4-c0a979068141\") " pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" Jul 02 19:06:24.708450 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.708401 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:24.717817 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:24.717788 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" Jul 02 19:06:25.608947 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:25.608910 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:26.149708 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:26.149670 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:26.243081 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:26.243049 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:26.329269 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:26.329235 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:27.606172 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.606124 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:27.616478 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.615978 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 19:06:27.622942 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.622911 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.626133 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.626112 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 19:06:27.626880 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.626724 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 19:06:27.627024 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.626934 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 19:06:27.627618 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.627191 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 19:06:27.627618 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.627604 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 19:06:27.628011 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.627872 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 19:06:27.628011 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.627885 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 19:06:27.628128 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.628071 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 19:06:27.628128 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.628122 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 19:06:27.628247 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.628126 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 19:06:27.628247 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.628217 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mgwnp\"" Jul 02 19:06:27.628463 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.628443 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 19:06:27.628579 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.628567 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cghtl0j3dfihp\"" Jul 02 19:06:27.628816 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.628792 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 02 19:06:27.628922 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.628885 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 19:06:27.628980 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.628794 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 19:06:27.630831 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.630660 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 19:06:27.645331 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.645310 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 19:06:27.709052 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.709018 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.709243 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.709063 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.709243 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.709093 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.709243 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.709165 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.709415 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.709269 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bsrq\" (UniqueName: \"kubernetes.io/projected/2e73306b-987b-4fcb-9046-095712301f40-kube-api-access-7bsrq\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.709415 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.709299 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.709415 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.709318 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-config\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.709415 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.709342 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.709415 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.709388 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.709636 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.709427 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.709636 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.709462 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.709636 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.709515 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e73306b-987b-4fcb-9046-095712301f40-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.709636 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.709549 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-web-config\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.709636 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.709574 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2e73306b-987b-4fcb-9046-095712301f40-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.709636 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.709601 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e73306b-987b-4fcb-9046-095712301f40-config-out\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.709636 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.709625 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.709953 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.709650 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.709953 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.709700 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.709953 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.709731 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.709953 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.709746 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.745749 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.745717 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:27.811055 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.811024 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bsrq\" (UniqueName: \"kubernetes.io/projected/2e73306b-987b-4fcb-9046-095712301f40-kube-api-access-7bsrq\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.811244 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.811073 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.811244 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.811097 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-config\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.811244 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.811119 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.811244 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.811151 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.811244 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.811167 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.811244 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.811186 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.811244 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.811227 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e73306b-987b-4fcb-9046-095712301f40-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.811575 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.811253 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-web-config\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.811575 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.811279 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2e73306b-987b-4fcb-9046-095712301f40-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.811575 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.811304 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e73306b-987b-4fcb-9046-095712301f40-config-out\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.811575 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.811327 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.811575 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.811347 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.811575 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.811380 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.811575 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.811407 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.811575 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.811429 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.811575 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.811464 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.811575 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.811504 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.811575 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.811532 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.811575 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.811563 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.812168 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.811827 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.814290 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.812356 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.814290 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.812553 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.814290 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.812784 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.814290 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.812906 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.816139 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.816111 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.816312 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.816286 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.817127 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.816866 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.817127 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.816946 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.817127 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.817050 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2e73306b-987b-4fcb-9046-095712301f40-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.817127 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.817107 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e73306b-987b-4fcb-9046-095712301f40-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.817381 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.817283 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e73306b-987b-4fcb-9046-095712301f40-config-out\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.817475 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.817452 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-config\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.817809 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.817787 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.818073 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.818031 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.818176 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.818071 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-web-config\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.818275 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.818253 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.818723 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.818684 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.819688 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.819671 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.826429 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.826408 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bsrq\" (UniqueName: \"kubernetes.io/projected/2e73306b-987b-4fcb-9046-095712301f40-kube-api-access-7bsrq\") pod \"prometheus-k8s-0\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:27.934689 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:27.934598 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:28.817835 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:28.817780 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:28.918958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:28.918930 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:30.287012 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:30.286964 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:30.386609 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:30.386576 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:30.968188 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:30.963515 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-588b585fb5-84q6s"] Jul 02 19:06:31.085253 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:31.085214 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 19:06:31.088305 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:06:31.088273 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e73306b_987b_4fcb_9046_095712301f40.slice/crio-f294907ebe813b9092acbf230ca53de6e724c0b2c786bcbba6bc52f91a9978ce WatchSource:0}: Error finding container f294907ebe813b9092acbf230ca53de6e724c0b2c786bcbba6bc52f91a9978ce: Status 404 returned error can't find the container with id f294907ebe813b9092acbf230ca53de6e724c0b2c786bcbba6bc52f91a9978ce Jul 02 19:06:31.090466 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:31.090446 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:31.096994 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:31.096973 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f7554c578-xwxrn"] Jul 02 19:06:31.153870 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:06:31.153824 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fe564a4_0d37_4e82_9fa4_c0a979068141.slice/crio-637fa4df756a2ef123b1a96c488fa4fb0b5a63e101585dbbba5d04fddc1ebf52 WatchSource:0}: Error finding container 637fa4df756a2ef123b1a96c488fa4fb0b5a63e101585dbbba5d04fddc1ebf52: Status 404 returned error can't find the container with id 637fa4df756a2ef123b1a96c488fa4fb0b5a63e101585dbbba5d04fddc1ebf52 Jul 02 19:06:31.187930 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:31.187836 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:31.288402 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:31.288371 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:31.794918 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:31.794878 2559 generic.go:356] "Generic (PLEG): container finished" podID="2a84becc-fd52-4aff-938e-87560dcba2b8" containerID="2fd4ed9c53abebfb0c662da8a83da39602eca12f238be75be37b782d9a225d21" exitCode=0 Jul 02 19:06:31.795116 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:31.794977 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nth4p" event={"ID":"2a84becc-fd52-4aff-938e-87560dcba2b8","Type":"ContainerDied","Data":"2fd4ed9c53abebfb0c662da8a83da39602eca12f238be75be37b782d9a225d21"} Jul 02 19:06:31.800451 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:31.800411 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z7ljn" event={"ID":"9f104f54-b9ee-4ceb-acc5-01a18ddfebe4","Type":"ContainerStarted","Data":"ea3f4b92ddbda913c583d5cd826191620515b316c95a1c4ebc0b0dff981c3fda"} Jul 02 19:06:31.802835 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:31.802811 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" event={"ID":"8fe564a4-0d37-4e82-9fa4-c0a979068141","Type":"ContainerStarted","Data":"637fa4df756a2ef123b1a96c488fa4fb0b5a63e101585dbbba5d04fddc1ebf52"} Jul 02 19:06:31.807332 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:31.807117 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-pgcqf" event={"ID":"357ddcc5-5598-480d-98b3-9a9f5427ba9d","Type":"ContainerStarted","Data":"5cf304b415764f96048e03f1a07a4c9b25ca59d08de7b4e7bffac72382f1af00"} Jul 02 19:06:31.811290 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:31.808616 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-pgcqf" Jul 02 19:06:31.811290 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:31.809833 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2e73306b-987b-4fcb-9046-095712301f40","Type":"ContainerStarted","Data":"f294907ebe813b9092acbf230ca53de6e724c0b2c786bcbba6bc52f91a9978ce"} Jul 02 19:06:31.814218 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:31.814121 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-pgcqf" Jul 02 19:06:31.834011 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:31.833837 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-z7ljn" podStartSLOduration=2.548578807 podStartE2EDuration="10.833815224s" totalImagesPullingTime="8.285236417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:31.833781962 +0000 UTC m=+319.495751116" watchObservedRunningTime="2026-07-02 19:06:31.833815224 +0000 UTC m=+319.495784377" Jul 02 19:06:31.854061 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:31.853905 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-pgcqf" podStartSLOduration=1.791704926 podStartE2EDuration="23.853837586s" totalImagesPullingTime="22.06213266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:06:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:31.852033622 +0000 UTC m=+319.514002774" watchObservedRunningTime="2026-07-02 19:06:31.853837586 +0000 UTC m=+319.515806737" Jul 02 19:06:32.818233 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:32.817945 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nth4p" event={"ID":"2a84becc-fd52-4aff-938e-87560dcba2b8","Type":"ContainerStarted","Data":"1dedddf5f3aaef6c0c575c630ad772cf76fae102f42106b26fabbdadde74d8a9"} Jul 02 19:06:32.818233 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:32.818010 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nth4p" event={"ID":"2a84becc-fd52-4aff-938e-87560dcba2b8","Type":"ContainerStarted","Data":"79e3f61de9447aaa86058de3438ea49e7da9d2c327fb18121be99e0800f21dd0"} Jul 02 19:06:32.839180 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:32.839118 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nth4p" podStartSLOduration=3.48375293 podStartE2EDuration="11.839099207s" totalImagesPullingTime="8.276413398s" totalInitContainerRuntime="78.932879ms" isStatefulPod=true podCreationTimestamp="2026-07-02 19:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:32.837281149 +0000 UTC m=+320.499250300" watchObservedRunningTime="2026-07-02 19:06:32.839099207 +0000 UTC m=+320.501068360" Jul 02 19:06:34.829607 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:34.829531 2559 generic.go:356] "Generic (PLEG): container finished" podID="2e73306b-987b-4fcb-9046-095712301f40" containerID="85fbd7a0d8d7cfe88fccac256d9d19a940f0ceb10775714e62783f0a74c92deb" exitCode=0 Jul 02 19:06:34.830134 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:34.829618 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2e73306b-987b-4fcb-9046-095712301f40","Type":"ContainerDied","Data":"85fbd7a0d8d7cfe88fccac256d9d19a940f0ceb10775714e62783f0a74c92deb"} Jul 02 19:06:34.832558 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:34.832534 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" event={"ID":"8fe564a4-0d37-4e82-9fa4-c0a979068141","Type":"ContainerStarted","Data":"d1e97e1903901d72fa0a0025e5fbe63d19d4e0cea28c7473cd71d8c06274cb2e"} Jul 02 19:06:34.833581 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:34.833561 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" event={"ID":"8fe564a4-0d37-4e82-9fa4-c0a979068141","Type":"ContainerStarted","Data":"feb09b932553f37b515801090af9b1747f30af69de1087d14d1cfd08919fc1a5"} Jul 02 19:06:34.833706 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:34.833692 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" event={"ID":"8fe564a4-0d37-4e82-9fa4-c0a979068141","Type":"ContainerStarted","Data":"2a2b24338b879d5107144117e80406cc3c03a4b04d0e445847f21e44f415f137"} Jul 02 19:06:36.153999 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:36.153959 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:36.206804 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:36.206766 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:36.572127 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:36.572065 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:36.672784 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:36.672755 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:36.847577 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:36.847494 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" event={"ID":"8fe564a4-0d37-4e82-9fa4-c0a979068141","Type":"ContainerStarted","Data":"ea602dfb5566db9e6d9fd18a1012877e144bb8d8213f11bd519094afedec5fae"} Jul 02 19:06:36.847747 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:36.847612 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" event={"ID":"8fe564a4-0d37-4e82-9fa4-c0a979068141","Type":"ContainerStarted","Data":"71fc7c197c05405ae4ac3943ae084953e864b8f1b375a19d29013a059fb2dd64"} Jul 02 19:06:36.847747 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:36.847659 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" event={"ID":"8fe564a4-0d37-4e82-9fa4-c0a979068141","Type":"ContainerStarted","Data":"2a36b39d84eb38c103ca8cd6a4ef729f5ca34a6c33270a1bb22d0cb7e798fbb1"} Jul 02 19:06:36.847890 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:36.847830 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" Jul 02 19:06:36.874796 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:36.874741 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" podStartSLOduration=8.681953963 podStartE2EDuration="12.8747203s" totalImagesPullingTime="4.192766337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:06:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:36.874268465 +0000 UTC m=+324.536237616" watchObservedRunningTime="2026-07-02 19:06:36.8747203 +0000 UTC m=+324.536689453" Jul 02 19:06:39.865684 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:39.865658 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2e73306b-987b-4fcb-9046-095712301f40","Type":"ContainerStarted","Data":"53edc7aeadc66bbb4fb4f07be2d2e81375597b2a4ca9c350efd923faf8877b6c"} Jul 02 19:06:39.866005 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:39.865720 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2e73306b-987b-4fcb-9046-095712301f40","Type":"ContainerStarted","Data":"ffabab16b708cedfe27489816b2ce85caae7882028ef8cfac118be479ce67820"} Jul 02 19:06:39.866005 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:39.865747 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2e73306b-987b-4fcb-9046-095712301f40","Type":"ContainerStarted","Data":"cec56793d5e333dc272f69dfd225bd3c2046835354803b96589ffd3d24c2210a"} Jul 02 19:06:39.866005 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:39.865772 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2e73306b-987b-4fcb-9046-095712301f40","Type":"ContainerStarted","Data":"eb373c0cd0773878820f0b729fd809580e99924786dddb7b1b462baffa1ec901"} Jul 02 19:06:39.866005 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:39.865795 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2e73306b-987b-4fcb-9046-095712301f40","Type":"ContainerStarted","Data":"0cb8879ba5ca4b1a277ee3d4771a73b421057bcc82a425d0572f72cd7cb7df4a"} Jul 02 19:06:39.866005 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:39.865819 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2e73306b-987b-4fcb-9046-095712301f40","Type":"ContainerStarted","Data":"896d97daacae6ef0f0c0cf9560196830bab55ab3cece83a305227eefb20f52bb"} Jul 02 19:06:40.919437 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:40.919386 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=7.419170799 podStartE2EDuration="13.919371215s" totalImagesPullingTime="6.477682375s" totalInitContainerRuntime="22.518041ms" isStatefulPod=false podCreationTimestamp="2026-07-02 19:06:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:40.918798492 +0000 UTC m=+328.580767641" watchObservedRunningTime="2026-07-02 19:06:40.919371215 +0000 UTC m=+328.581340364" Jul 02 19:06:42.858555 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:42.858530 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7f7554c578-xwxrn" Jul 02 19:06:42.934767 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:42.934739 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:06:43.132200 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:43.132139 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:43.230126 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:43.230102 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:43.329590 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:43.329565 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:43.429384 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:43.429310 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:50.800693 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:50.800657 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:50.887363 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:50.887334 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:55.998306 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:55.998264 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-588b585fb5-84q6s" podUID="7946e8f8-ff35-48d0-bb0a-47711451cb36" containerName="registry" containerID="cri-o://748a5fa05d1c69414ac0f38bbe81b196eeb2e38c110457462c9cf1b4df8dba03" gracePeriod=30 Jul 02 19:06:56.287962 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.287898 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:06:56.358795 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.358759 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7946e8f8-ff35-48d0-bb0a-47711451cb36-trusted-ca\") pod \"7946e8f8-ff35-48d0-bb0a-47711451cb36\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " Jul 02 19:06:56.358982 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.358817 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7946e8f8-ff35-48d0-bb0a-47711451cb36-image-registry-private-configuration\") pod \"7946e8f8-ff35-48d0-bb0a-47711451cb36\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " Jul 02 19:06:56.358982 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.358840 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls\") pod \"7946e8f8-ff35-48d0-bb0a-47711451cb36\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " Jul 02 19:06:56.358982 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.358884 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-bound-sa-token\") pod \"7946e8f8-ff35-48d0-bb0a-47711451cb36\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " Jul 02 19:06:56.358982 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.358913 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-certificates\") pod \"7946e8f8-ff35-48d0-bb0a-47711451cb36\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " Jul 02 19:06:56.359196 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.358993 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7946e8f8-ff35-48d0-bb0a-47711451cb36-installation-pull-secrets\") pod \"7946e8f8-ff35-48d0-bb0a-47711451cb36\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " Jul 02 19:06:56.359196 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.359018 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7946e8f8-ff35-48d0-bb0a-47711451cb36-ca-trust-extracted\") pod \"7946e8f8-ff35-48d0-bb0a-47711451cb36\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " Jul 02 19:06:56.359196 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.359051 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2276j\" (UniqueName: \"kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-kube-api-access-2276j\") pod \"7946e8f8-ff35-48d0-bb0a-47711451cb36\" (UID: \"7946e8f8-ff35-48d0-bb0a-47711451cb36\") " Jul 02 19:06:56.359337 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.359243 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7946e8f8-ff35-48d0-bb0a-47711451cb36-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7946e8f8-ff35-48d0-bb0a-47711451cb36" (UID: "7946e8f8-ff35-48d0-bb0a-47711451cb36"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:06:56.359397 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.359347 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7946e8f8-ff35-48d0-bb0a-47711451cb36-trusted-ca\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:06:56.359741 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.359712 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7946e8f8-ff35-48d0-bb0a-47711451cb36" (UID: "7946e8f8-ff35-48d0-bb0a-47711451cb36"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:06:56.361385 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.361325 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7946e8f8-ff35-48d0-bb0a-47711451cb36" (UID: "7946e8f8-ff35-48d0-bb0a-47711451cb36"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:06:56.361501 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.361414 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7946e8f8-ff35-48d0-bb0a-47711451cb36-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7946e8f8-ff35-48d0-bb0a-47711451cb36" (UID: "7946e8f8-ff35-48d0-bb0a-47711451cb36"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:06:56.361587 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.361567 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7946e8f8-ff35-48d0-bb0a-47711451cb36" (UID: "7946e8f8-ff35-48d0-bb0a-47711451cb36"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:06:56.361670 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.361646 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7946e8f8-ff35-48d0-bb0a-47711451cb36-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7946e8f8-ff35-48d0-bb0a-47711451cb36" (UID: "7946e8f8-ff35-48d0-bb0a-47711451cb36"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:06:56.361727 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.361674 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-kube-api-access-2276j" (OuterVolumeSpecName: "kube-api-access-2276j") pod "7946e8f8-ff35-48d0-bb0a-47711451cb36" (UID: "7946e8f8-ff35-48d0-bb0a-47711451cb36"). InnerVolumeSpecName "kube-api-access-2276j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:06:56.367526 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.367499 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7946e8f8-ff35-48d0-bb0a-47711451cb36-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7946e8f8-ff35-48d0-bb0a-47711451cb36" (UID: "7946e8f8-ff35-48d0-bb0a-47711451cb36"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:06:56.459925 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.459887 2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7946e8f8-ff35-48d0-bb0a-47711451cb36-image-registry-private-configuration\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:06:56.459925 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.459919 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-tls\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:06:56.459925 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.459932 2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-bound-sa-token\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:06:56.460237 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.459946 2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7946e8f8-ff35-48d0-bb0a-47711451cb36-registry-certificates\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:06:56.460237 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.459959 2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7946e8f8-ff35-48d0-bb0a-47711451cb36-installation-pull-secrets\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:06:56.460237 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.459970 2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7946e8f8-ff35-48d0-bb0a-47711451cb36-ca-trust-extracted\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:06:56.460237 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.459981 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2276j\" (UniqueName: \"kubernetes.io/projected/7946e8f8-ff35-48d0-bb0a-47711451cb36-kube-api-access-2276j\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:06:56.928014 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.927982 2559 generic.go:356] "Generic (PLEG): container finished" podID="7946e8f8-ff35-48d0-bb0a-47711451cb36" containerID="748a5fa05d1c69414ac0f38bbe81b196eeb2e38c110457462c9cf1b4df8dba03" exitCode=0 Jul 02 19:06:56.928174 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.928026 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-588b585fb5-84q6s" Jul 02 19:06:56.928174 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.928064 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588b585fb5-84q6s" event={"ID":"7946e8f8-ff35-48d0-bb0a-47711451cb36","Type":"ContainerDied","Data":"748a5fa05d1c69414ac0f38bbe81b196eeb2e38c110457462c9cf1b4df8dba03"} Jul 02 19:06:56.928174 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.928104 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588b585fb5-84q6s" event={"ID":"7946e8f8-ff35-48d0-bb0a-47711451cb36","Type":"ContainerDied","Data":"6638ddd66b10e518f5b1aa4ba208f3442d48d6eff4ec99d9177229c2f1e2602d"} Jul 02 19:06:56.928174 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.928123 2559 scope.go:117] "RemoveContainer" containerID="748a5fa05d1c69414ac0f38bbe81b196eeb2e38c110457462c9cf1b4df8dba03" Jul 02 19:06:56.936419 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.936400 2559 scope.go:117] "RemoveContainer" containerID="748a5fa05d1c69414ac0f38bbe81b196eeb2e38c110457462c9cf1b4df8dba03" Jul 02 19:06:56.936678 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:06:56.936657 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"748a5fa05d1c69414ac0f38bbe81b196eeb2e38c110457462c9cf1b4df8dba03\": container with ID starting with 748a5fa05d1c69414ac0f38bbe81b196eeb2e38c110457462c9cf1b4df8dba03 not found: ID does not exist" containerID="748a5fa05d1c69414ac0f38bbe81b196eeb2e38c110457462c9cf1b4df8dba03" Jul 02 19:06:56.936722 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.936687 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"748a5fa05d1c69414ac0f38bbe81b196eeb2e38c110457462c9cf1b4df8dba03"} err="failed to get container status \"748a5fa05d1c69414ac0f38bbe81b196eeb2e38c110457462c9cf1b4df8dba03\": rpc error: code = NotFound desc = could not find container \"748a5fa05d1c69414ac0f38bbe81b196eeb2e38c110457462c9cf1b4df8dba03\": container with ID starting with 748a5fa05d1c69414ac0f38bbe81b196eeb2e38c110457462c9cf1b4df8dba03 not found: ID does not exist" Jul 02 19:06:56.952146 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.952122 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-588b585fb5-84q6s"] Jul 02 19:06:56.956764 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:56.956744 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-588b585fb5-84q6s"] Jul 02 19:06:58.107455 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:58.107424 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:58.180443 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:58.180416 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:06:58.884718 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:06:58.884687 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7946e8f8-ff35-48d0-bb0a-47711451cb36" path="/var/lib/kubelet/pods/7946e8f8-ff35-48d0-bb0a-47711451cb36/volumes" Jul 02 19:07:11.207496 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:11.207426 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:13.117615 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:13.117588 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:13.181488 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:13.181455 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:26.708236 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:26.708203 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs\") pod \"network-metrics-daemon-2lpws\" (UID: \"7d6e7a30-d495-4e43-bba9-c9fda98277d9\") " pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:07:26.710472 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:26.710443 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d6e7a30-d495-4e43-bba9-c9fda98277d9-metrics-certs\") pod \"network-metrics-daemon-2lpws\" (UID: \"7d6e7a30-d495-4e43-bba9-c9fda98277d9\") " pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:07:26.985074 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:26.985004 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h66dc\"" Jul 02 19:07:26.993003 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:26.992975 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lpws" Jul 02 19:07:27.148521 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:27.148488 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2lpws"] Jul 02 19:07:27.151715 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:07:27.151688 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d6e7a30_d495_4e43_bba9_c9fda98277d9.slice/crio-f340eaa0fa06bed418a811698583c6679295ae2a10af0380cd7d9079d3830216 WatchSource:0}: Error finding container f340eaa0fa06bed418a811698583c6679295ae2a10af0380cd7d9079d3830216: Status 404 returned error can't find the container with id f340eaa0fa06bed418a811698583c6679295ae2a10af0380cd7d9079d3830216 Jul 02 19:07:27.935645 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:27.935606 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:27.969948 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:27.967537 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:28.041240 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:28.041195 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2lpws" event={"ID":"7d6e7a30-d495-4e43-bba9-c9fda98277d9","Type":"ContainerStarted","Data":"f340eaa0fa06bed418a811698583c6679295ae2a10af0380cd7d9079d3830216"} Jul 02 19:07:28.057783 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:28.057730 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:29.052742 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:29.052698 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2lpws" event={"ID":"7d6e7a30-d495-4e43-bba9-c9fda98277d9","Type":"ContainerStarted","Data":"637057562e5f4ba4abcb2fe2bfee3d2b34f8c973fcc3058aadd947a8363de378"} Jul 02 19:07:29.053331 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:29.052768 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2lpws" event={"ID":"7d6e7a30-d495-4e43-bba9-c9fda98277d9","Type":"ContainerStarted","Data":"45ba2ac623fda9b51323da57325fedd5d7fbc213127085c79ee4ecb8b0d000f5"} Jul 02 19:07:29.072547 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:29.071541 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2lpws" podStartSLOduration=374.93500617 podStartE2EDuration="6m16.071521914s" totalImagesPullingTime="1.136515744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:07:29.070280427 +0000 UTC m=+376.732249577" watchObservedRunningTime="2026-07-02 19:07:29.071521914 +0000 UTC m=+376.733491065" Jul 02 19:07:29.164502 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:29.164380 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:29.262429 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:29.262394 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:30.326376 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:30.326335 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:30.384408 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:30.384385 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:30.443090 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:30.443064 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:37.435007 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:37.434977 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:37.491707 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:37.491675 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:40.242624 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:40.242591 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:40.302626 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:40.302603 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:45.968092 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:45.968060 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 19:07:45.968614 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:45.968557 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2e73306b-987b-4fcb-9046-095712301f40" containerName="prometheus" containerID="cri-o://896d97daacae6ef0f0c0cf9560196830bab55ab3cece83a305227eefb20f52bb" gracePeriod=600 Jul 02 19:07:45.968707 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:45.968592 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2e73306b-987b-4fcb-9046-095712301f40" containerName="kube-rbac-proxy-thanos" containerID="cri-o://53edc7aeadc66bbb4fb4f07be2d2e81375597b2a4ca9c350efd923faf8877b6c" gracePeriod=600 Jul 02 19:07:45.968707 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:45.968637 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2e73306b-987b-4fcb-9046-095712301f40" containerName="kube-rbac-proxy-web" containerID="cri-o://cec56793d5e333dc272f69dfd225bd3c2046835354803b96589ffd3d24c2210a" gracePeriod=600 Jul 02 19:07:45.968707 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:45.968686 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2e73306b-987b-4fcb-9046-095712301f40" containerName="config-reloader" containerID="cri-o://0cb8879ba5ca4b1a277ee3d4771a73b421057bcc82a425d0572f72cd7cb7df4a" gracePeriod=600 Jul 02 19:07:45.968883 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:45.968736 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2e73306b-987b-4fcb-9046-095712301f40" containerName="thanos-sidecar" containerID="cri-o://eb373c0cd0773878820f0b729fd809580e99924786dddb7b1b462baffa1ec901" gracePeriod=600 Jul 02 19:07:45.968883 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:45.968649 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2e73306b-987b-4fcb-9046-095712301f40" containerName="kube-rbac-proxy" containerID="cri-o://ffabab16b708cedfe27489816b2ce85caae7882028ef8cfac118be479ce67820" gracePeriod=600 Jul 02 19:07:46.114091 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:46.114065 2559 generic.go:356] "Generic (PLEG): container finished" podID="2e73306b-987b-4fcb-9046-095712301f40" containerID="53edc7aeadc66bbb4fb4f07be2d2e81375597b2a4ca9c350efd923faf8877b6c" exitCode=0 Jul 02 19:07:46.114091 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:46.114087 2559 generic.go:356] "Generic (PLEG): container finished" podID="2e73306b-987b-4fcb-9046-095712301f40" containerID="ffabab16b708cedfe27489816b2ce85caae7882028ef8cfac118be479ce67820" exitCode=0 Jul 02 19:07:46.114091 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:46.114094 2559 generic.go:356] "Generic (PLEG): container finished" podID="2e73306b-987b-4fcb-9046-095712301f40" containerID="eb373c0cd0773878820f0b729fd809580e99924786dddb7b1b462baffa1ec901" exitCode=0 Jul 02 19:07:46.114301 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:46.114100 2559 generic.go:356] "Generic (PLEG): container finished" podID="2e73306b-987b-4fcb-9046-095712301f40" containerID="0cb8879ba5ca4b1a277ee3d4771a73b421057bcc82a425d0572f72cd7cb7df4a" exitCode=0 Jul 02 19:07:46.114301 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:46.114105 2559 generic.go:356] "Generic (PLEG): container finished" podID="2e73306b-987b-4fcb-9046-095712301f40" containerID="896d97daacae6ef0f0c0cf9560196830bab55ab3cece83a305227eefb20f52bb" exitCode=0 Jul 02 19:07:46.114301 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:46.114132 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2e73306b-987b-4fcb-9046-095712301f40","Type":"ContainerDied","Data":"53edc7aeadc66bbb4fb4f07be2d2e81375597b2a4ca9c350efd923faf8877b6c"} Jul 02 19:07:46.114301 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:46.114196 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2e73306b-987b-4fcb-9046-095712301f40","Type":"ContainerDied","Data":"ffabab16b708cedfe27489816b2ce85caae7882028ef8cfac118be479ce67820"} Jul 02 19:07:46.114301 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:46.114223 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2e73306b-987b-4fcb-9046-095712301f40","Type":"ContainerDied","Data":"eb373c0cd0773878820f0b729fd809580e99924786dddb7b1b462baffa1ec901"} Jul 02 19:07:46.114301 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:46.114250 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2e73306b-987b-4fcb-9046-095712301f40","Type":"ContainerDied","Data":"0cb8879ba5ca4b1a277ee3d4771a73b421057bcc82a425d0572f72cd7cb7df4a"} Jul 02 19:07:46.114301 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:46.114273 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2e73306b-987b-4fcb-9046-095712301f40","Type":"ContainerDied","Data":"896d97daacae6ef0f0c0cf9560196830bab55ab3cece83a305227eefb20f52bb"} Jul 02 19:07:47.123036 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.123010 2559 generic.go:356] "Generic (PLEG): container finished" podID="2e73306b-987b-4fcb-9046-095712301f40" containerID="cec56793d5e333dc272f69dfd225bd3c2046835354803b96589ffd3d24c2210a" exitCode=0 Jul 02 19:07:47.123355 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.123084 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2e73306b-987b-4fcb-9046-095712301f40","Type":"ContainerDied","Data":"cec56793d5e333dc272f69dfd225bd3c2046835354803b96589ffd3d24c2210a"} Jul 02 19:07:47.213726 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.213705 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:47.270133 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.270111 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-metrics-client-certs\") pod \"2e73306b-987b-4fcb-9046-095712301f40\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " Jul 02 19:07:47.270284 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.270142 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-prometheus-trusted-ca-bundle\") pod \"2e73306b-987b-4fcb-9046-095712301f40\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " Jul 02 19:07:47.270284 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.270162 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-config\") pod \"2e73306b-987b-4fcb-9046-095712301f40\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " Jul 02 19:07:47.270284 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.270184 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-prometheus-k8s-rulefiles-0\") pod \"2e73306b-987b-4fcb-9046-095712301f40\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " Jul 02 19:07:47.270284 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.270214 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"2e73306b-987b-4fcb-9046-095712301f40\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " Jul 02 19:07:47.270284 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.270242 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-configmap-kubelet-serving-ca-bundle\") pod \"2e73306b-987b-4fcb-9046-095712301f40\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " Jul 02 19:07:47.270284 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.270267 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-prometheus-k8s-rulefiles-2\") pod \"2e73306b-987b-4fcb-9046-095712301f40\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " Jul 02 19:07:47.270585 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.270294 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-thanos-prometheus-http-client-file\") pod \"2e73306b-987b-4fcb-9046-095712301f40\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " Jul 02 19:07:47.270585 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.270342 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-configmap-metrics-client-ca\") pod \"2e73306b-987b-4fcb-9046-095712301f40\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " Jul 02 19:07:47.270585 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.270379 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"2e73306b-987b-4fcb-9046-095712301f40\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " Jul 02 19:07:47.270585 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.270404 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e73306b-987b-4fcb-9046-095712301f40-tls-assets\") pod \"2e73306b-987b-4fcb-9046-095712301f40\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " Jul 02 19:07:47.270585 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.270431 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-configmap-serving-certs-ca-bundle\") pod \"2e73306b-987b-4fcb-9046-095712301f40\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " Jul 02 19:07:47.270585 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.270458 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-kube-rbac-proxy\") pod \"2e73306b-987b-4fcb-9046-095712301f40\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " Jul 02 19:07:47.270585 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.270487 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bsrq\" (UniqueName: \"kubernetes.io/projected/2e73306b-987b-4fcb-9046-095712301f40-kube-api-access-7bsrq\") pod \"2e73306b-987b-4fcb-9046-095712301f40\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " Jul 02 19:07:47.270585 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.270511 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-prometheus-k8s-tls\") pod \"2e73306b-987b-4fcb-9046-095712301f40\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " Jul 02 19:07:47.270585 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.270551 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-web-config\") pod \"2e73306b-987b-4fcb-9046-095712301f40\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " Jul 02 19:07:47.270585 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.270583 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-prometheus-k8s-rulefiles-1\") pod \"2e73306b-987b-4fcb-9046-095712301f40\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " Jul 02 19:07:47.271095 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.270631 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2e73306b-987b-4fcb-9046-095712301f40-prometheus-k8s-db\") pod \"2e73306b-987b-4fcb-9046-095712301f40\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " Jul 02 19:07:47.271095 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.270678 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e73306b-987b-4fcb-9046-095712301f40-config-out\") pod \"2e73306b-987b-4fcb-9046-095712301f40\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " Jul 02 19:07:47.271095 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.270675 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "2e73306b-987b-4fcb-9046-095712301f40" (UID: "2e73306b-987b-4fcb-9046-095712301f40"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:07:47.271095 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.270707 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-grpc-tls\") pod \"2e73306b-987b-4fcb-9046-095712301f40\" (UID: \"2e73306b-987b-4fcb-9046-095712301f40\") " Jul 02 19:07:47.271095 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.270977 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:07:47.271095 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.270998 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "2e73306b-987b-4fcb-9046-095712301f40" (UID: "2e73306b-987b-4fcb-9046-095712301f40"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:07:47.272268 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.271710 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "2e73306b-987b-4fcb-9046-095712301f40" (UID: "2e73306b-987b-4fcb-9046-095712301f40"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:07:47.272268 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.272035 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "2e73306b-987b-4fcb-9046-095712301f40" (UID: "2e73306b-987b-4fcb-9046-095712301f40"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:07:47.272471 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.272443 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "2e73306b-987b-4fcb-9046-095712301f40" (UID: "2e73306b-987b-4fcb-9046-095712301f40"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:07:47.273009 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.272953 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "2e73306b-987b-4fcb-9046-095712301f40" (UID: "2e73306b-987b-4fcb-9046-095712301f40"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:07:47.273009 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.272953 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e73306b-987b-4fcb-9046-095712301f40-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "2e73306b-987b-4fcb-9046-095712301f40" (UID: "2e73306b-987b-4fcb-9046-095712301f40"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:07:47.273231 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.273192 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-config" (OuterVolumeSpecName: "config") pod "2e73306b-987b-4fcb-9046-095712301f40" (UID: "2e73306b-987b-4fcb-9046-095712301f40"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:07:47.273395 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.273366 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "2e73306b-987b-4fcb-9046-095712301f40" (UID: "2e73306b-987b-4fcb-9046-095712301f40"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:07:47.273759 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.273722 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "2e73306b-987b-4fcb-9046-095712301f40" (UID: "2e73306b-987b-4fcb-9046-095712301f40"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:07:47.276122 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.276093 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "2e73306b-987b-4fcb-9046-095712301f40" (UID: "2e73306b-987b-4fcb-9046-095712301f40"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:07:47.276313 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.276285 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "2e73306b-987b-4fcb-9046-095712301f40" (UID: "2e73306b-987b-4fcb-9046-095712301f40"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:07:47.276590 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.276557 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "2e73306b-987b-4fcb-9046-095712301f40" (UID: "2e73306b-987b-4fcb-9046-095712301f40"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:07:47.276683 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.276642 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "2e73306b-987b-4fcb-9046-095712301f40" (UID: "2e73306b-987b-4fcb-9046-095712301f40"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:07:47.276754 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.276724 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e73306b-987b-4fcb-9046-095712301f40-config-out" (OuterVolumeSpecName: "config-out") pod "2e73306b-987b-4fcb-9046-095712301f40" (UID: "2e73306b-987b-4fcb-9046-095712301f40"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:07:47.276812 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.276751 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e73306b-987b-4fcb-9046-095712301f40-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2e73306b-987b-4fcb-9046-095712301f40" (UID: "2e73306b-987b-4fcb-9046-095712301f40"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:07:47.276914 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.276889 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e73306b-987b-4fcb-9046-095712301f40-kube-api-access-7bsrq" (OuterVolumeSpecName: "kube-api-access-7bsrq") pod "2e73306b-987b-4fcb-9046-095712301f40" (UID: "2e73306b-987b-4fcb-9046-095712301f40"). InnerVolumeSpecName "kube-api-access-7bsrq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:07:47.277005 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.276986 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "2e73306b-987b-4fcb-9046-095712301f40" (UID: "2e73306b-987b-4fcb-9046-095712301f40"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:07:47.277157 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.277136 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "2e73306b-987b-4fcb-9046-095712301f40" (UID: "2e73306b-987b-4fcb-9046-095712301f40"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:07:47.288982 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.288956 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-web-config" (OuterVolumeSpecName: "web-config") pod "2e73306b-987b-4fcb-9046-095712301f40" (UID: "2e73306b-987b-4fcb-9046-095712301f40"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:07:47.371342 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.371312 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-web-config\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:07:47.371342 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.371337 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:07:47.371342 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.371348 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2e73306b-987b-4fcb-9046-095712301f40-prometheus-k8s-db\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:07:47.371554 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.371359 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e73306b-987b-4fcb-9046-095712301f40-config-out\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:07:47.371554 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.371367 2559 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-grpc-tls\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:07:47.371554 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.371375 2559 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-metrics-client-certs\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:07:47.371554 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.371383 2559 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-config\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:07:47.371554 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.371390 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:07:47.371554 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.371400 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:07:47.371554 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.371409 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:07:47.371554 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.371417 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:07:47.371554 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.371425 2559 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:07:47.371554 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.371435 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-configmap-metrics-client-ca\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:07:47.371554 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.371443 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:07:47.371554 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.371451 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e73306b-987b-4fcb-9046-095712301f40-tls-assets\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:07:47.371554 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.371459 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e73306b-987b-4fcb-9046-095712301f40-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:07:47.371554 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.371467 2559 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-kube-rbac-proxy\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:07:47.371554 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.371476 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bsrq\" (UniqueName: \"kubernetes.io/projected/2e73306b-987b-4fcb-9046-095712301f40-kube-api-access-7bsrq\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:07:47.371554 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:47.371491 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2e73306b-987b-4fcb-9046-095712301f40-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:07:48.129798 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.129766 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2e73306b-987b-4fcb-9046-095712301f40","Type":"ContainerDied","Data":"f294907ebe813b9092acbf230ca53de6e724c0b2c786bcbba6bc52f91a9978ce"} Jul 02 19:07:48.130154 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.129833 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.130154 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.129843 2559 scope.go:117] "RemoveContainer" containerID="53edc7aeadc66bbb4fb4f07be2d2e81375597b2a4ca9c350efd923faf8877b6c" Jul 02 19:07:48.137635 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.137401 2559 scope.go:117] "RemoveContainer" containerID="ffabab16b708cedfe27489816b2ce85caae7882028ef8cfac118be479ce67820" Jul 02 19:07:48.144356 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.144340 2559 scope.go:117] "RemoveContainer" containerID="cec56793d5e333dc272f69dfd225bd3c2046835354803b96589ffd3d24c2210a" Jul 02 19:07:48.150816 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.150802 2559 scope.go:117] "RemoveContainer" containerID="eb373c0cd0773878820f0b729fd809580e99924786dddb7b1b462baffa1ec901" Jul 02 19:07:48.156999 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.156985 2559 scope.go:117] "RemoveContainer" containerID="0cb8879ba5ca4b1a277ee3d4771a73b421057bcc82a425d0572f72cd7cb7df4a" Jul 02 19:07:48.161982 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.161954 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 19:07:48.164113 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.164068 2559 scope.go:117] "RemoveContainer" containerID="896d97daacae6ef0f0c0cf9560196830bab55ab3cece83a305227eefb20f52bb" Jul 02 19:07:48.170915 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.170898 2559 scope.go:117] "RemoveContainer" containerID="85fbd7a0d8d7cfe88fccac256d9d19a940f0ceb10775714e62783f0a74c92deb" Jul 02 19:07:48.174952 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.174930 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 19:07:48.217681 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.217654 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 19:07:48.218008 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.217991 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e73306b-987b-4fcb-9046-095712301f40" containerName="kube-rbac-proxy-web" Jul 02 19:07:48.218091 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.218011 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e73306b-987b-4fcb-9046-095712301f40" containerName="kube-rbac-proxy-web" Jul 02 19:07:48.218091 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.218025 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7946e8f8-ff35-48d0-bb0a-47711451cb36" containerName="registry" Jul 02 19:07:48.218091 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.218032 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7946e8f8-ff35-48d0-bb0a-47711451cb36" containerName="registry" Jul 02 19:07:48.218091 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.218050 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e73306b-987b-4fcb-9046-095712301f40" containerName="thanos-sidecar" Jul 02 19:07:48.218091 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.218059 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e73306b-987b-4fcb-9046-095712301f40" containerName="thanos-sidecar" Jul 02 19:07:48.218091 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.218068 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e73306b-987b-4fcb-9046-095712301f40" containerName="kube-rbac-proxy" Jul 02 19:07:48.218091 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.218076 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e73306b-987b-4fcb-9046-095712301f40" containerName="kube-rbac-proxy" Jul 02 19:07:48.218091 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.218087 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e73306b-987b-4fcb-9046-095712301f40" containerName="init-config-reloader" Jul 02 19:07:48.218091 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.218095 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e73306b-987b-4fcb-9046-095712301f40" containerName="init-config-reloader" Jul 02 19:07:48.218499 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.218108 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e73306b-987b-4fcb-9046-095712301f40" containerName="config-reloader" Jul 02 19:07:48.218499 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.218117 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e73306b-987b-4fcb-9046-095712301f40" containerName="config-reloader" Jul 02 19:07:48.218499 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.218131 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e73306b-987b-4fcb-9046-095712301f40" containerName="prometheus" Jul 02 19:07:48.218499 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.218141 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e73306b-987b-4fcb-9046-095712301f40" containerName="prometheus" Jul 02 19:07:48.218499 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.218157 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e73306b-987b-4fcb-9046-095712301f40" containerName="kube-rbac-proxy-thanos" Jul 02 19:07:48.218499 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.218165 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e73306b-987b-4fcb-9046-095712301f40" containerName="kube-rbac-proxy-thanos" Jul 02 19:07:48.218499 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.218233 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e73306b-987b-4fcb-9046-095712301f40" containerName="thanos-sidecar" Jul 02 19:07:48.218499 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.218247 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e73306b-987b-4fcb-9046-095712301f40" containerName="kube-rbac-proxy-web" Jul 02 19:07:48.218499 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.218257 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7946e8f8-ff35-48d0-bb0a-47711451cb36" containerName="registry" Jul 02 19:07:48.218499 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.218268 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e73306b-987b-4fcb-9046-095712301f40" containerName="prometheus" Jul 02 19:07:48.218499 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.218277 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e73306b-987b-4fcb-9046-095712301f40" containerName="config-reloader" Jul 02 19:07:48.218499 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.218285 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e73306b-987b-4fcb-9046-095712301f40" containerName="kube-rbac-proxy" Jul 02 19:07:48.218499 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.218294 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e73306b-987b-4fcb-9046-095712301f40" containerName="kube-rbac-proxy-thanos" Jul 02 19:07:48.222697 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.222679 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.226699 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.226676 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 19:07:48.226972 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.226954 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 19:07:48.227392 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.227374 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 19:07:48.227467 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.227437 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 19:07:48.227588 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.227574 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 19:07:48.227642 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.227625 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 02 19:07:48.227701 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.227628 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 19:07:48.228727 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.228707 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 19:07:48.228727 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.228726 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 19:07:48.229028 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.229000 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 19:07:48.229240 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.229110 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cghtl0j3dfihp\"" Jul 02 19:07:48.229240 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.229182 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 19:07:48.230519 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.230455 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 19:07:48.231636 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.231439 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 19:07:48.231926 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.231863 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mgwnp\"" Jul 02 19:07:48.236402 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.236381 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 19:07:48.238433 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.238416 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 19:07:48.249721 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.249703 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 19:07:48.277271 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.277246 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7891db4-79f7-46c5-b934-5e32fac70f6a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.277352 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.277282 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7891db4-79f7-46c5-b934-5e32fac70f6a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.277352 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.277302 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a7891db4-79f7-46c5-b934-5e32fac70f6a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.277352 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.277320 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7891db4-79f7-46c5-b934-5e32fac70f6a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.277449 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.277354 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a7891db4-79f7-46c5-b934-5e32fac70f6a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.277449 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.277412 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7891db4-79f7-46c5-b934-5e32fac70f6a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.277449 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.277434 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a7891db4-79f7-46c5-b934-5e32fac70f6a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.277540 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.277448 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7891db4-79f7-46c5-b934-5e32fac70f6a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.277540 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.277465 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a7891db4-79f7-46c5-b934-5e32fac70f6a-config\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.277540 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.277503 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7891db4-79f7-46c5-b934-5e32fac70f6a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.277540 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.277524 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a7891db4-79f7-46c5-b934-5e32fac70f6a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.277652 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.277542 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a7891db4-79f7-46c5-b934-5e32fac70f6a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.277652 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.277566 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7891db4-79f7-46c5-b934-5e32fac70f6a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.277652 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.277618 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sltl2\" (UniqueName: \"kubernetes.io/projected/a7891db4-79f7-46c5-b934-5e32fac70f6a-kube-api-access-sltl2\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.277652 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.277639 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7891db4-79f7-46c5-b934-5e32fac70f6a-config-out\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.277766 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.277656 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a7891db4-79f7-46c5-b934-5e32fac70f6a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.277766 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.277671 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7891db4-79f7-46c5-b934-5e32fac70f6a-web-config\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.277766 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.277688 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7891db4-79f7-46c5-b934-5e32fac70f6a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.277766 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.277720 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a7891db4-79f7-46c5-b934-5e32fac70f6a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.277766 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.277747 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a7891db4-79f7-46c5-b934-5e32fac70f6a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.378587 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.378560 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7891db4-79f7-46c5-b934-5e32fac70f6a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.378699 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.378597 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a7891db4-79f7-46c5-b934-5e32fac70f6a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.378699 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.378624 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7891db4-79f7-46c5-b934-5e32fac70f6a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.378699 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.378646 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a7891db4-79f7-46c5-b934-5e32fac70f6a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.378699 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.378678 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7891db4-79f7-46c5-b934-5e32fac70f6a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.378933 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.378704 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a7891db4-79f7-46c5-b934-5e32fac70f6a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.378933 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.378726 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7891db4-79f7-46c5-b934-5e32fac70f6a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.378933 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.378752 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a7891db4-79f7-46c5-b934-5e32fac70f6a-config\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.378933 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.378779 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7891db4-79f7-46c5-b934-5e32fac70f6a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.378933 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.378805 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a7891db4-79f7-46c5-b934-5e32fac70f6a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.378933 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.378834 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a7891db4-79f7-46c5-b934-5e32fac70f6a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.378933 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.378887 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7891db4-79f7-46c5-b934-5e32fac70f6a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.378933 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.378918 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sltl2\" (UniqueName: \"kubernetes.io/projected/a7891db4-79f7-46c5-b934-5e32fac70f6a-kube-api-access-sltl2\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.379296 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.378958 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7891db4-79f7-46c5-b934-5e32fac70f6a-config-out\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.379296 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.378988 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a7891db4-79f7-46c5-b934-5e32fac70f6a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.379296 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.379014 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7891db4-79f7-46c5-b934-5e32fac70f6a-web-config\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.379296 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.379046 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7891db4-79f7-46c5-b934-5e32fac70f6a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.379296 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.379072 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a7891db4-79f7-46c5-b934-5e32fac70f6a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.379296 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.379098 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a7891db4-79f7-46c5-b934-5e32fac70f6a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.379296 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.379129 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7891db4-79f7-46c5-b934-5e32fac70f6a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.379631 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.379396 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a7891db4-79f7-46c5-b934-5e32fac70f6a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.379797 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.379771 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7891db4-79f7-46c5-b934-5e32fac70f6a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.379977 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.379955 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7891db4-79f7-46c5-b934-5e32fac70f6a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.381897 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.381869 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7891db4-79f7-46c5-b934-5e32fac70f6a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.382002 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.381986 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a7891db4-79f7-46c5-b934-5e32fac70f6a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.382292 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.382199 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7891db4-79f7-46c5-b934-5e32fac70f6a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.382418 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.382397 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7891db4-79f7-46c5-b934-5e32fac70f6a-config-out\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.382631 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.382607 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7891db4-79f7-46c5-b934-5e32fac70f6a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.382870 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.382823 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7891db4-79f7-46c5-b934-5e32fac70f6a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.383688 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.383254 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7891db4-79f7-46c5-b934-5e32fac70f6a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.383688 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.383350 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a7891db4-79f7-46c5-b934-5e32fac70f6a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.383688 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.383376 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7891db4-79f7-46c5-b934-5e32fac70f6a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.383688 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.383645 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a7891db4-79f7-46c5-b934-5e32fac70f6a-config\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.383964 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.383826 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a7891db4-79f7-46c5-b934-5e32fac70f6a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.384021 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.383968 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a7891db4-79f7-46c5-b934-5e32fac70f6a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.384731 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.384705 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a7891db4-79f7-46c5-b934-5e32fac70f6a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.384803 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.384746 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7891db4-79f7-46c5-b934-5e32fac70f6a-web-config\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.384872 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.384840 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a7891db4-79f7-46c5-b934-5e32fac70f6a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.384916 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.384886 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a7891db4-79f7-46c5-b934-5e32fac70f6a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.391108 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.391088 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sltl2\" (UniqueName: \"kubernetes.io/projected/a7891db4-79f7-46c5-b934-5e32fac70f6a-kube-api-access-sltl2\") pod \"prometheus-k8s-0\" (UID: \"a7891db4-79f7-46c5-b934-5e32fac70f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.534646 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.534624 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:48.671969 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.671940 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 19:07:48.674422 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:07:48.674399 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7891db4_79f7_46c5_b934_5e32fac70f6a.slice/crio-3d2c91c5ca4da43d3302e2e0f2a177b292834475d175f1f573e2a7b326866927 WatchSource:0}: Error finding container 3d2c91c5ca4da43d3302e2e0f2a177b292834475d175f1f573e2a7b326866927: Status 404 returned error can't find the container with id 3d2c91c5ca4da43d3302e2e0f2a177b292834475d175f1f573e2a7b326866927 Jul 02 19:07:48.885294 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:48.885265 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e73306b-987b-4fcb-9046-095712301f40" path="/var/lib/kubelet/pods/2e73306b-987b-4fcb-9046-095712301f40/volumes" Jul 02 19:07:49.136297 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:49.136271 2559 generic.go:356] "Generic (PLEG): container finished" podID="a7891db4-79f7-46c5-b934-5e32fac70f6a" containerID="df92d5ec6e248cb1c0518cf0dbfcfeccd2d3cd98a6465ec18477a526d6bedf29" exitCode=0 Jul 02 19:07:49.136616 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:49.136324 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7891db4-79f7-46c5-b934-5e32fac70f6a","Type":"ContainerDied","Data":"df92d5ec6e248cb1c0518cf0dbfcfeccd2d3cd98a6465ec18477a526d6bedf29"} Jul 02 19:07:49.136616 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:49.136381 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7891db4-79f7-46c5-b934-5e32fac70f6a","Type":"ContainerStarted","Data":"3d2c91c5ca4da43d3302e2e0f2a177b292834475d175f1f573e2a7b326866927"} Jul 02 19:07:49.382402 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:49.382359 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:49.482506 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:49.482483 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:50.142898 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:50.142867 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7891db4-79f7-46c5-b934-5e32fac70f6a","Type":"ContainerStarted","Data":"d785e0eb61b8acb6ee68742e04901fb0fc0d72dd1c6075c0c846639d52ddbd9e"} Jul 02 19:07:50.143221 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:50.142948 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7891db4-79f7-46c5-b934-5e32fac70f6a","Type":"ContainerStarted","Data":"51fca4d308b7a08afd0067e2b1b72c7304e6ea9796140282e75283eaf1697913"} Jul 02 19:07:50.143221 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:50.142986 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7891db4-79f7-46c5-b934-5e32fac70f6a","Type":"ContainerStarted","Data":"2f171c346dfe079d724fb32d6d5e5fe526216425687cb67b5bfecd90f3852d6c"} Jul 02 19:07:50.143221 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:50.143026 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7891db4-79f7-46c5-b934-5e32fac70f6a","Type":"ContainerStarted","Data":"6be87ab8750f6e7cb9cd3714fa69d994c3077e8c32ec522796c3f2f652e035d6"} Jul 02 19:07:50.143221 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:50.143069 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7891db4-79f7-46c5-b934-5e32fac70f6a","Type":"ContainerStarted","Data":"322bc2eabad867dbcc9f3d5838aa335d4a94919811d222c67149171cf82aec8f"} Jul 02 19:07:50.143221 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:50.143107 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7891db4-79f7-46c5-b934-5e32fac70f6a","Type":"ContainerStarted","Data":"44353ab3135c37ea0993537af62a3df4a8b62619611b906fe5e35bc86dc8fef7"} Jul 02 19:07:50.194697 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:50.194654 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.175471182 podStartE2EDuration="2.194640119s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.168937ms" isStatefulPod=false podCreationTimestamp="2026-07-02 19:07:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:07:50.194379825 +0000 UTC m=+397.856348975" watchObservedRunningTime="2026-07-02 19:07:50.194640119 +0000 UTC m=+397.856609303" Jul 02 19:07:51.085285 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:51.085252 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:51.181076 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:51.181046 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:51.281775 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:51.281746 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:53.535139 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:53.535094 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:07:53.983406 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:53.983375 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:54.049870 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:54.049828 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:58.111003 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:58.110969 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:58.208391 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:58.208353 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:59.816768 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:59.816736 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:07:59.908990 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:07:59.908957 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:03.110943 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:03.110908 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:41.073009 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:41.072925 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:41.221760 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:41.221714 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:45.384263 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:45.384228 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:45.490414 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:45.490383 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:45.590783 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:45.590750 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:08:46.363780 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:46.363743 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k"] Jul 02 19:08:46.366085 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:46.366065 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k" Jul 02 19:08:46.368326 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:46.368310 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 19:08:46.369115 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:46.369100 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 19:08:46.369190 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:46.369102 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-k6d8s\"" Jul 02 19:08:46.375629 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:46.375604 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k"] Jul 02 19:08:46.502640 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:46.502605 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1328d8f9-1e5b-427c-9457-53b8234b0aee-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k\" (UID: \"1328d8f9-1e5b-427c-9457-53b8234b0aee\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k" Jul 02 19:08:46.503059 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:46.502656 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkp47\" (UniqueName: \"kubernetes.io/projected/1328d8f9-1e5b-427c-9457-53b8234b0aee-kube-api-access-nkp47\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k\" (UID: \"1328d8f9-1e5b-427c-9457-53b8234b0aee\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k" Jul 02 19:08:46.503059 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:46.502717 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1328d8f9-1e5b-427c-9457-53b8234b0aee-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k\" (UID: \"1328d8f9-1e5b-427c-9457-53b8234b0aee\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k" Jul 02 19:08:46.603990 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:46.603956 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1328d8f9-1e5b-427c-9457-53b8234b0aee-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k\" (UID: \"1328d8f9-1e5b-427c-9457-53b8234b0aee\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k" Jul 02 19:08:46.604164 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:46.604002 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkp47\" (UniqueName: \"kubernetes.io/projected/1328d8f9-1e5b-427c-9457-53b8234b0aee-kube-api-access-nkp47\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k\" (UID: \"1328d8f9-1e5b-427c-9457-53b8234b0aee\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k" Jul 02 19:08:46.604164 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:46.604041 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1328d8f9-1e5b-427c-9457-53b8234b0aee-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k\" (UID: \"1328d8f9-1e5b-427c-9457-53b8234b0aee\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k" Jul 02 19:08:46.604345 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:46.604324 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1328d8f9-1e5b-427c-9457-53b8234b0aee-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k\" (UID: \"1328d8f9-1e5b-427c-9457-53b8234b0aee\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k" Jul 02 19:08:46.604395 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:46.604350 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1328d8f9-1e5b-427c-9457-53b8234b0aee-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k\" (UID: \"1328d8f9-1e5b-427c-9457-53b8234b0aee\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k" Jul 02 19:08:46.612719 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:46.612695 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkp47\" (UniqueName: \"kubernetes.io/projected/1328d8f9-1e5b-427c-9457-53b8234b0aee-kube-api-access-nkp47\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k\" (UID: \"1328d8f9-1e5b-427c-9457-53b8234b0aee\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k" Jul 02 19:08:46.675937 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:46.675829 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k" Jul 02 19:08:46.801518 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:46.801435 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k"] Jul 02 19:08:46.804133 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:08:46.804108 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1328d8f9_1e5b_427c_9457_53b8234b0aee.slice/crio-8ecbbcd48d84f57cd89bd41d7c6ddc1a01f9c738dd83cb96b52f5f37cc5e227a WatchSource:0}: Error finding container 8ecbbcd48d84f57cd89bd41d7c6ddc1a01f9c738dd83cb96b52f5f37cc5e227a: Status 404 returned error can't find the container with id 8ecbbcd48d84f57cd89bd41d7c6ddc1a01f9c738dd83cb96b52f5f37cc5e227a Jul 02 19:08:47.365841 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:47.365809 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k" event={"ID":"1328d8f9-1e5b-427c-9457-53b8234b0aee","Type":"ContainerStarted","Data":"8ecbbcd48d84f57cd89bd41d7c6ddc1a01f9c738dd83cb96b52f5f37cc5e227a"} Jul 02 19:08:48.535696 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:48.535659 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:08:48.551738 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:48.551715 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:08:49.388647 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:49.388616 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:08:55.398680 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:55.398644 2559 generic.go:356] "Generic (PLEG): container finished" podID="1328d8f9-1e5b-427c-9457-53b8234b0aee" containerID="3048ca4ca40f5e938de4f7483d149ebead27aba02e79867a71d9b39d4c27c51a" exitCode=0 Jul 02 19:08:55.399055 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:55.398728 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k" event={"ID":"1328d8f9-1e5b-427c-9457-53b8234b0aee","Type":"ContainerDied","Data":"3048ca4ca40f5e938de4f7483d149ebead27aba02e79867a71d9b39d4c27c51a"} Jul 02 19:08:58.413460 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:58.413431 2559 generic.go:356] "Generic (PLEG): container finished" podID="1328d8f9-1e5b-427c-9457-53b8234b0aee" containerID="bcbbb6eeabc3cb258a908a2c3378df910266bc00f658834c0a012b004d049f16" exitCode=0 Jul 02 19:08:58.413842 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:08:58.413486 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k" event={"ID":"1328d8f9-1e5b-427c-9457-53b8234b0aee","Type":"ContainerDied","Data":"bcbbb6eeabc3cb258a908a2c3378df910266bc00f658834c0a012b004d049f16"} Jul 02 19:09:07.453281 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:07.453250 2559 generic.go:356] "Generic (PLEG): container finished" podID="1328d8f9-1e5b-427c-9457-53b8234b0aee" containerID="c2574bc78e61eaee33f6296897d413c6b6e9e77de0784e6d7a13708b6a3c8042" exitCode=0 Jul 02 19:09:07.453662 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:07.453337 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k" event={"ID":"1328d8f9-1e5b-427c-9457-53b8234b0aee","Type":"ContainerDied","Data":"c2574bc78e61eaee33f6296897d413c6b6e9e77de0784e6d7a13708b6a3c8042"} Jul 02 19:09:08.633454 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:08.633423 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k" Jul 02 19:09:08.683201 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:08.683176 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkp47\" (UniqueName: \"kubernetes.io/projected/1328d8f9-1e5b-427c-9457-53b8234b0aee-kube-api-access-nkp47\") pod \"1328d8f9-1e5b-427c-9457-53b8234b0aee\" (UID: \"1328d8f9-1e5b-427c-9457-53b8234b0aee\") " Jul 02 19:09:08.683373 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:08.683252 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1328d8f9-1e5b-427c-9457-53b8234b0aee-bundle\") pod \"1328d8f9-1e5b-427c-9457-53b8234b0aee\" (UID: \"1328d8f9-1e5b-427c-9457-53b8234b0aee\") " Jul 02 19:09:08.683373 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:08.683280 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1328d8f9-1e5b-427c-9457-53b8234b0aee-util\") pod \"1328d8f9-1e5b-427c-9457-53b8234b0aee\" (UID: \"1328d8f9-1e5b-427c-9457-53b8234b0aee\") " Jul 02 19:09:08.684095 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:08.684063 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1328d8f9-1e5b-427c-9457-53b8234b0aee-bundle" (OuterVolumeSpecName: "bundle") pod "1328d8f9-1e5b-427c-9457-53b8234b0aee" (UID: "1328d8f9-1e5b-427c-9457-53b8234b0aee"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:09:08.685429 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:08.685396 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1328d8f9-1e5b-427c-9457-53b8234b0aee-kube-api-access-nkp47" (OuterVolumeSpecName: "kube-api-access-nkp47") pod "1328d8f9-1e5b-427c-9457-53b8234b0aee" (UID: "1328d8f9-1e5b-427c-9457-53b8234b0aee"). InnerVolumeSpecName "kube-api-access-nkp47". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:09:08.688071 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:08.688052 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1328d8f9-1e5b-427c-9457-53b8234b0aee-util" (OuterVolumeSpecName: "util") pod "1328d8f9-1e5b-427c-9457-53b8234b0aee" (UID: "1328d8f9-1e5b-427c-9457-53b8234b0aee"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:09:08.783814 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:08.783732 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1328d8f9-1e5b-427c-9457-53b8234b0aee-bundle\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:09:08.783814 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:08.783761 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1328d8f9-1e5b-427c-9457-53b8234b0aee-util\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:09:08.783814 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:08.783773 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkp47\" (UniqueName: \"kubernetes.io/projected/1328d8f9-1e5b-427c-9457-53b8234b0aee-kube-api-access-nkp47\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:09:09.463098 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:09.463072 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k" Jul 02 19:09:09.463247 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:09.463063 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q744k" event={"ID":"1328d8f9-1e5b-427c-9457-53b8234b0aee","Type":"ContainerDied","Data":"8ecbbcd48d84f57cd89bd41d7c6ddc1a01f9c738dd83cb96b52f5f37cc5e227a"} Jul 02 19:09:09.463247 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:09.463190 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ecbbcd48d84f57cd89bd41d7c6ddc1a01f9c738dd83cb96b52f5f37cc5e227a" Jul 02 19:09:12.724978 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:12.724935 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:13.039637 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:13.039570 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:16.813962 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:16.813929 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:16.913734 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:16.913698 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:18.654200 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:18.654167 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:18.770874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:18.770837 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:18.865225 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:18.865202 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6"] Jul 02 19:09:18.865487 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:18.865475 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1328d8f9-1e5b-427c-9457-53b8234b0aee" containerName="util" Jul 02 19:09:18.865549 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:18.865488 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1328d8f9-1e5b-427c-9457-53b8234b0aee" containerName="util" Jul 02 19:09:18.865549 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:18.865504 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1328d8f9-1e5b-427c-9457-53b8234b0aee" containerName="pull" Jul 02 19:09:18.865549 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:18.865510 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1328d8f9-1e5b-427c-9457-53b8234b0aee" containerName="pull" Jul 02 19:09:18.865549 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:18.865515 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1328d8f9-1e5b-427c-9457-53b8234b0aee" containerName="extract" Jul 02 19:09:18.865549 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:18.865521 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1328d8f9-1e5b-427c-9457-53b8234b0aee" containerName="extract" Jul 02 19:09:18.865717 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:18.865572 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1328d8f9-1e5b-427c-9457-53b8234b0aee" containerName="extract" Jul 02 19:09:18.867745 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:18.867729 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6" Jul 02 19:09:18.877060 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:18.877045 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 19:09:18.877152 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:18.877061 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 19:09:18.877816 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:18.877802 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-k6d8s\"" Jul 02 19:09:18.887481 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:18.887453 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6"] Jul 02 19:09:18.959358 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:18.959295 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5jc2\" (UniqueName: \"kubernetes.io/projected/2f7d2b2e-894d-4685-9749-047b2a56f686-kube-api-access-q5jc2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6\" (UID: \"2f7d2b2e-894d-4685-9749-047b2a56f686\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6" Jul 02 19:09:18.959463 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:18.959355 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f7d2b2e-894d-4685-9749-047b2a56f686-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6\" (UID: \"2f7d2b2e-894d-4685-9749-047b2a56f686\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6" Jul 02 19:09:18.959529 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:18.959475 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f7d2b2e-894d-4685-9749-047b2a56f686-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6\" (UID: \"2f7d2b2e-894d-4685-9749-047b2a56f686\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6" Jul 02 19:09:19.060802 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:19.060771 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f7d2b2e-894d-4685-9749-047b2a56f686-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6\" (UID: \"2f7d2b2e-894d-4685-9749-047b2a56f686\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6" Jul 02 19:09:19.060973 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:19.060806 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f7d2b2e-894d-4685-9749-047b2a56f686-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6\" (UID: \"2f7d2b2e-894d-4685-9749-047b2a56f686\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6" Jul 02 19:09:19.060973 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:19.060900 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5jc2\" (UniqueName: \"kubernetes.io/projected/2f7d2b2e-894d-4685-9749-047b2a56f686-kube-api-access-q5jc2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6\" (UID: \"2f7d2b2e-894d-4685-9749-047b2a56f686\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6" Jul 02 19:09:19.061227 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:19.061207 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f7d2b2e-894d-4685-9749-047b2a56f686-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6\" (UID: \"2f7d2b2e-894d-4685-9749-047b2a56f686\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6" Jul 02 19:09:19.061265 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:19.061225 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f7d2b2e-894d-4685-9749-047b2a56f686-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6\" (UID: \"2f7d2b2e-894d-4685-9749-047b2a56f686\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6" Jul 02 19:09:19.084484 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:19.084455 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5jc2\" (UniqueName: \"kubernetes.io/projected/2f7d2b2e-894d-4685-9749-047b2a56f686-kube-api-access-q5jc2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6\" (UID: \"2f7d2b2e-894d-4685-9749-047b2a56f686\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6" Jul 02 19:09:19.176770 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:19.176744 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6" Jul 02 19:09:19.259042 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:19.259012 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:19.309271 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:19.309237 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6"] Jul 02 19:09:19.313992 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:09:19.313967 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f7d2b2e_894d_4685_9749_047b2a56f686.slice/crio-1209f9c0910534c777940b26e1f5ab26a43f40bbc0333d0e677ee6fa65657070 WatchSource:0}: Error finding container 1209f9c0910534c777940b26e1f5ab26a43f40bbc0333d0e677ee6fa65657070: Status 404 returned error can't find the container with id 1209f9c0910534c777940b26e1f5ab26a43f40bbc0333d0e677ee6fa65657070 Jul 02 19:09:19.412740 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:19.412715 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:19.501111 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:19.501047 2559 generic.go:356] "Generic (PLEG): container finished" podID="2f7d2b2e-894d-4685-9749-047b2a56f686" containerID="4d2c726f6ea358d353e9929b8fe841cd85eb4f9126e1ccfc97ca83e83a9249f3" exitCode=0 Jul 02 19:09:19.501222 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:19.501114 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6" event={"ID":"2f7d2b2e-894d-4685-9749-047b2a56f686","Type":"ContainerDied","Data":"4d2c726f6ea358d353e9929b8fe841cd85eb4f9126e1ccfc97ca83e83a9249f3"} Jul 02 19:09:19.501222 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:19.501146 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6" event={"ID":"2f7d2b2e-894d-4685-9749-047b2a56f686","Type":"ContainerStarted","Data":"1209f9c0910534c777940b26e1f5ab26a43f40bbc0333d0e677ee6fa65657070"} Jul 02 19:09:19.547603 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:19.547579 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rnvr7"] Jul 02 19:09:19.549586 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:19.549571 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-rnvr7" Jul 02 19:09:19.552346 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:19.552327 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 02 19:09:19.552424 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:19.552338 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 02 19:09:19.552473 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:19.552460 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-9lxq8\"" Jul 02 19:09:19.564784 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:19.564765 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw2kz\" (UniqueName: \"kubernetes.io/projected/68b2abb8-2fde-47d4-8aad-9bae62404701-kube-api-access-zw2kz\") pod \"cert-manager-webhook-6486ffd997-rnvr7\" (UID: \"68b2abb8-2fde-47d4-8aad-9bae62404701\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rnvr7" Jul 02 19:09:19.564933 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:19.564913 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68b2abb8-2fde-47d4-8aad-9bae62404701-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rnvr7\" (UID: \"68b2abb8-2fde-47d4-8aad-9bae62404701\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rnvr7" Jul 02 19:09:19.566614 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:19.566596 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rnvr7"] Jul 02 19:09:19.665294 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:19.665268 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68b2abb8-2fde-47d4-8aad-9bae62404701-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rnvr7\" (UID: \"68b2abb8-2fde-47d4-8aad-9bae62404701\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rnvr7" Jul 02 19:09:19.665584 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:19.665303 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw2kz\" (UniqueName: \"kubernetes.io/projected/68b2abb8-2fde-47d4-8aad-9bae62404701-kube-api-access-zw2kz\") pod \"cert-manager-webhook-6486ffd997-rnvr7\" (UID: \"68b2abb8-2fde-47d4-8aad-9bae62404701\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rnvr7" Jul 02 19:09:19.676495 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:19.676473 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw2kz\" (UniqueName: \"kubernetes.io/projected/68b2abb8-2fde-47d4-8aad-9bae62404701-kube-api-access-zw2kz\") pod \"cert-manager-webhook-6486ffd997-rnvr7\" (UID: \"68b2abb8-2fde-47d4-8aad-9bae62404701\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rnvr7" Jul 02 19:09:19.679731 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:19.679715 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68b2abb8-2fde-47d4-8aad-9bae62404701-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rnvr7\" (UID: \"68b2abb8-2fde-47d4-8aad-9bae62404701\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rnvr7" Jul 02 19:09:19.872391 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:19.872354 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-rnvr7" Jul 02 19:09:19.993105 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:19.993073 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rnvr7"] Jul 02 19:09:19.995889 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:09:19.995866 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68b2abb8_2fde_47d4_8aad_9bae62404701.slice/crio-b32f23e513dc05cb73248ccba3c9c77bd07896023ebcbf075b15b27f70600e61 WatchSource:0}: Error finding container b32f23e513dc05cb73248ccba3c9c77bd07896023ebcbf075b15b27f70600e61: Status 404 returned error can't find the container with id b32f23e513dc05cb73248ccba3c9c77bd07896023ebcbf075b15b27f70600e61 Jul 02 19:09:20.507330 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:20.507291 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-rnvr7" event={"ID":"68b2abb8-2fde-47d4-8aad-9bae62404701","Type":"ContainerStarted","Data":"b32f23e513dc05cb73248ccba3c9c77bd07896023ebcbf075b15b27f70600e61"} Jul 02 19:09:21.514578 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:21.514544 2559 generic.go:356] "Generic (PLEG): container finished" podID="2f7d2b2e-894d-4685-9749-047b2a56f686" containerID="e576aa21d58cd6f6262ff6c95f698b25125801d1765134ed8273f7b200e48087" exitCode=0 Jul 02 19:09:21.515001 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:21.514593 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6" event={"ID":"2f7d2b2e-894d-4685-9749-047b2a56f686","Type":"ContainerDied","Data":"e576aa21d58cd6f6262ff6c95f698b25125801d1765134ed8273f7b200e48087"} Jul 02 19:09:21.697255 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:21.697224 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:21.796591 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:21.796561 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:22.521424 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:22.521386 2559 generic.go:356] "Generic (PLEG): container finished" podID="2f7d2b2e-894d-4685-9749-047b2a56f686" containerID="a4f2b6fade83039639c1399c3cd46bcd976c7dae927e3e83510496ce30ae5d61" exitCode=0 Jul 02 19:09:22.521906 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:22.521473 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6" event={"ID":"2f7d2b2e-894d-4685-9749-047b2a56f686","Type":"ContainerDied","Data":"a4f2b6fade83039639c1399c3cd46bcd976c7dae927e3e83510496ce30ae5d61"} Jul 02 19:09:23.104599 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:23.104563 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:23.206222 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:23.206189 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:23.527531 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:23.527496 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-rnvr7" event={"ID":"68b2abb8-2fde-47d4-8aad-9bae62404701","Type":"ContainerStarted","Data":"7826e44c5b67717a1e167dbf928f683ee3a61e41701ada8b4638f4d3f7417ca9"} Jul 02 19:09:23.527927 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:23.527559 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-rnvr7" Jul 02 19:09:23.658449 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:23.658426 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6" Jul 02 19:09:23.679337 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:23.679295 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-rnvr7" podStartSLOduration=1.35906779 podStartE2EDuration="4.679279849s" totalImagesPullingTime="3.320212059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:09:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:09:23.55663047 +0000 UTC m=+491.218599620" watchObservedRunningTime="2026-07-02 19:09:23.679279849 +0000 UTC m=+491.341248999" Jul 02 19:09:23.700547 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:23.700520 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f7d2b2e-894d-4685-9749-047b2a56f686-util\") pod \"2f7d2b2e-894d-4685-9749-047b2a56f686\" (UID: \"2f7d2b2e-894d-4685-9749-047b2a56f686\") " Jul 02 19:09:23.700632 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:23.700580 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5jc2\" (UniqueName: \"kubernetes.io/projected/2f7d2b2e-894d-4685-9749-047b2a56f686-kube-api-access-q5jc2\") pod \"2f7d2b2e-894d-4685-9749-047b2a56f686\" (UID: \"2f7d2b2e-894d-4685-9749-047b2a56f686\") " Jul 02 19:09:23.700632 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:23.700603 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f7d2b2e-894d-4685-9749-047b2a56f686-bundle\") pod \"2f7d2b2e-894d-4685-9749-047b2a56f686\" (UID: \"2f7d2b2e-894d-4685-9749-047b2a56f686\") " Jul 02 19:09:23.701029 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:23.701003 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f7d2b2e-894d-4685-9749-047b2a56f686-bundle" (OuterVolumeSpecName: "bundle") pod "2f7d2b2e-894d-4685-9749-047b2a56f686" (UID: "2f7d2b2e-894d-4685-9749-047b2a56f686"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:09:23.702522 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:23.702498 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f7d2b2e-894d-4685-9749-047b2a56f686-kube-api-access-q5jc2" (OuterVolumeSpecName: "kube-api-access-q5jc2") pod "2f7d2b2e-894d-4685-9749-047b2a56f686" (UID: "2f7d2b2e-894d-4685-9749-047b2a56f686"). InnerVolumeSpecName "kube-api-access-q5jc2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:09:23.705557 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:23.705526 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f7d2b2e-894d-4685-9749-047b2a56f686-util" (OuterVolumeSpecName: "util") pod "2f7d2b2e-894d-4685-9749-047b2a56f686" (UID: "2f7d2b2e-894d-4685-9749-047b2a56f686"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:09:23.801566 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:23.801543 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f7d2b2e-894d-4685-9749-047b2a56f686-util\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:09:23.801566 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:23.801564 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5jc2\" (UniqueName: \"kubernetes.io/projected/2f7d2b2e-894d-4685-9749-047b2a56f686-kube-api-access-q5jc2\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:09:23.801691 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:23.801574 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f7d2b2e-894d-4685-9749-047b2a56f686-bundle\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:09:24.533729 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:24.533693 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6" event={"ID":"2f7d2b2e-894d-4685-9749-047b2a56f686","Type":"ContainerDied","Data":"1209f9c0910534c777940b26e1f5ab26a43f40bbc0333d0e677ee6fa65657070"} Jul 02 19:09:24.533729 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:24.533726 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqw7r6" Jul 02 19:09:24.534143 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:24.533740 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1209f9c0910534c777940b26e1f5ab26a43f40bbc0333d0e677ee6fa65657070" Jul 02 19:09:27.757669 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:27.757636 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:27.879439 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:27.879415 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:29.170415 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:29.170380 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:29.536030 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:29.535948 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-rnvr7" Jul 02 19:09:29.792134 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:29.792047 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:29.891971 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:29.891929 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:31.218554 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:31.218523 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l7npk"] Jul 02 19:09:31.218910 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:31.218814 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f7d2b2e-894d-4685-9749-047b2a56f686" containerName="extract" Jul 02 19:09:31.218910 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:31.218824 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f7d2b2e-894d-4685-9749-047b2a56f686" containerName="extract" Jul 02 19:09:31.218910 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:31.218838 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f7d2b2e-894d-4685-9749-047b2a56f686" containerName="util" Jul 02 19:09:31.218910 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:31.218844 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f7d2b2e-894d-4685-9749-047b2a56f686" containerName="util" Jul 02 19:09:31.218910 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:31.218867 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f7d2b2e-894d-4685-9749-047b2a56f686" containerName="pull" Jul 02 19:09:31.218910 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:31.218875 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f7d2b2e-894d-4685-9749-047b2a56f686" containerName="pull" Jul 02 19:09:31.219100 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:31.218928 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f7d2b2e-894d-4685-9749-047b2a56f686" containerName="extract" Jul 02 19:09:31.220980 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:31.220966 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l7npk" Jul 02 19:09:31.227065 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:31.226775 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-6w9ws\"" Jul 02 19:09:31.227610 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:31.227595 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 02 19:09:31.227660 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:31.227606 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:09:31.239371 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:31.239352 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l7npk"] Jul 02 19:09:31.261666 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:31.261643 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnxvv\" (UniqueName: \"kubernetes.io/projected/a69701c1-bc60-4adc-ad4d-7f4a6fe77d3a-kube-api-access-pnxvv\") pod \"openshift-lws-operator-fd8ccff4c-l7npk\" (UID: \"a69701c1-bc60-4adc-ad4d-7f4a6fe77d3a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l7npk" Jul 02 19:09:31.261777 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:31.261695 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a69701c1-bc60-4adc-ad4d-7f4a6fe77d3a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-l7npk\" (UID: \"a69701c1-bc60-4adc-ad4d-7f4a6fe77d3a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l7npk" Jul 02 19:09:31.362025 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:31.361996 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnxvv\" (UniqueName: \"kubernetes.io/projected/a69701c1-bc60-4adc-ad4d-7f4a6fe77d3a-kube-api-access-pnxvv\") pod \"openshift-lws-operator-fd8ccff4c-l7npk\" (UID: \"a69701c1-bc60-4adc-ad4d-7f4a6fe77d3a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l7npk" Jul 02 19:09:31.362142 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:31.362042 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a69701c1-bc60-4adc-ad4d-7f4a6fe77d3a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-l7npk\" (UID: \"a69701c1-bc60-4adc-ad4d-7f4a6fe77d3a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l7npk" Jul 02 19:09:31.362362 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:31.362348 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a69701c1-bc60-4adc-ad4d-7f4a6fe77d3a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-l7npk\" (UID: \"a69701c1-bc60-4adc-ad4d-7f4a6fe77d3a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l7npk" Jul 02 19:09:31.374440 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:31.374421 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnxvv\" (UniqueName: \"kubernetes.io/projected/a69701c1-bc60-4adc-ad4d-7f4a6fe77d3a-kube-api-access-pnxvv\") pod \"openshift-lws-operator-fd8ccff4c-l7npk\" (UID: \"a69701c1-bc60-4adc-ad4d-7f4a6fe77d3a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l7npk" Jul 02 19:09:31.529818 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:31.529740 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l7npk" Jul 02 19:09:31.656926 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:31.656899 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l7npk"] Jul 02 19:09:31.659415 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:09:31.659377 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda69701c1_bc60_4adc_ad4d_7f4a6fe77d3a.slice/crio-4efeb66bc02b6f5fb8ccd0bb5a98aa241414e068c3e133db32e08700f814dab0 WatchSource:0}: Error finding container 4efeb66bc02b6f5fb8ccd0bb5a98aa241414e068c3e133db32e08700f814dab0: Status 404 returned error can't find the container with id 4efeb66bc02b6f5fb8ccd0bb5a98aa241414e068c3e133db32e08700f814dab0 Jul 02 19:09:32.051260 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:32.051227 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5hj74"] Jul 02 19:09:32.058154 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:32.058127 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-5hj74" Jul 02 19:09:32.061688 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:32.061665 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-25wts\"" Jul 02 19:09:32.072378 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:32.072358 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5hj74"] Jul 02 19:09:32.169769 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:32.169740 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpwjg\" (UniqueName: \"kubernetes.io/projected/fc382680-e195-464d-a877-12271b6f202b-kube-api-access-kpwjg\") pod \"cert-manager-55b4d954d5-5hj74\" (UID: \"fc382680-e195-464d-a877-12271b6f202b\") " pod="cert-manager/cert-manager-55b4d954d5-5hj74" Jul 02 19:09:32.169928 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:32.169793 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fc382680-e195-464d-a877-12271b6f202b-bound-sa-token\") pod \"cert-manager-55b4d954d5-5hj74\" (UID: \"fc382680-e195-464d-a877-12271b6f202b\") " pod="cert-manager/cert-manager-55b4d954d5-5hj74" Jul 02 19:09:32.270127 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:32.270098 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fc382680-e195-464d-a877-12271b6f202b-bound-sa-token\") pod \"cert-manager-55b4d954d5-5hj74\" (UID: \"fc382680-e195-464d-a877-12271b6f202b\") " pod="cert-manager/cert-manager-55b4d954d5-5hj74" Jul 02 19:09:32.270485 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:32.270158 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpwjg\" (UniqueName: \"kubernetes.io/projected/fc382680-e195-464d-a877-12271b6f202b-kube-api-access-kpwjg\") pod \"cert-manager-55b4d954d5-5hj74\" (UID: \"fc382680-e195-464d-a877-12271b6f202b\") " pod="cert-manager/cert-manager-55b4d954d5-5hj74" Jul 02 19:09:32.282558 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:32.282533 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fc382680-e195-464d-a877-12271b6f202b-bound-sa-token\") pod \"cert-manager-55b4d954d5-5hj74\" (UID: \"fc382680-e195-464d-a877-12271b6f202b\") " pod="cert-manager/cert-manager-55b4d954d5-5hj74" Jul 02 19:09:32.282686 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:32.282669 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpwjg\" (UniqueName: \"kubernetes.io/projected/fc382680-e195-464d-a877-12271b6f202b-kube-api-access-kpwjg\") pod \"cert-manager-55b4d954d5-5hj74\" (UID: \"fc382680-e195-464d-a877-12271b6f202b\") " pod="cert-manager/cert-manager-55b4d954d5-5hj74" Jul 02 19:09:32.367629 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:32.367571 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-5hj74" Jul 02 19:09:32.531705 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:32.531640 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5hj74"] Jul 02 19:09:32.535307 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:09:32.535280 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc382680_e195_464d_a877_12271b6f202b.slice/crio-120c5ed5d249d70967b0fb1cbcde2317c9d9fe271e1253ea72cc3c3b669c906b WatchSource:0}: Error finding container 120c5ed5d249d70967b0fb1cbcde2317c9d9fe271e1253ea72cc3c3b669c906b: Status 404 returned error can't find the container with id 120c5ed5d249d70967b0fb1cbcde2317c9d9fe271e1253ea72cc3c3b669c906b Jul 02 19:09:32.569511 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:32.569479 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-5hj74" event={"ID":"fc382680-e195-464d-a877-12271b6f202b","Type":"ContainerStarted","Data":"120c5ed5d249d70967b0fb1cbcde2317c9d9fe271e1253ea72cc3c3b669c906b"} Jul 02 19:09:32.570907 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:32.570882 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l7npk" event={"ID":"a69701c1-bc60-4adc-ad4d-7f4a6fe77d3a","Type":"ContainerStarted","Data":"4efeb66bc02b6f5fb8ccd0bb5a98aa241414e068c3e133db32e08700f814dab0"} Jul 02 19:09:33.576746 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:33.576663 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l7npk" event={"ID":"a69701c1-bc60-4adc-ad4d-7f4a6fe77d3a","Type":"ContainerStarted","Data":"9ff1ce9047951e5b1a3fa991cb480c41c554d08268c206ac7d0e7f56fcebd6b1"} Jul 02 19:09:33.578170 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:33.578146 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-5hj74" event={"ID":"fc382680-e195-464d-a877-12271b6f202b","Type":"ContainerStarted","Data":"c4c568cc4833070b5f2fa77ebd73a2c5b9153029e3b838a550dcb8756ad4bff7"} Jul 02 19:09:33.675917 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:33.675872 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l7npk" podStartSLOduration=1.015858542 podStartE2EDuration="2.675843158s" totalImagesPullingTime="1.659984616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:09:33.601316354 +0000 UTC m=+501.263285503" watchObservedRunningTime="2026-07-02 19:09:33.675843158 +0000 UTC m=+501.337812307" Jul 02 19:09:33.676037 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:33.676019 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-5hj74" podStartSLOduration=1.676013744 podStartE2EDuration="1.676013744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:09:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:09:33.675104285 +0000 UTC m=+501.337073437" watchObservedRunningTime="2026-07-02 19:09:33.676013744 +0000 UTC m=+501.337982894" Jul 02 19:09:34.410539 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:34.410513 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:34.512032 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:34.512000 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:36.131528 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:36.131495 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc"] Jul 02 19:09:36.134961 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:36.134946 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc" Jul 02 19:09:36.137234 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:36.137212 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-k6d8s\"" Jul 02 19:09:36.137373 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:36.137285 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 19:09:36.137838 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:36.137822 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 19:09:36.143470 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:36.143448 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc"] Jul 02 19:09:36.203530 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:36.203504 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtlhw\" (UniqueName: \"kubernetes.io/projected/67cf302c-71df-466f-905a-b27c04b5cae4-kube-api-access-xtlhw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc\" (UID: \"67cf302c-71df-466f-905a-b27c04b5cae4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc" Jul 02 19:09:36.203616 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:36.203544 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67cf302c-71df-466f-905a-b27c04b5cae4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc\" (UID: \"67cf302c-71df-466f-905a-b27c04b5cae4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc" Jul 02 19:09:36.203616 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:36.203569 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67cf302c-71df-466f-905a-b27c04b5cae4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc\" (UID: \"67cf302c-71df-466f-905a-b27c04b5cae4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc" Jul 02 19:09:36.304295 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:36.304264 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtlhw\" (UniqueName: \"kubernetes.io/projected/67cf302c-71df-466f-905a-b27c04b5cae4-kube-api-access-xtlhw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc\" (UID: \"67cf302c-71df-466f-905a-b27c04b5cae4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc" Jul 02 19:09:36.304412 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:36.304309 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67cf302c-71df-466f-905a-b27c04b5cae4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc\" (UID: \"67cf302c-71df-466f-905a-b27c04b5cae4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc" Jul 02 19:09:36.304412 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:36.304333 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67cf302c-71df-466f-905a-b27c04b5cae4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc\" (UID: \"67cf302c-71df-466f-905a-b27c04b5cae4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc" Jul 02 19:09:36.304642 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:36.304627 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67cf302c-71df-466f-905a-b27c04b5cae4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc\" (UID: \"67cf302c-71df-466f-905a-b27c04b5cae4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc" Jul 02 19:09:36.304711 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:36.304693 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67cf302c-71df-466f-905a-b27c04b5cae4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc\" (UID: \"67cf302c-71df-466f-905a-b27c04b5cae4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc" Jul 02 19:09:36.314967 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:36.314944 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtlhw\" (UniqueName: \"kubernetes.io/projected/67cf302c-71df-466f-905a-b27c04b5cae4-kube-api-access-xtlhw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc\" (UID: \"67cf302c-71df-466f-905a-b27c04b5cae4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc" Jul 02 19:09:36.444606 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:36.444527 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc" Jul 02 19:09:36.581964 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:36.581925 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc"] Jul 02 19:09:36.584821 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:09:36.584795 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67cf302c_71df_466f_905a_b27c04b5cae4.slice/crio-ec1b5a8ee206c1dcb0f93131b194dffcb4deb77ee64f0eea6c498a3c1801949c WatchSource:0}: Error finding container ec1b5a8ee206c1dcb0f93131b194dffcb4deb77ee64f0eea6c498a3c1801949c: Status 404 returned error can't find the container with id ec1b5a8ee206c1dcb0f93131b194dffcb4deb77ee64f0eea6c498a3c1801949c Jul 02 19:09:36.592512 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:36.592489 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc" event={"ID":"67cf302c-71df-466f-905a-b27c04b5cae4","Type":"ContainerStarted","Data":"ec1b5a8ee206c1dcb0f93131b194dffcb4deb77ee64f0eea6c498a3c1801949c"} Jul 02 19:09:36.789407 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:36.789366 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:37.597735 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:37.597661 2559 generic.go:356] "Generic (PLEG): container finished" podID="67cf302c-71df-466f-905a-b27c04b5cae4" containerID="c13b8b94020b36e98dc39a76f3cfd7d41bc2b5a09bb01b5aaadbd373b5f56058" exitCode=0 Jul 02 19:09:37.597735 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:37.597724 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc" event={"ID":"67cf302c-71df-466f-905a-b27c04b5cae4","Type":"ContainerDied","Data":"c13b8b94020b36e98dc39a76f3cfd7d41bc2b5a09bb01b5aaadbd373b5f56058"} Jul 02 19:09:39.608323 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:39.608289 2559 generic.go:356] "Generic (PLEG): container finished" podID="67cf302c-71df-466f-905a-b27c04b5cae4" containerID="a8d44c823dc139ebc5e9122544e2204bed2e5cdf7b0aa809df2701b302fe0625" exitCode=0 Jul 02 19:09:39.608726 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:39.608378 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc" event={"ID":"67cf302c-71df-466f-905a-b27c04b5cae4","Type":"ContainerDied","Data":"a8d44c823dc139ebc5e9122544e2204bed2e5cdf7b0aa809df2701b302fe0625"} Jul 02 19:09:40.614507 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:40.614472 2559 generic.go:356] "Generic (PLEG): container finished" podID="67cf302c-71df-466f-905a-b27c04b5cae4" containerID="7449ca833bb899dbde5721a8827342dc57f04ffa3c0955bb3db8045c609b2181" exitCode=0 Jul 02 19:09:40.614936 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:40.614554 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc" event={"ID":"67cf302c-71df-466f-905a-b27c04b5cae4","Type":"ContainerDied","Data":"7449ca833bb899dbde5721a8827342dc57f04ffa3c0955bb3db8045c609b2181"} Jul 02 19:09:41.744152 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:41.744128 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc" Jul 02 19:09:41.855231 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:41.855198 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67cf302c-71df-466f-905a-b27c04b5cae4-util\") pod \"67cf302c-71df-466f-905a-b27c04b5cae4\" (UID: \"67cf302c-71df-466f-905a-b27c04b5cae4\") " Jul 02 19:09:41.855404 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:41.855247 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67cf302c-71df-466f-905a-b27c04b5cae4-bundle\") pod \"67cf302c-71df-466f-905a-b27c04b5cae4\" (UID: \"67cf302c-71df-466f-905a-b27c04b5cae4\") " Jul 02 19:09:41.855404 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:41.855316 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtlhw\" (UniqueName: \"kubernetes.io/projected/67cf302c-71df-466f-905a-b27c04b5cae4-kube-api-access-xtlhw\") pod \"67cf302c-71df-466f-905a-b27c04b5cae4\" (UID: \"67cf302c-71df-466f-905a-b27c04b5cae4\") " Jul 02 19:09:41.856001 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:41.855976 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67cf302c-71df-466f-905a-b27c04b5cae4-bundle" (OuterVolumeSpecName: "bundle") pod "67cf302c-71df-466f-905a-b27c04b5cae4" (UID: "67cf302c-71df-466f-905a-b27c04b5cae4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:09:41.857430 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:41.857404 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67cf302c-71df-466f-905a-b27c04b5cae4-kube-api-access-xtlhw" (OuterVolumeSpecName: "kube-api-access-xtlhw") pod "67cf302c-71df-466f-905a-b27c04b5cae4" (UID: "67cf302c-71df-466f-905a-b27c04b5cae4"). InnerVolumeSpecName "kube-api-access-xtlhw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:09:41.860743 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:41.860719 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67cf302c-71df-466f-905a-b27c04b5cae4-util" (OuterVolumeSpecName: "util") pod "67cf302c-71df-466f-905a-b27c04b5cae4" (UID: "67cf302c-71df-466f-905a-b27c04b5cae4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:09:41.956758 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:41.956684 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67cf302c-71df-466f-905a-b27c04b5cae4-bundle\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:09:41.956758 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:41.956710 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtlhw\" (UniqueName: \"kubernetes.io/projected/67cf302c-71df-466f-905a-b27c04b5cae4-kube-api-access-xtlhw\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:09:41.956758 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:41.956720 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67cf302c-71df-466f-905a-b27c04b5cae4-util\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:09:42.624258 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:42.624227 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc" Jul 02 19:09:42.624258 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:42.624235 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afljqqc" event={"ID":"67cf302c-71df-466f-905a-b27c04b5cae4","Type":"ContainerDied","Data":"ec1b5a8ee206c1dcb0f93131b194dffcb4deb77ee64f0eea6c498a3c1801949c"} Jul 02 19:09:42.624457 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:42.624279 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec1b5a8ee206c1dcb0f93131b194dffcb4deb77ee64f0eea6c498a3c1801949c" Jul 02 19:09:48.468716 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:48.468681 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:48.658743 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:48.658712 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:49.005327 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.005294 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:49.400417 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.400388 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:49.492015 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.491979 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:49.555905 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.555874 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d984f5d94-b7wvc"] Jul 02 19:09:49.556210 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.556197 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67cf302c-71df-466f-905a-b27c04b5cae4" containerName="pull" Jul 02 19:09:49.556251 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.556212 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="67cf302c-71df-466f-905a-b27c04b5cae4" containerName="pull" Jul 02 19:09:49.556251 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.556225 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67cf302c-71df-466f-905a-b27c04b5cae4" containerName="extract" Jul 02 19:09:49.556251 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.556231 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="67cf302c-71df-466f-905a-b27c04b5cae4" containerName="extract" Jul 02 19:09:49.556251 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.556240 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67cf302c-71df-466f-905a-b27c04b5cae4" containerName="util" Jul 02 19:09:49.556251 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.556245 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="67cf302c-71df-466f-905a-b27c04b5cae4" containerName="util" Jul 02 19:09:49.556398 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.556299 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="67cf302c-71df-466f-905a-b27c04b5cae4" containerName="extract" Jul 02 19:09:49.558461 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.558442 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-b7wvc" Jul 02 19:09:49.561609 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.561591 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 19:09:49.564728 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.564706 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 19:09:49.565660 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.565645 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 19:09:49.571014 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.570997 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xghdc\"" Jul 02 19:09:49.573784 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.573768 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 19:09:49.614008 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.613985 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d984f5d94-b7wvc"] Jul 02 19:09:49.713513 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.713455 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bcae5632-4ce0-4beb-86dc-9a7dbbb317c8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d984f5d94-b7wvc\" (UID: \"bcae5632-4ce0-4beb-86dc-9a7dbbb317c8\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-b7wvc" Jul 02 19:09:49.713513 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.713484 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcae5632-4ce0-4beb-86dc-9a7dbbb317c8-tmp\") pod \"opendatahub-operator-controller-manager-d984f5d94-b7wvc\" (UID: \"bcae5632-4ce0-4beb-86dc-9a7dbbb317c8\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-b7wvc" Jul 02 19:09:49.713656 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.713547 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6vkr\" (UniqueName: \"kubernetes.io/projected/bcae5632-4ce0-4beb-86dc-9a7dbbb317c8-kube-api-access-h6vkr\") pod \"opendatahub-operator-controller-manager-d984f5d94-b7wvc\" (UID: \"bcae5632-4ce0-4beb-86dc-9a7dbbb317c8\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-b7wvc" Jul 02 19:09:49.713656 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.713606 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bcae5632-4ce0-4beb-86dc-9a7dbbb317c8-webhook-cert\") pod \"opendatahub-operator-controller-manager-d984f5d94-b7wvc\" (UID: \"bcae5632-4ce0-4beb-86dc-9a7dbbb317c8\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-b7wvc" Jul 02 19:09:49.713656 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.713625 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bcae5632-4ce0-4beb-86dc-9a7dbbb317c8-manifests\") pod \"opendatahub-operator-controller-manager-d984f5d94-b7wvc\" (UID: \"bcae5632-4ce0-4beb-86dc-9a7dbbb317c8\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-b7wvc" Jul 02 19:09:49.751016 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.750993 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:49.814122 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.814100 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6vkr\" (UniqueName: \"kubernetes.io/projected/bcae5632-4ce0-4beb-86dc-9a7dbbb317c8-kube-api-access-h6vkr\") pod \"opendatahub-operator-controller-manager-d984f5d94-b7wvc\" (UID: \"bcae5632-4ce0-4beb-86dc-9a7dbbb317c8\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-b7wvc" Jul 02 19:09:49.814226 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.814140 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bcae5632-4ce0-4beb-86dc-9a7dbbb317c8-webhook-cert\") pod \"opendatahub-operator-controller-manager-d984f5d94-b7wvc\" (UID: \"bcae5632-4ce0-4beb-86dc-9a7dbbb317c8\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-b7wvc" Jul 02 19:09:49.814226 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.814156 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bcae5632-4ce0-4beb-86dc-9a7dbbb317c8-manifests\") pod \"opendatahub-operator-controller-manager-d984f5d94-b7wvc\" (UID: \"bcae5632-4ce0-4beb-86dc-9a7dbbb317c8\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-b7wvc" Jul 02 19:09:49.814226 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.814181 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bcae5632-4ce0-4beb-86dc-9a7dbbb317c8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d984f5d94-b7wvc\" (UID: \"bcae5632-4ce0-4beb-86dc-9a7dbbb317c8\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-b7wvc" Jul 02 19:09:49.814226 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.814205 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcae5632-4ce0-4beb-86dc-9a7dbbb317c8-tmp\") pod \"opendatahub-operator-controller-manager-d984f5d94-b7wvc\" (UID: \"bcae5632-4ce0-4beb-86dc-9a7dbbb317c8\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-b7wvc" Jul 02 19:09:49.814513 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.814494 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bcae5632-4ce0-4beb-86dc-9a7dbbb317c8-manifests\") pod \"opendatahub-operator-controller-manager-d984f5d94-b7wvc\" (UID: \"bcae5632-4ce0-4beb-86dc-9a7dbbb317c8\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-b7wvc" Jul 02 19:09:49.816516 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.816499 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcae5632-4ce0-4beb-86dc-9a7dbbb317c8-tmp\") pod \"opendatahub-operator-controller-manager-d984f5d94-b7wvc\" (UID: \"bcae5632-4ce0-4beb-86dc-9a7dbbb317c8\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-b7wvc" Jul 02 19:09:49.816719 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.816699 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bcae5632-4ce0-4beb-86dc-9a7dbbb317c8-webhook-cert\") pod \"opendatahub-operator-controller-manager-d984f5d94-b7wvc\" (UID: \"bcae5632-4ce0-4beb-86dc-9a7dbbb317c8\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-b7wvc" Jul 02 19:09:49.816768 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.816713 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bcae5632-4ce0-4beb-86dc-9a7dbbb317c8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d984f5d94-b7wvc\" (UID: \"bcae5632-4ce0-4beb-86dc-9a7dbbb317c8\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-b7wvc" Jul 02 19:09:49.824534 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.824507 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6vkr\" (UniqueName: \"kubernetes.io/projected/bcae5632-4ce0-4beb-86dc-9a7dbbb317c8-kube-api-access-h6vkr\") pod \"opendatahub-operator-controller-manager-d984f5d94-b7wvc\" (UID: \"bcae5632-4ce0-4beb-86dc-9a7dbbb317c8\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-b7wvc" Jul 02 19:09:49.863287 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.863262 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:49.868186 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.868168 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-b7wvc" Jul 02 19:09:49.997408 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:49.997337 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:50.008469 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:50.008373 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d984f5d94-b7wvc"] Jul 02 19:09:50.010808 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:09:50.010781 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcae5632_4ce0_4beb_86dc_9a7dbbb317c8.slice/crio-954e1918ce0e04e6d7941ff00c686713c18b6d3eeab06538c2b05278f166453a WatchSource:0}: Error finding container 954e1918ce0e04e6d7941ff00c686713c18b6d3eeab06538c2b05278f166453a: Status 404 returned error can't find the container with id 954e1918ce0e04e6d7941ff00c686713c18b6d3eeab06538c2b05278f166453a Jul 02 19:09:50.103717 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:50.103694 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:50.209977 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:50.209947 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:09:50.657332 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:50.657295 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-b7wvc" event={"ID":"bcae5632-4ce0-4beb-86dc-9a7dbbb317c8","Type":"ContainerStarted","Data":"954e1918ce0e04e6d7941ff00c686713c18b6d3eeab06538c2b05278f166453a"} Jul 02 19:09:54.678242 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:54.678211 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-b7wvc" event={"ID":"bcae5632-4ce0-4beb-86dc-9a7dbbb317c8","Type":"ContainerStarted","Data":"7fed4911eb6ccda1a5481513ae142a99ec26e0f9668f3ae0ccea69cf1899ef61"} Jul 02 19:09:55.684317 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:55.684279 2559 generic.go:356] "Generic (PLEG): container finished" podID="bcae5632-4ce0-4beb-86dc-9a7dbbb317c8" containerID="7fed4911eb6ccda1a5481513ae142a99ec26e0f9668f3ae0ccea69cf1899ef61" exitCode=0 Jul 02 19:09:55.684696 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:55.684358 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-b7wvc" event={"ID":"bcae5632-4ce0-4beb-86dc-9a7dbbb317c8","Type":"ContainerDied","Data":"7fed4911eb6ccda1a5481513ae142a99ec26e0f9668f3ae0ccea69cf1899ef61"} Jul 02 19:09:56.691149 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:56.691071 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-b7wvc" event={"ID":"bcae5632-4ce0-4beb-86dc-9a7dbbb317c8","Type":"ContainerStarted","Data":"c25e24eee53f86ddb22e4e77e6d4ad0bd03f53afd44d711f4dc24d8e0490c2e8"} Jul 02 19:09:56.691490 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:56.691176 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-b7wvc" Jul 02 19:09:56.716061 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:09:56.716009 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-b7wvc" podStartSLOduration=2.131654749 podStartE2EDuration="7.715994668s" totalImagesPullingTime="4.492674172s" totalInitContainerRuntime="1.091665747s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:09:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:09:56.715014109 +0000 UTC m=+524.376983260" watchObservedRunningTime="2026-07-02 19:09:56.715994668 +0000 UTC m=+524.377963817" Jul 02 19:10:07.698178 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:07.698100 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-b7wvc" Jul 02 19:10:09.642732 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:09.642700 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:09.918215 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:09.918139 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:10.232037 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:10.231970 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:10.484435 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:10.484361 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:10.713235 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:10.713196 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:10.887860 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:10.887818 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7965745c7f-9rcsz"] Jul 02 19:10:10.896046 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:10.896012 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:10.896197 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:10.896163 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7965745c7f-9rcsz" Jul 02 19:10:10.899869 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:10.899823 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 02 19:10:10.899869 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:10.899823 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 02 19:10:10.900567 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:10.900551 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 02 19:10:10.900658 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:10.900584 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-g56hx\"" Jul 02 19:10:10.925234 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:10.925205 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7965745c7f-9rcsz"] Jul 02 19:10:10.992128 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:10.992105 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d02bde4-1da7-494a-a02a-925489357cc7-cert\") pod \"lws-controller-manager-7965745c7f-9rcsz\" (UID: \"4d02bde4-1da7-494a-a02a-925489357cc7\") " pod="openshift-lws-operator/lws-controller-manager-7965745c7f-9rcsz" Jul 02 19:10:10.992271 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:10.992161 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4d02bde4-1da7-494a-a02a-925489357cc7-manager-config\") pod \"lws-controller-manager-7965745c7f-9rcsz\" (UID: \"4d02bde4-1da7-494a-a02a-925489357cc7\") " pod="openshift-lws-operator/lws-controller-manager-7965745c7f-9rcsz" Jul 02 19:10:10.992271 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:10.992190 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d02bde4-1da7-494a-a02a-925489357cc7-metrics-cert\") pod \"lws-controller-manager-7965745c7f-9rcsz\" (UID: \"4d02bde4-1da7-494a-a02a-925489357cc7\") " pod="openshift-lws-operator/lws-controller-manager-7965745c7f-9rcsz" Jul 02 19:10:10.992271 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:10.992218 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42s77\" (UniqueName: \"kubernetes.io/projected/4d02bde4-1da7-494a-a02a-925489357cc7-kube-api-access-42s77\") pod \"lws-controller-manager-7965745c7f-9rcsz\" (UID: \"4d02bde4-1da7-494a-a02a-925489357cc7\") " pod="openshift-lws-operator/lws-controller-manager-7965745c7f-9rcsz" Jul 02 19:10:11.092933 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:11.092900 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4d02bde4-1da7-494a-a02a-925489357cc7-manager-config\") pod \"lws-controller-manager-7965745c7f-9rcsz\" (UID: \"4d02bde4-1da7-494a-a02a-925489357cc7\") " pod="openshift-lws-operator/lws-controller-manager-7965745c7f-9rcsz" Jul 02 19:10:11.092933 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:11.092931 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d02bde4-1da7-494a-a02a-925489357cc7-metrics-cert\") pod \"lws-controller-manager-7965745c7f-9rcsz\" (UID: \"4d02bde4-1da7-494a-a02a-925489357cc7\") " pod="openshift-lws-operator/lws-controller-manager-7965745c7f-9rcsz" Jul 02 19:10:11.093162 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:11.092951 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42s77\" (UniqueName: \"kubernetes.io/projected/4d02bde4-1da7-494a-a02a-925489357cc7-kube-api-access-42s77\") pod \"lws-controller-manager-7965745c7f-9rcsz\" (UID: \"4d02bde4-1da7-494a-a02a-925489357cc7\") " pod="openshift-lws-operator/lws-controller-manager-7965745c7f-9rcsz" Jul 02 19:10:11.093162 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:11.092988 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d02bde4-1da7-494a-a02a-925489357cc7-cert\") pod \"lws-controller-manager-7965745c7f-9rcsz\" (UID: \"4d02bde4-1da7-494a-a02a-925489357cc7\") " pod="openshift-lws-operator/lws-controller-manager-7965745c7f-9rcsz" Jul 02 19:10:11.093506 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:11.093486 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4d02bde4-1da7-494a-a02a-925489357cc7-manager-config\") pod \"lws-controller-manager-7965745c7f-9rcsz\" (UID: \"4d02bde4-1da7-494a-a02a-925489357cc7\") " pod="openshift-lws-operator/lws-controller-manager-7965745c7f-9rcsz" Jul 02 19:10:11.095358 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:11.095338 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d02bde4-1da7-494a-a02a-925489357cc7-cert\") pod \"lws-controller-manager-7965745c7f-9rcsz\" (UID: \"4d02bde4-1da7-494a-a02a-925489357cc7\") " pod="openshift-lws-operator/lws-controller-manager-7965745c7f-9rcsz" Jul 02 19:10:11.095420 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:11.095393 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d02bde4-1da7-494a-a02a-925489357cc7-metrics-cert\") pod \"lws-controller-manager-7965745c7f-9rcsz\" (UID: \"4d02bde4-1da7-494a-a02a-925489357cc7\") " pod="openshift-lws-operator/lws-controller-manager-7965745c7f-9rcsz" Jul 02 19:10:11.111484 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:11.111457 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42s77\" (UniqueName: \"kubernetes.io/projected/4d02bde4-1da7-494a-a02a-925489357cc7-kube-api-access-42s77\") pod \"lws-controller-manager-7965745c7f-9rcsz\" (UID: \"4d02bde4-1da7-494a-a02a-925489357cc7\") " pod="openshift-lws-operator/lws-controller-manager-7965745c7f-9rcsz" Jul 02 19:10:11.143815 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:11.143745 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:11.205813 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:11.205780 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7965745c7f-9rcsz" Jul 02 19:10:11.275665 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:11.275633 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:11.377842 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:11.377810 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7965745c7f-9rcsz"] Jul 02 19:10:11.380708 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:10:11.380682 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d02bde4_1da7_494a_a02a_925489357cc7.slice/crio-4320e98c9993358313d9c6725be44a1cbfe5caed423b4cd285539dac0e194d6a WatchSource:0}: Error finding container 4320e98c9993358313d9c6725be44a1cbfe5caed423b4cd285539dac0e194d6a: Status 404 returned error can't find the container with id 4320e98c9993358313d9c6725be44a1cbfe5caed423b4cd285539dac0e194d6a Jul 02 19:10:11.758893 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:11.758838 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7965745c7f-9rcsz" event={"ID":"4d02bde4-1da7-494a-a02a-925489357cc7","Type":"ContainerStarted","Data":"4320e98c9993358313d9c6725be44a1cbfe5caed423b4cd285539dac0e194d6a"} Jul 02 19:10:11.897611 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:11.897573 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:12.238152 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:12.238114 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:13.048961 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:13.048925 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:13.196186 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:13.196151 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:13.769305 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:13.769271 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7965745c7f-9rcsz" event={"ID":"4d02bde4-1da7-494a-a02a-925489357cc7","Type":"ContainerStarted","Data":"24a624f615f7a17abec95c926d7e12bdd466b125678cb36af2442fb069c0d19c"} Jul 02 19:10:13.769487 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:13.769383 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7965745c7f-9rcsz" Jul 02 19:10:13.809089 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:13.809048 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7965745c7f-9rcsz" podStartSLOduration=1.5593756619999999 podStartE2EDuration="3.809033506s" totalImagesPullingTime="2.249657844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:10:13.808106402 +0000 UTC m=+541.470075551" watchObservedRunningTime="2026-07-02 19:10:13.809033506 +0000 UTC m=+541.471002656" Jul 02 19:10:15.491664 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:15.491629 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:15.739868 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:15.739826 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:16.681900 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:16.681867 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:16.782863 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:16.782818 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:17.620472 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.620432 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd"] Jul 02 19:10:17.623937 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.623916 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:17.628072 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.628037 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 02 19:10:17.628163 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.628086 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 19:10:17.628430 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.628413 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 19:10:17.628926 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.628903 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-bnvmn\"" Jul 02 19:10:17.642021 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.642001 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd"] Jul 02 19:10:17.652162 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.652137 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/728b9481-425c-42f3-9ec4-d82af992fd98-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mdjxd\" (UID: \"728b9481-425c-42f3-9ec4-d82af992fd98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:17.652267 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.652179 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/728b9481-425c-42f3-9ec4-d82af992fd98-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mdjxd\" (UID: \"728b9481-425c-42f3-9ec4-d82af992fd98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:17.652267 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.652218 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/728b9481-425c-42f3-9ec4-d82af992fd98-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mdjxd\" (UID: \"728b9481-425c-42f3-9ec4-d82af992fd98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:17.652267 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.652245 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/728b9481-425c-42f3-9ec4-d82af992fd98-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mdjxd\" (UID: \"728b9481-425c-42f3-9ec4-d82af992fd98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:17.652267 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.652264 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/728b9481-425c-42f3-9ec4-d82af992fd98-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mdjxd\" (UID: \"728b9481-425c-42f3-9ec4-d82af992fd98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:17.652475 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.652325 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/728b9481-425c-42f3-9ec4-d82af992fd98-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mdjxd\" (UID: \"728b9481-425c-42f3-9ec4-d82af992fd98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:17.652475 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.652351 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/728b9481-425c-42f3-9ec4-d82af992fd98-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mdjxd\" (UID: \"728b9481-425c-42f3-9ec4-d82af992fd98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:17.652475 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.652399 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/728b9481-425c-42f3-9ec4-d82af992fd98-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mdjxd\" (UID: \"728b9481-425c-42f3-9ec4-d82af992fd98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:17.652475 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.652418 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pffv\" (UniqueName: \"kubernetes.io/projected/728b9481-425c-42f3-9ec4-d82af992fd98-kube-api-access-6pffv\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mdjxd\" (UID: \"728b9481-425c-42f3-9ec4-d82af992fd98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:17.677532 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.677508 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:17.753343 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.753316 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/728b9481-425c-42f3-9ec4-d82af992fd98-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mdjxd\" (UID: \"728b9481-425c-42f3-9ec4-d82af992fd98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:17.753726 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.753352 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/728b9481-425c-42f3-9ec4-d82af992fd98-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mdjxd\" (UID: \"728b9481-425c-42f3-9ec4-d82af992fd98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:17.753726 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.753374 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/728b9481-425c-42f3-9ec4-d82af992fd98-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mdjxd\" (UID: \"728b9481-425c-42f3-9ec4-d82af992fd98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:17.753726 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.753402 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/728b9481-425c-42f3-9ec4-d82af992fd98-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mdjxd\" (UID: \"728b9481-425c-42f3-9ec4-d82af992fd98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:17.753726 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.753437 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/728b9481-425c-42f3-9ec4-d82af992fd98-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mdjxd\" (UID: \"728b9481-425c-42f3-9ec4-d82af992fd98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:17.753726 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.753467 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/728b9481-425c-42f3-9ec4-d82af992fd98-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mdjxd\" (UID: \"728b9481-425c-42f3-9ec4-d82af992fd98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:17.753726 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.753535 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/728b9481-425c-42f3-9ec4-d82af992fd98-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mdjxd\" (UID: \"728b9481-425c-42f3-9ec4-d82af992fd98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:17.753726 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.753590 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pffv\" (UniqueName: \"kubernetes.io/projected/728b9481-425c-42f3-9ec4-d82af992fd98-kube-api-access-6pffv\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mdjxd\" (UID: \"728b9481-425c-42f3-9ec4-d82af992fd98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:17.753726 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.753638 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/728b9481-425c-42f3-9ec4-d82af992fd98-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mdjxd\" (UID: \"728b9481-425c-42f3-9ec4-d82af992fd98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:17.754155 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.753774 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/728b9481-425c-42f3-9ec4-d82af992fd98-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mdjxd\" (UID: \"728b9481-425c-42f3-9ec4-d82af992fd98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:17.754155 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.753786 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/728b9481-425c-42f3-9ec4-d82af992fd98-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mdjxd\" (UID: \"728b9481-425c-42f3-9ec4-d82af992fd98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:17.754155 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.753989 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/728b9481-425c-42f3-9ec4-d82af992fd98-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mdjxd\" (UID: \"728b9481-425c-42f3-9ec4-d82af992fd98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:17.754155 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.754056 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/728b9481-425c-42f3-9ec4-d82af992fd98-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mdjxd\" (UID: \"728b9481-425c-42f3-9ec4-d82af992fd98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:17.754420 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.754392 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/728b9481-425c-42f3-9ec4-d82af992fd98-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mdjxd\" (UID: \"728b9481-425c-42f3-9ec4-d82af992fd98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:17.754587 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.754566 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:17.755783 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.755759 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/728b9481-425c-42f3-9ec4-d82af992fd98-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mdjxd\" (UID: \"728b9481-425c-42f3-9ec4-d82af992fd98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:17.756134 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.756115 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/728b9481-425c-42f3-9ec4-d82af992fd98-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mdjxd\" (UID: \"728b9481-425c-42f3-9ec4-d82af992fd98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:17.761278 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.761256 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/728b9481-425c-42f3-9ec4-d82af992fd98-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mdjxd\" (UID: \"728b9481-425c-42f3-9ec4-d82af992fd98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:17.764446 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.764424 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pffv\" (UniqueName: \"kubernetes.io/projected/728b9481-425c-42f3-9ec4-d82af992fd98-kube-api-access-6pffv\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mdjxd\" (UID: \"728b9481-425c-42f3-9ec4-d82af992fd98\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:17.922064 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.921992 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:17.935138 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:17.935119 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:18.083663 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:18.083634 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd"] Jul 02 19:10:18.085446 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:10:18.085419 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod728b9481_425c_42f3_9ec4_d82af992fd98.slice/crio-e0b25d0d3bd1611f339a00bf26603ea4d2a54958b72402062374ca1796202d4a WatchSource:0}: Error finding container e0b25d0d3bd1611f339a00bf26603ea4d2a54958b72402062374ca1796202d4a: Status 404 returned error can't find the container with id e0b25d0d3bd1611f339a00bf26603ea4d2a54958b72402062374ca1796202d4a Jul 02 19:10:18.792939 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:18.792903 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" event={"ID":"728b9481-425c-42f3-9ec4-d82af992fd98","Type":"ContainerStarted","Data":"e0b25d0d3bd1611f339a00bf26603ea4d2a54958b72402062374ca1796202d4a"} Jul 02 19:10:20.595540 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.595502 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24"] Jul 02 19:10:20.605484 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.605457 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24" Jul 02 19:10:20.613095 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.613042 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 02 19:10:20.613249 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.613098 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 02 19:10:20.613249 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.613098 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 02 19:10:20.613392 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.613345 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-n6hsn\"" Jul 02 19:10:20.637331 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.637291 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24"] Jul 02 19:10:20.681135 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.681097 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a26358e2-c342-4623-b048-537ecf0b715a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zbb24\" (UID: \"a26358e2-c342-4623-b048-537ecf0b715a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24" Jul 02 19:10:20.681316 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.681145 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a26358e2-c342-4623-b048-537ecf0b715a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zbb24\" (UID: \"a26358e2-c342-4623-b048-537ecf0b715a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24" Jul 02 19:10:20.681316 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.681191 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5cwl\" (UniqueName: \"kubernetes.io/projected/a26358e2-c342-4623-b048-537ecf0b715a-kube-api-access-r5cwl\") pod \"istiod-openshift-gateway-94bb8fbfd-zbb24\" (UID: \"a26358e2-c342-4623-b048-537ecf0b715a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24" Jul 02 19:10:20.681316 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.681228 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a26358e2-c342-4623-b048-537ecf0b715a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zbb24\" (UID: \"a26358e2-c342-4623-b048-537ecf0b715a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24" Jul 02 19:10:20.681316 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.681291 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a26358e2-c342-4623-b048-537ecf0b715a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zbb24\" (UID: \"a26358e2-c342-4623-b048-537ecf0b715a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24" Jul 02 19:10:20.681508 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.681326 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a26358e2-c342-4623-b048-537ecf0b715a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zbb24\" (UID: \"a26358e2-c342-4623-b048-537ecf0b715a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24" Jul 02 19:10:20.681508 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.681352 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a26358e2-c342-4623-b048-537ecf0b715a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zbb24\" (UID: \"a26358e2-c342-4623-b048-537ecf0b715a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24" Jul 02 19:10:20.782830 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.782411 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a26358e2-c342-4623-b048-537ecf0b715a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zbb24\" (UID: \"a26358e2-c342-4623-b048-537ecf0b715a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24" Jul 02 19:10:20.782830 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.782474 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a26358e2-c342-4623-b048-537ecf0b715a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zbb24\" (UID: \"a26358e2-c342-4623-b048-537ecf0b715a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24" Jul 02 19:10:20.782830 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.782520 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a26358e2-c342-4623-b048-537ecf0b715a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zbb24\" (UID: \"a26358e2-c342-4623-b048-537ecf0b715a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24" Jul 02 19:10:20.782830 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.782550 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a26358e2-c342-4623-b048-537ecf0b715a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zbb24\" (UID: \"a26358e2-c342-4623-b048-537ecf0b715a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24" Jul 02 19:10:20.782830 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.782616 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5cwl\" (UniqueName: \"kubernetes.io/projected/a26358e2-c342-4623-b048-537ecf0b715a-kube-api-access-r5cwl\") pod \"istiod-openshift-gateway-94bb8fbfd-zbb24\" (UID: \"a26358e2-c342-4623-b048-537ecf0b715a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24" Jul 02 19:10:20.782830 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.782654 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a26358e2-c342-4623-b048-537ecf0b715a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zbb24\" (UID: \"a26358e2-c342-4623-b048-537ecf0b715a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24" Jul 02 19:10:20.782830 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.782703 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a26358e2-c342-4623-b048-537ecf0b715a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zbb24\" (UID: \"a26358e2-c342-4623-b048-537ecf0b715a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24" Jul 02 19:10:20.784022 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.783994 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a26358e2-c342-4623-b048-537ecf0b715a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zbb24\" (UID: \"a26358e2-c342-4623-b048-537ecf0b715a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24" Jul 02 19:10:20.785555 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.785531 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a26358e2-c342-4623-b048-537ecf0b715a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zbb24\" (UID: \"a26358e2-c342-4623-b048-537ecf0b715a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24" Jul 02 19:10:20.785673 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.785558 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a26358e2-c342-4623-b048-537ecf0b715a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zbb24\" (UID: \"a26358e2-c342-4623-b048-537ecf0b715a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24" Jul 02 19:10:20.785673 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.785624 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a26358e2-c342-4623-b048-537ecf0b715a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zbb24\" (UID: \"a26358e2-c342-4623-b048-537ecf0b715a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24" Jul 02 19:10:20.785902 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.785879 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a26358e2-c342-4623-b048-537ecf0b715a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zbb24\" (UID: \"a26358e2-c342-4623-b048-537ecf0b715a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24" Jul 02 19:10:20.792394 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.792363 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:10:20.792464 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.792428 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:10:20.792464 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.792458 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:10:20.800677 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.800654 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5cwl\" (UniqueName: \"kubernetes.io/projected/a26358e2-c342-4623-b048-537ecf0b715a-kube-api-access-r5cwl\") pod \"istiod-openshift-gateway-94bb8fbfd-zbb24\" (UID: \"a26358e2-c342-4623-b048-537ecf0b715a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24" Jul 02 19:10:20.801243 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.801226 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a26358e2-c342-4623-b048-537ecf0b715a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zbb24\" (UID: \"a26358e2-c342-4623-b048-537ecf0b715a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24" Jul 02 19:10:20.917449 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:20.917420 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24" Jul 02 19:10:21.067883 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:21.067840 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24"] Jul 02 19:10:21.069621 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:10:21.069593 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda26358e2_c342_4623_b048_537ecf0b715a.slice/crio-23e1f2a5512dc892dc0cc7409ba0851e2eeb96f3bba52e42a0c2804060036c59 WatchSource:0}: Error finding container 23e1f2a5512dc892dc0cc7409ba0851e2eeb96f3bba52e42a0c2804060036c59: Status 404 returned error can't find the container with id 23e1f2a5512dc892dc0cc7409ba0851e2eeb96f3bba52e42a0c2804060036c59 Jul 02 19:10:21.809646 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:21.809608 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24" event={"ID":"a26358e2-c342-4623-b048-537ecf0b715a","Type":"ContainerStarted","Data":"23e1f2a5512dc892dc0cc7409ba0851e2eeb96f3bba52e42a0c2804060036c59"} Jul 02 19:10:21.811155 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:21.811129 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" event={"ID":"728b9481-425c-42f3-9ec4-d82af992fd98","Type":"ContainerStarted","Data":"47439775dfe613da50a3ea2a3cbf944758e9eedaf74649494d8286dc66267bed"} Jul 02 19:10:21.843536 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:21.843484 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" podStartSLOduration=2.138705335 podStartE2EDuration="4.843468855s" totalImagesPullingTime="2.70476352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:10:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:10:21.842728089 +0000 UTC m=+549.504697239" watchObservedRunningTime="2026-07-02 19:10:21.843468855 +0000 UTC m=+549.505438050" Jul 02 19:10:21.935320 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:21.935285 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:21.939878 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:21.939827 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:22.817009 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:22.816974 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:22.817985 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:22.817962 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mdjxd" Jul 02 19:10:23.659523 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:23.659484 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:23.803338 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:23.803010 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:24.000459 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:24.000342 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:24.235780 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:24.235746 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:24.254233 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:24.254194 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:10:24.254349 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:24.254257 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:10:24.467496 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:24.467451 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:24.777000 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:24.776970 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7965745c7f-9rcsz" Jul 02 19:10:24.831327 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:24.831292 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24" event={"ID":"a26358e2-c342-4623-b048-537ecf0b715a","Type":"ContainerStarted","Data":"c25642093a81109fcc2814bd243153687a6ab42b140ab0293486dbf762344d0d"} Jul 02 19:10:24.831576 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:24.831546 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24" Jul 02 19:10:24.878125 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:24.878081 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24" podStartSLOduration=1.695803206 podStartE2EDuration="4.878067013s" totalImagesPullingTime="3.182263807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:10:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:10:24.875837934 +0000 UTC m=+552.537807084" watchObservedRunningTime="2026-07-02 19:10:24.878067013 +0000 UTC m=+552.540036162" Jul 02 19:10:25.838109 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:25.838081 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zbb24" Jul 02 19:10:29.519974 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:29.519943 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:10:29.623574 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:10:29.623547 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:11.188096 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:11.188064 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:11.358360 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:11.358334 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:11.510146 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:11.510051 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:12.187907 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:12.187823 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:12.379236 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:12.379203 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:12.788686 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:12.788656 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gf2s_a95b977b-6b92-411f-a185-ecc012668bff/ovn-acl-logging/0.log" Jul 02 19:11:12.789549 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:12.789529 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gf2s_a95b977b-6b92-411f-a185-ecc012668bff/ovn-acl-logging/0.log" Jul 02 19:11:27.622285 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:27.622252 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg"] Jul 02 19:11:27.626094 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:27.626077 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg" Jul 02 19:11:27.629472 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:27.629448 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 19:11:27.629672 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:27.629658 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 19:11:27.630287 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:27.630271 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gfjmq\"" Jul 02 19:11:27.648395 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:27.648364 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg"] Jul 02 19:11:27.755811 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:27.755788 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/493b5e47-74ca-44b1-9bf0-783592e85e0d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg\" (UID: \"493b5e47-74ca-44b1-9bf0-783592e85e0d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg" Jul 02 19:11:27.755969 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:27.755838 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g25vs\" (UniqueName: \"kubernetes.io/projected/493b5e47-74ca-44b1-9bf0-783592e85e0d-kube-api-access-g25vs\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg\" (UID: \"493b5e47-74ca-44b1-9bf0-783592e85e0d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg" Jul 02 19:11:27.756036 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:27.755973 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/493b5e47-74ca-44b1-9bf0-783592e85e0d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg\" (UID: \"493b5e47-74ca-44b1-9bf0-783592e85e0d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg" Jul 02 19:11:27.856287 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:27.856263 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g25vs\" (UniqueName: \"kubernetes.io/projected/493b5e47-74ca-44b1-9bf0-783592e85e0d-kube-api-access-g25vs\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg\" (UID: \"493b5e47-74ca-44b1-9bf0-783592e85e0d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg" Jul 02 19:11:27.856426 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:27.856329 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/493b5e47-74ca-44b1-9bf0-783592e85e0d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg\" (UID: \"493b5e47-74ca-44b1-9bf0-783592e85e0d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg" Jul 02 19:11:27.856426 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:27.856372 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/493b5e47-74ca-44b1-9bf0-783592e85e0d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg\" (UID: \"493b5e47-74ca-44b1-9bf0-783592e85e0d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg" Jul 02 19:11:27.856801 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:27.856778 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/493b5e47-74ca-44b1-9bf0-783592e85e0d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg\" (UID: \"493b5e47-74ca-44b1-9bf0-783592e85e0d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg" Jul 02 19:11:27.856801 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:27.856792 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/493b5e47-74ca-44b1-9bf0-783592e85e0d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg\" (UID: \"493b5e47-74ca-44b1-9bf0-783592e85e0d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg" Jul 02 19:11:27.871242 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:27.871223 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g25vs\" (UniqueName: \"kubernetes.io/projected/493b5e47-74ca-44b1-9bf0-783592e85e0d-kube-api-access-g25vs\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg\" (UID: \"493b5e47-74ca-44b1-9bf0-783592e85e0d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg" Jul 02 19:11:27.935418 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:27.935367 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg" Jul 02 19:11:28.076304 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:11:28.076280 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod493b5e47_74ca_44b1_9bf0_783592e85e0d.slice/crio-36406c33a32c09122b3566b217f8d4fe3f8965357a47f40a677cece2dd7a19ce WatchSource:0}: Error finding container 36406c33a32c09122b3566b217f8d4fe3f8965357a47f40a677cece2dd7a19ce: Status 404 returned error can't find the container with id 36406c33a32c09122b3566b217f8d4fe3f8965357a47f40a677cece2dd7a19ce Jul 02 19:11:28.077966 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.077942 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg"] Jul 02 19:11:28.117944 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.117916 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg" event={"ID":"493b5e47-74ca-44b1-9bf0-783592e85e0d","Type":"ContainerStarted","Data":"36406c33a32c09122b3566b217f8d4fe3f8965357a47f40a677cece2dd7a19ce"} Jul 02 19:11:28.210031 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.210006 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz"] Jul 02 19:11:28.213361 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.213344 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz" Jul 02 19:11:28.232691 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.232667 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz"] Jul 02 19:11:28.361462 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.361428 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4442a8e3-4a92-4cad-a51c-c0e9a6c1d271-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz\" (UID: \"4442a8e3-4a92-4cad-a51c-c0e9a6c1d271\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz" Jul 02 19:11:28.361462 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.361465 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65mkt\" (UniqueName: \"kubernetes.io/projected/4442a8e3-4a92-4cad-a51c-c0e9a6c1d271-kube-api-access-65mkt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz\" (UID: \"4442a8e3-4a92-4cad-a51c-c0e9a6c1d271\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz" Jul 02 19:11:28.361680 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.361487 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4442a8e3-4a92-4cad-a51c-c0e9a6c1d271-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz\" (UID: \"4442a8e3-4a92-4cad-a51c-c0e9a6c1d271\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz" Jul 02 19:11:28.462958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.462882 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4442a8e3-4a92-4cad-a51c-c0e9a6c1d271-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz\" (UID: \"4442a8e3-4a92-4cad-a51c-c0e9a6c1d271\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz" Jul 02 19:11:28.462958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.462913 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65mkt\" (UniqueName: \"kubernetes.io/projected/4442a8e3-4a92-4cad-a51c-c0e9a6c1d271-kube-api-access-65mkt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz\" (UID: \"4442a8e3-4a92-4cad-a51c-c0e9a6c1d271\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz" Jul 02 19:11:28.462958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.462936 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4442a8e3-4a92-4cad-a51c-c0e9a6c1d271-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz\" (UID: \"4442a8e3-4a92-4cad-a51c-c0e9a6c1d271\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz" Jul 02 19:11:28.463262 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.463243 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4442a8e3-4a92-4cad-a51c-c0e9a6c1d271-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz\" (UID: \"4442a8e3-4a92-4cad-a51c-c0e9a6c1d271\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz" Jul 02 19:11:28.463302 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.463286 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4442a8e3-4a92-4cad-a51c-c0e9a6c1d271-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz\" (UID: \"4442a8e3-4a92-4cad-a51c-c0e9a6c1d271\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz" Jul 02 19:11:28.472063 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.472040 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65mkt\" (UniqueName: \"kubernetes.io/projected/4442a8e3-4a92-4cad-a51c-c0e9a6c1d271-kube-api-access-65mkt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz\" (UID: \"4442a8e3-4a92-4cad-a51c-c0e9a6c1d271\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz" Jul 02 19:11:28.552259 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.552231 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz" Jul 02 19:11:28.570300 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.570275 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc"] Jul 02 19:11:28.573973 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.573954 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc" Jul 02 19:11:28.584834 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.584807 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc"] Jul 02 19:11:28.664672 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.664646 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fa1c139-3c9d-4252-8f3e-4da234afa1df-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc\" (UID: \"6fa1c139-3c9d-4252-8f3e-4da234afa1df\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc" Jul 02 19:11:28.665060 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.664676 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kvss\" (UniqueName: \"kubernetes.io/projected/6fa1c139-3c9d-4252-8f3e-4da234afa1df-kube-api-access-8kvss\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc\" (UID: \"6fa1c139-3c9d-4252-8f3e-4da234afa1df\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc" Jul 02 19:11:28.665060 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.664720 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fa1c139-3c9d-4252-8f3e-4da234afa1df-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc\" (UID: \"6fa1c139-3c9d-4252-8f3e-4da234afa1df\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc" Jul 02 19:11:28.694504 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.694478 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz"] Jul 02 19:11:28.696333 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:11:28.696309 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4442a8e3_4a92_4cad_a51c_c0e9a6c1d271.slice/crio-ef5074f007e5eb933962ecefb4c70bf97534012bd93a3bcfcfc1338c4d6f28f1 WatchSource:0}: Error finding container ef5074f007e5eb933962ecefb4c70bf97534012bd93a3bcfcfc1338c4d6f28f1: Status 404 returned error can't find the container with id ef5074f007e5eb933962ecefb4c70bf97534012bd93a3bcfcfc1338c4d6f28f1 Jul 02 19:11:28.765907 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.765879 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fa1c139-3c9d-4252-8f3e-4da234afa1df-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc\" (UID: \"6fa1c139-3c9d-4252-8f3e-4da234afa1df\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc" Jul 02 19:11:28.766005 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.765962 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fa1c139-3c9d-4252-8f3e-4da234afa1df-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc\" (UID: \"6fa1c139-3c9d-4252-8f3e-4da234afa1df\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc" Jul 02 19:11:28.766005 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.765980 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kvss\" (UniqueName: \"kubernetes.io/projected/6fa1c139-3c9d-4252-8f3e-4da234afa1df-kube-api-access-8kvss\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc\" (UID: \"6fa1c139-3c9d-4252-8f3e-4da234afa1df\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc" Jul 02 19:11:28.766305 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.766288 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fa1c139-3c9d-4252-8f3e-4da234afa1df-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc\" (UID: \"6fa1c139-3c9d-4252-8f3e-4da234afa1df\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc" Jul 02 19:11:28.766344 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.766285 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fa1c139-3c9d-4252-8f3e-4da234afa1df-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc\" (UID: \"6fa1c139-3c9d-4252-8f3e-4da234afa1df\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc" Jul 02 19:11:28.779567 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.779537 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kvss\" (UniqueName: \"kubernetes.io/projected/6fa1c139-3c9d-4252-8f3e-4da234afa1df-kube-api-access-8kvss\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc\" (UID: \"6fa1c139-3c9d-4252-8f3e-4da234afa1df\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc" Jul 02 19:11:28.882524 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.882495 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc" Jul 02 19:11:28.987043 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.986977 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4"] Jul 02 19:11:28.991825 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:28.991801 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4" Jul 02 19:11:29.009434 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:29.009409 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4"] Jul 02 19:11:29.025533 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:29.025507 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc"] Jul 02 19:11:29.030995 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:11:29.030971 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fa1c139_3c9d_4252_8f3e_4da234afa1df.slice/crio-a61bd831a67dd7f4a402281418b9cd08cbf17352defffdf5a1d35a8ba8192b6a WatchSource:0}: Error finding container a61bd831a67dd7f4a402281418b9cd08cbf17352defffdf5a1d35a8ba8192b6a: Status 404 returned error can't find the container with id a61bd831a67dd7f4a402281418b9cd08cbf17352defffdf5a1d35a8ba8192b6a Jul 02 19:11:29.131902 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:29.130193 2559 generic.go:356] "Generic (PLEG): container finished" podID="493b5e47-74ca-44b1-9bf0-783592e85e0d" containerID="5c56c80fe87ec991e244b94ed6b96bfed7bc36a9e60c49ad232b21d479f9231d" exitCode=0 Jul 02 19:11:29.131902 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:29.130976 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 19:11:29.131902 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:29.131376 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg" event={"ID":"493b5e47-74ca-44b1-9bf0-783592e85e0d","Type":"ContainerDied","Data":"5c56c80fe87ec991e244b94ed6b96bfed7bc36a9e60c49ad232b21d479f9231d"} Jul 02 19:11:29.134921 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:29.134635 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc" event={"ID":"6fa1c139-3c9d-4252-8f3e-4da234afa1df","Type":"ContainerStarted","Data":"df9d2ce49a5da6750cb6d091fa0f6fb4124af3cc6280be4dd4814deb99e57269"} Jul 02 19:11:29.134921 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:29.134681 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc" event={"ID":"6fa1c139-3c9d-4252-8f3e-4da234afa1df","Type":"ContainerStarted","Data":"a61bd831a67dd7f4a402281418b9cd08cbf17352defffdf5a1d35a8ba8192b6a"} Jul 02 19:11:29.136159 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:29.136137 2559 generic.go:356] "Generic (PLEG): container finished" podID="4442a8e3-4a92-4cad-a51c-c0e9a6c1d271" containerID="a5efc77f44cf3a16083519053f0039a5ad83b3800d66f31a76dccb596d657625" exitCode=0 Jul 02 19:11:29.136295 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:29.136219 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz" event={"ID":"4442a8e3-4a92-4cad-a51c-c0e9a6c1d271","Type":"ContainerDied","Data":"a5efc77f44cf3a16083519053f0039a5ad83b3800d66f31a76dccb596d657625"} Jul 02 19:11:29.136295 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:29.136254 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz" event={"ID":"4442a8e3-4a92-4cad-a51c-c0e9a6c1d271","Type":"ContainerStarted","Data":"ef5074f007e5eb933962ecefb4c70bf97534012bd93a3bcfcfc1338c4d6f28f1"} Jul 02 19:11:29.171068 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:29.171040 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02021470-d4db-4cdc-bf9b-552dda77d22e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4\" (UID: \"02021470-d4db-4cdc-bf9b-552dda77d22e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4" Jul 02 19:11:29.171158 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:29.171072 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxnlr\" (UniqueName: \"kubernetes.io/projected/02021470-d4db-4cdc-bf9b-552dda77d22e-kube-api-access-bxnlr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4\" (UID: \"02021470-d4db-4cdc-bf9b-552dda77d22e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4" Jul 02 19:11:29.171158 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:29.171152 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02021470-d4db-4cdc-bf9b-552dda77d22e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4\" (UID: \"02021470-d4db-4cdc-bf9b-552dda77d22e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4" Jul 02 19:11:29.272418 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:29.272335 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02021470-d4db-4cdc-bf9b-552dda77d22e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4\" (UID: \"02021470-d4db-4cdc-bf9b-552dda77d22e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4" Jul 02 19:11:29.272418 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:29.272410 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02021470-d4db-4cdc-bf9b-552dda77d22e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4\" (UID: \"02021470-d4db-4cdc-bf9b-552dda77d22e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4" Jul 02 19:11:29.272642 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:29.272441 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxnlr\" (UniqueName: \"kubernetes.io/projected/02021470-d4db-4cdc-bf9b-552dda77d22e-kube-api-access-bxnlr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4\" (UID: \"02021470-d4db-4cdc-bf9b-552dda77d22e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4" Jul 02 19:11:29.272871 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:29.272821 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02021470-d4db-4cdc-bf9b-552dda77d22e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4\" (UID: \"02021470-d4db-4cdc-bf9b-552dda77d22e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4" Jul 02 19:11:29.272934 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:29.272891 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02021470-d4db-4cdc-bf9b-552dda77d22e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4\" (UID: \"02021470-d4db-4cdc-bf9b-552dda77d22e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4" Jul 02 19:11:29.286790 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:29.286769 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxnlr\" (UniqueName: \"kubernetes.io/projected/02021470-d4db-4cdc-bf9b-552dda77d22e-kube-api-access-bxnlr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4\" (UID: \"02021470-d4db-4cdc-bf9b-552dda77d22e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4" Jul 02 19:11:29.301748 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:29.301730 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4" Jul 02 19:11:29.457456 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:29.457420 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4"] Jul 02 19:11:29.460606 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:11:29.460581 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02021470_d4db_4cdc_bf9b_552dda77d22e.slice/crio-afd09149d83a36c7e20b688c4e27500dbeec3c373109c6a21614df08e23c4295 WatchSource:0}: Error finding container afd09149d83a36c7e20b688c4e27500dbeec3c373109c6a21614df08e23c4295: Status 404 returned error can't find the container with id afd09149d83a36c7e20b688c4e27500dbeec3c373109c6a21614df08e23c4295 Jul 02 19:11:30.143105 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:30.143076 2559 generic.go:356] "Generic (PLEG): container finished" podID="493b5e47-74ca-44b1-9bf0-783592e85e0d" containerID="9fcd4f29143cb578d7a29e4deaac01f8d869c7054ea707848ce83e235486b0d5" exitCode=0 Jul 02 19:11:30.143551 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:30.143168 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg" event={"ID":"493b5e47-74ca-44b1-9bf0-783592e85e0d","Type":"ContainerDied","Data":"9fcd4f29143cb578d7a29e4deaac01f8d869c7054ea707848ce83e235486b0d5"} Jul 02 19:11:30.144641 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:30.144619 2559 generic.go:356] "Generic (PLEG): container finished" podID="6fa1c139-3c9d-4252-8f3e-4da234afa1df" containerID="df9d2ce49a5da6750cb6d091fa0f6fb4124af3cc6280be4dd4814deb99e57269" exitCode=0 Jul 02 19:11:30.144740 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:30.144700 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc" event={"ID":"6fa1c139-3c9d-4252-8f3e-4da234afa1df","Type":"ContainerDied","Data":"df9d2ce49a5da6750cb6d091fa0f6fb4124af3cc6280be4dd4814deb99e57269"} Jul 02 19:11:30.146663 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:30.146641 2559 generic.go:356] "Generic (PLEG): container finished" podID="4442a8e3-4a92-4cad-a51c-c0e9a6c1d271" containerID="4b10c01c7e998e210fac5670da32c4f770f569f03c2d5a755eb9ad719f74005e" exitCode=0 Jul 02 19:11:30.146767 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:30.146720 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz" event={"ID":"4442a8e3-4a92-4cad-a51c-c0e9a6c1d271","Type":"ContainerDied","Data":"4b10c01c7e998e210fac5670da32c4f770f569f03c2d5a755eb9ad719f74005e"} Jul 02 19:11:30.148410 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:30.148341 2559 generic.go:356] "Generic (PLEG): container finished" podID="02021470-d4db-4cdc-bf9b-552dda77d22e" containerID="d850a6346ae0988132f44f830628beffa00c61b5ac1a9784e7e6a05385912775" exitCode=0 Jul 02 19:11:30.148477 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:30.148423 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4" event={"ID":"02021470-d4db-4cdc-bf9b-552dda77d22e","Type":"ContainerDied","Data":"d850a6346ae0988132f44f830628beffa00c61b5ac1a9784e7e6a05385912775"} Jul 02 19:11:30.148477 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:30.148465 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4" event={"ID":"02021470-d4db-4cdc-bf9b-552dda77d22e","Type":"ContainerStarted","Data":"afd09149d83a36c7e20b688c4e27500dbeec3c373109c6a21614df08e23c4295"} Jul 02 19:11:31.155566 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:31.155489 2559 generic.go:356] "Generic (PLEG): container finished" podID="493b5e47-74ca-44b1-9bf0-783592e85e0d" containerID="59be5ccc10b3f1ffa0369dfa58455f2ed4979405e9860b68ab7e4350165a2e0f" exitCode=0 Jul 02 19:11:31.155970 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:31.155572 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg" event={"ID":"493b5e47-74ca-44b1-9bf0-783592e85e0d","Type":"ContainerDied","Data":"59be5ccc10b3f1ffa0369dfa58455f2ed4979405e9860b68ab7e4350165a2e0f"} Jul 02 19:11:31.157509 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:31.157488 2559 generic.go:356] "Generic (PLEG): container finished" podID="4442a8e3-4a92-4cad-a51c-c0e9a6c1d271" containerID="eaea6dda7eb7cbd8a6dae83c961474ec2f4b47ac6b52155633f5cc1790e4e6fc" exitCode=0 Jul 02 19:11:31.157600 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:31.157564 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz" event={"ID":"4442a8e3-4a92-4cad-a51c-c0e9a6c1d271","Type":"ContainerDied","Data":"eaea6dda7eb7cbd8a6dae83c961474ec2f4b47ac6b52155633f5cc1790e4e6fc"} Jul 02 19:11:31.159117 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:31.159098 2559 generic.go:356] "Generic (PLEG): container finished" podID="02021470-d4db-4cdc-bf9b-552dda77d22e" containerID="7ad7a52e4182bf27d222ea9892d6d03446189d72e2328379bf76b3694b5c770d" exitCode=0 Jul 02 19:11:31.159219 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:31.159161 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4" event={"ID":"02021470-d4db-4cdc-bf9b-552dda77d22e","Type":"ContainerDied","Data":"7ad7a52e4182bf27d222ea9892d6d03446189d72e2328379bf76b3694b5c770d"} Jul 02 19:11:32.165817 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:32.165780 2559 generic.go:356] "Generic (PLEG): container finished" podID="6fa1c139-3c9d-4252-8f3e-4da234afa1df" containerID="fc09ec2737e351cc351bdff77e8cc240b5c3de36c6ceb54bad16122528fa62f6" exitCode=0 Jul 02 19:11:32.166217 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:32.165886 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc" event={"ID":"6fa1c139-3c9d-4252-8f3e-4da234afa1df","Type":"ContainerDied","Data":"fc09ec2737e351cc351bdff77e8cc240b5c3de36c6ceb54bad16122528fa62f6"} Jul 02 19:11:32.167984 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:32.167961 2559 generic.go:356] "Generic (PLEG): container finished" podID="02021470-d4db-4cdc-bf9b-552dda77d22e" containerID="cf7047aae2f92ccd863c02d0c9e5880944cef4b149cd5a1691760c106a9977d2" exitCode=0 Jul 02 19:11:32.168084 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:32.168042 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4" event={"ID":"02021470-d4db-4cdc-bf9b-552dda77d22e","Type":"ContainerDied","Data":"cf7047aae2f92ccd863c02d0c9e5880944cef4b149cd5a1691760c106a9977d2"} Jul 02 19:11:32.378036 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:32.378013 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg" Jul 02 19:11:32.381158 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:32.381142 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz" Jul 02 19:11:32.500840 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:32.500737 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g25vs\" (UniqueName: \"kubernetes.io/projected/493b5e47-74ca-44b1-9bf0-783592e85e0d-kube-api-access-g25vs\") pod \"493b5e47-74ca-44b1-9bf0-783592e85e0d\" (UID: \"493b5e47-74ca-44b1-9bf0-783592e85e0d\") " Jul 02 19:11:32.500840 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:32.500799 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4442a8e3-4a92-4cad-a51c-c0e9a6c1d271-util\") pod \"4442a8e3-4a92-4cad-a51c-c0e9a6c1d271\" (UID: \"4442a8e3-4a92-4cad-a51c-c0e9a6c1d271\") " Jul 02 19:11:32.500840 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:32.500839 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/493b5e47-74ca-44b1-9bf0-783592e85e0d-bundle\") pod \"493b5e47-74ca-44b1-9bf0-783592e85e0d\" (UID: \"493b5e47-74ca-44b1-9bf0-783592e85e0d\") " Jul 02 19:11:32.501121 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:32.500918 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65mkt\" (UniqueName: \"kubernetes.io/projected/4442a8e3-4a92-4cad-a51c-c0e9a6c1d271-kube-api-access-65mkt\") pod \"4442a8e3-4a92-4cad-a51c-c0e9a6c1d271\" (UID: \"4442a8e3-4a92-4cad-a51c-c0e9a6c1d271\") " Jul 02 19:11:32.501121 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:32.500942 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/493b5e47-74ca-44b1-9bf0-783592e85e0d-util\") pod \"493b5e47-74ca-44b1-9bf0-783592e85e0d\" (UID: \"493b5e47-74ca-44b1-9bf0-783592e85e0d\") " Jul 02 19:11:32.501121 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:32.500967 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4442a8e3-4a92-4cad-a51c-c0e9a6c1d271-bundle\") pod \"4442a8e3-4a92-4cad-a51c-c0e9a6c1d271\" (UID: \"4442a8e3-4a92-4cad-a51c-c0e9a6c1d271\") " Jul 02 19:11:32.501506 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:32.501473 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/493b5e47-74ca-44b1-9bf0-783592e85e0d-bundle" (OuterVolumeSpecName: "bundle") pod "493b5e47-74ca-44b1-9bf0-783592e85e0d" (UID: "493b5e47-74ca-44b1-9bf0-783592e85e0d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:11:32.501697 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:32.501667 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4442a8e3-4a92-4cad-a51c-c0e9a6c1d271-bundle" (OuterVolumeSpecName: "bundle") pod "4442a8e3-4a92-4cad-a51c-c0e9a6c1d271" (UID: "4442a8e3-4a92-4cad-a51c-c0e9a6c1d271"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:11:32.503121 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:32.503098 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/493b5e47-74ca-44b1-9bf0-783592e85e0d-kube-api-access-g25vs" (OuterVolumeSpecName: "kube-api-access-g25vs") pod "493b5e47-74ca-44b1-9bf0-783592e85e0d" (UID: "493b5e47-74ca-44b1-9bf0-783592e85e0d"). InnerVolumeSpecName "kube-api-access-g25vs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:11:32.503210 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:32.503153 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4442a8e3-4a92-4cad-a51c-c0e9a6c1d271-kube-api-access-65mkt" (OuterVolumeSpecName: "kube-api-access-65mkt") pod "4442a8e3-4a92-4cad-a51c-c0e9a6c1d271" (UID: "4442a8e3-4a92-4cad-a51c-c0e9a6c1d271"). InnerVolumeSpecName "kube-api-access-65mkt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:11:32.506164 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:32.506131 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4442a8e3-4a92-4cad-a51c-c0e9a6c1d271-util" (OuterVolumeSpecName: "util") pod "4442a8e3-4a92-4cad-a51c-c0e9a6c1d271" (UID: "4442a8e3-4a92-4cad-a51c-c0e9a6c1d271"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:11:32.506395 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:32.506372 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/493b5e47-74ca-44b1-9bf0-783592e85e0d-util" (OuterVolumeSpecName: "util") pod "493b5e47-74ca-44b1-9bf0-783592e85e0d" (UID: "493b5e47-74ca-44b1-9bf0-783592e85e0d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:11:32.601791 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:32.601768 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65mkt\" (UniqueName: \"kubernetes.io/projected/4442a8e3-4a92-4cad-a51c-c0e9a6c1d271-kube-api-access-65mkt\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:11:32.601791 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:32.601791 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/493b5e47-74ca-44b1-9bf0-783592e85e0d-util\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:11:32.601966 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:32.601803 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4442a8e3-4a92-4cad-a51c-c0e9a6c1d271-bundle\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:11:32.601966 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:32.601811 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g25vs\" (UniqueName: \"kubernetes.io/projected/493b5e47-74ca-44b1-9bf0-783592e85e0d-kube-api-access-g25vs\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:11:32.601966 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:32.601820 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4442a8e3-4a92-4cad-a51c-c0e9a6c1d271-util\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:11:32.601966 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:32.601834 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/493b5e47-74ca-44b1-9bf0-783592e85e0d-bundle\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:11:33.175168 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:33.175091 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg" Jul 02 19:11:33.175168 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:33.175095 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg" event={"ID":"493b5e47-74ca-44b1-9bf0-783592e85e0d","Type":"ContainerDied","Data":"36406c33a32c09122b3566b217f8d4fe3f8965357a47f40a677cece2dd7a19ce"} Jul 02 19:11:33.175168 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:33.175137 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36406c33a32c09122b3566b217f8d4fe3f8965357a47f40a677cece2dd7a19ce" Jul 02 19:11:33.177226 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:33.177201 2559 generic.go:356] "Generic (PLEG): container finished" podID="6fa1c139-3c9d-4252-8f3e-4da234afa1df" containerID="553fcab273d51545cfb619c0c1ccd06dce1b6d6449d6da646cbd2548a738d0a7" exitCode=0 Jul 02 19:11:33.177360 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:33.177284 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc" event={"ID":"6fa1c139-3c9d-4252-8f3e-4da234afa1df","Type":"ContainerDied","Data":"553fcab273d51545cfb619c0c1ccd06dce1b6d6449d6da646cbd2548a738d0a7"} Jul 02 19:11:33.179166 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:33.179148 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz" Jul 02 19:11:33.179266 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:33.179180 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz" event={"ID":"4442a8e3-4a92-4cad-a51c-c0e9a6c1d271","Type":"ContainerDied","Data":"ef5074f007e5eb933962ecefb4c70bf97534012bd93a3bcfcfc1338c4d6f28f1"} Jul 02 19:11:33.179266 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:33.179212 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef5074f007e5eb933962ecefb4c70bf97534012bd93a3bcfcfc1338c4d6f28f1" Jul 02 19:11:33.309271 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:33.309245 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4" Jul 02 19:11:33.408817 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:33.408784 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02021470-d4db-4cdc-bf9b-552dda77d22e-bundle\") pod \"02021470-d4db-4cdc-bf9b-552dda77d22e\" (UID: \"02021470-d4db-4cdc-bf9b-552dda77d22e\") " Jul 02 19:11:33.408995 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:33.408842 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxnlr\" (UniqueName: \"kubernetes.io/projected/02021470-d4db-4cdc-bf9b-552dda77d22e-kube-api-access-bxnlr\") pod \"02021470-d4db-4cdc-bf9b-552dda77d22e\" (UID: \"02021470-d4db-4cdc-bf9b-552dda77d22e\") " Jul 02 19:11:33.408995 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:33.408921 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02021470-d4db-4cdc-bf9b-552dda77d22e-util\") pod \"02021470-d4db-4cdc-bf9b-552dda77d22e\" (UID: \"02021470-d4db-4cdc-bf9b-552dda77d22e\") " Jul 02 19:11:33.409457 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:33.409433 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02021470-d4db-4cdc-bf9b-552dda77d22e-bundle" (OuterVolumeSpecName: "bundle") pod "02021470-d4db-4cdc-bf9b-552dda77d22e" (UID: "02021470-d4db-4cdc-bf9b-552dda77d22e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:11:33.411025 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:33.411000 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02021470-d4db-4cdc-bf9b-552dda77d22e-kube-api-access-bxnlr" (OuterVolumeSpecName: "kube-api-access-bxnlr") pod "02021470-d4db-4cdc-bf9b-552dda77d22e" (UID: "02021470-d4db-4cdc-bf9b-552dda77d22e"). InnerVolumeSpecName "kube-api-access-bxnlr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:11:33.414220 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:33.414196 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02021470-d4db-4cdc-bf9b-552dda77d22e-util" (OuterVolumeSpecName: "util") pod "02021470-d4db-4cdc-bf9b-552dda77d22e" (UID: "02021470-d4db-4cdc-bf9b-552dda77d22e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:11:33.509899 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:33.509791 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02021470-d4db-4cdc-bf9b-552dda77d22e-bundle\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:11:33.509899 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:33.509820 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxnlr\" (UniqueName: \"kubernetes.io/projected/02021470-d4db-4cdc-bf9b-552dda77d22e-kube-api-access-bxnlr\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:11:33.509899 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:33.509830 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02021470-d4db-4cdc-bf9b-552dda77d22e-util\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:11:34.185694 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:34.185665 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4" Jul 02 19:11:34.185694 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:34.185674 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4" event={"ID":"02021470-d4db-4cdc-bf9b-552dda77d22e","Type":"ContainerDied","Data":"afd09149d83a36c7e20b688c4e27500dbeec3c373109c6a21614df08e23c4295"} Jul 02 19:11:34.186123 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:34.185717 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="afd09149d83a36c7e20b688c4e27500dbeec3c373109c6a21614df08e23c4295" Jul 02 19:11:34.314574 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:34.314551 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc" Jul 02 19:11:34.418897 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:34.418869 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fa1c139-3c9d-4252-8f3e-4da234afa1df-bundle\") pod \"6fa1c139-3c9d-4252-8f3e-4da234afa1df\" (UID: \"6fa1c139-3c9d-4252-8f3e-4da234afa1df\") " Jul 02 19:11:34.419028 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:34.418926 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fa1c139-3c9d-4252-8f3e-4da234afa1df-util\") pod \"6fa1c139-3c9d-4252-8f3e-4da234afa1df\" (UID: \"6fa1c139-3c9d-4252-8f3e-4da234afa1df\") " Jul 02 19:11:34.419028 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:34.418980 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kvss\" (UniqueName: \"kubernetes.io/projected/6fa1c139-3c9d-4252-8f3e-4da234afa1df-kube-api-access-8kvss\") pod \"6fa1c139-3c9d-4252-8f3e-4da234afa1df\" (UID: \"6fa1c139-3c9d-4252-8f3e-4da234afa1df\") " Jul 02 19:11:34.419337 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:34.419309 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fa1c139-3c9d-4252-8f3e-4da234afa1df-bundle" (OuterVolumeSpecName: "bundle") pod "6fa1c139-3c9d-4252-8f3e-4da234afa1df" (UID: "6fa1c139-3c9d-4252-8f3e-4da234afa1df"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:11:34.420891 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:34.420864 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fa1c139-3c9d-4252-8f3e-4da234afa1df-kube-api-access-8kvss" (OuterVolumeSpecName: "kube-api-access-8kvss") pod "6fa1c139-3c9d-4252-8f3e-4da234afa1df" (UID: "6fa1c139-3c9d-4252-8f3e-4da234afa1df"). InnerVolumeSpecName "kube-api-access-8kvss". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:11:34.423874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:34.423826 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fa1c139-3c9d-4252-8f3e-4da234afa1df-util" (OuterVolumeSpecName: "util") pod "6fa1c139-3c9d-4252-8f3e-4da234afa1df" (UID: "6fa1c139-3c9d-4252-8f3e-4da234afa1df"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:11:34.520650 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:34.520570 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fa1c139-3c9d-4252-8f3e-4da234afa1df-bundle\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:11:34.520650 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:34.520597 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fa1c139-3c9d-4252-8f3e-4da234afa1df-util\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:11:34.520650 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:34.520607 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kvss\" (UniqueName: \"kubernetes.io/projected/6fa1c139-3c9d-4252-8f3e-4da234afa1df-kube-api-access-8kvss\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:11:35.192688 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:35.192603 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc" Jul 02 19:11:35.192688 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:35.192639 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc" event={"ID":"6fa1c139-3c9d-4252-8f3e-4da234afa1df","Type":"ContainerDied","Data":"a61bd831a67dd7f4a402281418b9cd08cbf17352defffdf5a1d35a8ba8192b6a"} Jul 02 19:11:35.193123 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:35.192695 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a61bd831a67dd7f4a402281418b9cd08cbf17352defffdf5a1d35a8ba8192b6a" Jul 02 19:11:39.855045 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:39.855010 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:41.492934 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:41.492893 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:44.612595 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:44.612560 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:46.532045 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:46.532012 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:48.390759 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:48.390727 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:48.523290 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:48.523259 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:50.812336 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:50.812298 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:50.968346 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:50.968311 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:51.174958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:51.174928 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:51.279752 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:51.279717 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:51.423870 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:51.423814 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:51.732752 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:51.732721 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:52.635097 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:52.635068 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:52.965741 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:52.965665 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:53.172871 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:53.172817 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:53.274627 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:53.274542 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:56.152387 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:56.152353 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:11:56.252748 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:11:56.252718 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:03.840805 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:03.840771 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:03.952836 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:03.952798 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:05.859598 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:05.859560 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:05.960185 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:05.960127 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:08.628038 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:08.628004 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:08.723620 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:08.723582 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:13.383993 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:13.383957 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:13.487457 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:13.487417 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:17.586042 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:17.586005 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:17.712720 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:17.712685 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:24.764969 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:24.764933 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:24.851407 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:24.851361 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:28.960601 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:28.960567 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:29.068693 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:29.068664 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:33.766873 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:33.766818 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:33.865884 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:33.865799 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:36.803831 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:36.803771 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:36.970305 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:36.970274 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:41.236285 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.236253 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:41.357401 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.357365 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:41.460225 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.460194 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:41.563165 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.563082 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:41.671554 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.671521 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:12:41.671887 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.671875 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="493b5e47-74ca-44b1-9bf0-783592e85e0d" containerName="extract" Jul 02 19:12:41.671887 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.671888 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="493b5e47-74ca-44b1-9bf0-783592e85e0d" containerName="extract" Jul 02 19:12:41.671975 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.671899 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4442a8e3-4a92-4cad-a51c-c0e9a6c1d271" containerName="pull" Jul 02 19:12:41.671975 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.671904 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4442a8e3-4a92-4cad-a51c-c0e9a6c1d271" containerName="pull" Jul 02 19:12:41.671975 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.671917 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="493b5e47-74ca-44b1-9bf0-783592e85e0d" containerName="util" Jul 02 19:12:41.671975 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.671923 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="493b5e47-74ca-44b1-9bf0-783592e85e0d" containerName="util" Jul 02 19:12:41.671975 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.671933 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4442a8e3-4a92-4cad-a51c-c0e9a6c1d271" containerName="util" Jul 02 19:12:41.671975 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.671939 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4442a8e3-4a92-4cad-a51c-c0e9a6c1d271" containerName="util" Jul 02 19:12:41.671975 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.671944 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="493b5e47-74ca-44b1-9bf0-783592e85e0d" containerName="pull" Jul 02 19:12:41.671975 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.671949 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="493b5e47-74ca-44b1-9bf0-783592e85e0d" containerName="pull" Jul 02 19:12:41.671975 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.671958 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02021470-d4db-4cdc-bf9b-552dda77d22e" containerName="extract" Jul 02 19:12:41.671975 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.671964 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="02021470-d4db-4cdc-bf9b-552dda77d22e" containerName="extract" Jul 02 19:12:41.671975 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.671970 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4442a8e3-4a92-4cad-a51c-c0e9a6c1d271" containerName="extract" Jul 02 19:12:41.671975 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.671975 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4442a8e3-4a92-4cad-a51c-c0e9a6c1d271" containerName="extract" Jul 02 19:12:41.671975 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.671980 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02021470-d4db-4cdc-bf9b-552dda77d22e" containerName="pull" Jul 02 19:12:41.672387 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.671986 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="02021470-d4db-4cdc-bf9b-552dda77d22e" containerName="pull" Jul 02 19:12:41.672387 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.671991 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fa1c139-3c9d-4252-8f3e-4da234afa1df" containerName="extract" Jul 02 19:12:41.672387 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.671998 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fa1c139-3c9d-4252-8f3e-4da234afa1df" containerName="extract" Jul 02 19:12:41.672387 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.672005 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fa1c139-3c9d-4252-8f3e-4da234afa1df" containerName="util" Jul 02 19:12:41.672387 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.672010 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fa1c139-3c9d-4252-8f3e-4da234afa1df" containerName="util" Jul 02 19:12:41.672387 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.672016 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02021470-d4db-4cdc-bf9b-552dda77d22e" containerName="util" Jul 02 19:12:41.672387 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.672021 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="02021470-d4db-4cdc-bf9b-552dda77d22e" containerName="util" Jul 02 19:12:41.672387 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.672028 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fa1c139-3c9d-4252-8f3e-4da234afa1df" containerName="pull" Jul 02 19:12:41.672387 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.672032 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fa1c139-3c9d-4252-8f3e-4da234afa1df" containerName="pull" Jul 02 19:12:41.672387 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.672099 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4442a8e3-4a92-4cad-a51c-c0e9a6c1d271" containerName="extract" Jul 02 19:12:41.672387 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.672107 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="02021470-d4db-4cdc-bf9b-552dda77d22e" containerName="extract" Jul 02 19:12:41.672387 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.672114 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fa1c139-3c9d-4252-8f3e-4da234afa1df" containerName="extract" Jul 02 19:12:41.672387 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.672119 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="493b5e47-74ca-44b1-9bf0-783592e85e0d" containerName="extract" Jul 02 19:12:41.675064 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.675049 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-bsfzn" Jul 02 19:12:41.677547 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.677527 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 19:12:41.677547 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.677538 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 02 19:12:41.677547 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.677545 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 19:12:41.678215 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.678202 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gfjmq\"" Jul 02 19:12:41.685192 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.685173 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:12:41.715443 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.715418 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:12:41.788713 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.788685 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c077dd56-5a5b-4111-9eb4-b039ab766156-config-file\") pod \"limitador-limitador-54d6d988d5-bsfzn\" (UID: \"c077dd56-5a5b-4111-9eb4-b039ab766156\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bsfzn" Jul 02 19:12:41.788831 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.788720 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5ql2\" (UniqueName: \"kubernetes.io/projected/c077dd56-5a5b-4111-9eb4-b039ab766156-kube-api-access-c5ql2\") pod \"limitador-limitador-54d6d988d5-bsfzn\" (UID: \"c077dd56-5a5b-4111-9eb4-b039ab766156\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bsfzn" Jul 02 19:12:41.889181 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.889152 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c077dd56-5a5b-4111-9eb4-b039ab766156-config-file\") pod \"limitador-limitador-54d6d988d5-bsfzn\" (UID: \"c077dd56-5a5b-4111-9eb4-b039ab766156\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bsfzn" Jul 02 19:12:41.889331 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.889196 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5ql2\" (UniqueName: \"kubernetes.io/projected/c077dd56-5a5b-4111-9eb4-b039ab766156-kube-api-access-c5ql2\") pod \"limitador-limitador-54d6d988d5-bsfzn\" (UID: \"c077dd56-5a5b-4111-9eb4-b039ab766156\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bsfzn" Jul 02 19:12:41.889793 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.889774 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c077dd56-5a5b-4111-9eb4-b039ab766156-config-file\") pod \"limitador-limitador-54d6d988d5-bsfzn\" (UID: \"c077dd56-5a5b-4111-9eb4-b039ab766156\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bsfzn" Jul 02 19:12:41.897202 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.897175 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5ql2\" (UniqueName: \"kubernetes.io/projected/c077dd56-5a5b-4111-9eb4-b039ab766156-kube-api-access-c5ql2\") pod \"limitador-limitador-54d6d988d5-bsfzn\" (UID: \"c077dd56-5a5b-4111-9eb4-b039ab766156\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bsfzn" Jul 02 19:12:41.986205 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:41.986169 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-bsfzn" Jul 02 19:12:42.101395 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:42.101370 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:42.114662 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:42.114637 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:12:42.116320 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:12:42.116296 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc077dd56_5a5b_4111_9eb4_b039ab766156.slice/crio-9b6b3a10b53401c94da865a7322dffe673c00f42bfa335a5ca85d94e4bca844e WatchSource:0}: Error finding container 9b6b3a10b53401c94da865a7322dffe673c00f42bfa335a5ca85d94e4bca844e: Status 404 returned error can't find the container with id 9b6b3a10b53401c94da865a7322dffe673c00f42bfa335a5ca85d94e4bca844e Jul 02 19:12:42.163199 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:42.163121 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:12:42.524017 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:42.523933 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-bsfzn" event={"ID":"c077dd56-5a5b-4111-9eb4-b039ab766156","Type":"ContainerStarted","Data":"9b6b3a10b53401c94da865a7322dffe673c00f42bfa335a5ca85d94e4bca844e"} Jul 02 19:12:45.541926 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:45.541882 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-bsfzn" event={"ID":"c077dd56-5a5b-4111-9eb4-b039ab766156","Type":"ContainerStarted","Data":"e14ffc173739968f3b35368882d4d485031037636ecb6cebf476c621a81be105"} Jul 02 19:12:45.542300 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:45.541973 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-bsfzn" Jul 02 19:12:45.559618 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:45.559565 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-bsfzn" podStartSLOduration=2.021187254 podStartE2EDuration="4.5595513s" totalImagesPullingTime="2.538364046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:12:45.557048738 +0000 UTC m=+693.219017888" watchObservedRunningTime="2026-07-02 19:12:45.5595513 +0000 UTC m=+693.221520449" Jul 02 19:12:56.548298 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:12:56.548271 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-bsfzn" Jul 02 19:13:02.875436 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:13:02.875399 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:13:02.947490 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:13:02.947461 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:13:15.665479 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:13:15.665409 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:13:15.875124 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:13:15.875091 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:13:22.121037 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:13:22.121001 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:13:22.224160 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:13:22.224126 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:13:22.330117 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:13:22.330082 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:13:24.906550 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:13:24.906512 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:13:24.992727 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:13:24.992687 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:13:53.999653 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:13:53.999616 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:13:54.507741 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:13:54.507705 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:13:54.831517 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:13:54.831435 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:13:55.034719 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:13:55.034684 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:13:55.107352 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:13:55.107316 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:13:55.128025 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:13:55.127992 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:14:05.572263 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:14:05.572226 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:14:05.674076 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:14:05.674042 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:14:15.781310 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:14:15.781276 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:14:16.189218 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:14:16.189180 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:14:29.797912 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:14:29.797878 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:14:30.595209 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:14:30.595180 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:14:39.898653 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:14:39.898585 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:14:41.095537 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:14:41.095499 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:14:42.784766 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:14:42.784735 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:14:47.355673 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:14:47.355643 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:14:47.401611 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:14:47.401564 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:14:50.029525 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:14:50.029496 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:14:52.990493 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:14:52.990464 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:15:00.147070 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:15:00.147028 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29716995-xjrhw"] Jul 02 19:15:00.150099 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:15:00.150083 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29716995-xjrhw" Jul 02 19:15:00.153085 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:15:00.153068 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-n2w8x\"" Jul 02 19:15:00.158456 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:15:00.158428 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29716995-xjrhw"] Jul 02 19:15:00.233958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:15:00.233931 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2sb4\" (UniqueName: \"kubernetes.io/projected/4ef3d67e-93df-4285-8db7-30f0062f6f7b-kube-api-access-k2sb4\") pod \"maas-api-key-cleanup-29716995-xjrhw\" (UID: \"4ef3d67e-93df-4285-8db7-30f0062f6f7b\") " pod="opendatahub/maas-api-key-cleanup-29716995-xjrhw" Jul 02 19:15:00.334538 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:15:00.334511 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2sb4\" (UniqueName: \"kubernetes.io/projected/4ef3d67e-93df-4285-8db7-30f0062f6f7b-kube-api-access-k2sb4\") pod \"maas-api-key-cleanup-29716995-xjrhw\" (UID: \"4ef3d67e-93df-4285-8db7-30f0062f6f7b\") " pod="opendatahub/maas-api-key-cleanup-29716995-xjrhw" Jul 02 19:15:00.346238 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:15:00.346212 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2sb4\" (UniqueName: \"kubernetes.io/projected/4ef3d67e-93df-4285-8db7-30f0062f6f7b-kube-api-access-k2sb4\") pod \"maas-api-key-cleanup-29716995-xjrhw\" (UID: \"4ef3d67e-93df-4285-8db7-30f0062f6f7b\") " pod="opendatahub/maas-api-key-cleanup-29716995-xjrhw" Jul 02 19:15:00.460698 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:15:00.460637 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29716995-xjrhw" Jul 02 19:15:00.598172 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:15:00.598144 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29716995-xjrhw"] Jul 02 19:15:00.601623 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:15:00.601591 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ef3d67e_93df_4285_8db7_30f0062f6f7b.slice/crio-19155d314c4c137db68c817307e5b9a07b3cb61b3bfd10f6df7976eb94d53479 WatchSource:0}: Error finding container 19155d314c4c137db68c817307e5b9a07b3cb61b3bfd10f6df7976eb94d53479: Status 404 returned error can't find the container with id 19155d314c4c137db68c817307e5b9a07b3cb61b3bfd10f6df7976eb94d53479 Jul 02 19:15:01.237205 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:15:01.237169 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29716995-xjrhw" event={"ID":"4ef3d67e-93df-4285-8db7-30f0062f6f7b","Type":"ContainerStarted","Data":"19155d314c4c137db68c817307e5b9a07b3cb61b3bfd10f6df7976eb94d53479"} Jul 02 19:15:03.250569 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:15:03.250490 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29716995-xjrhw" event={"ID":"4ef3d67e-93df-4285-8db7-30f0062f6f7b","Type":"ContainerStarted","Data":"e418943ff5eb3d481ffab93c984ea83ba8b4e02ca8dd8e259af7e201f0971d60"} Jul 02 19:15:03.269005 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:15:03.268956 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29716995-xjrhw" podStartSLOduration=1.000588313 podStartE2EDuration="3.268941475s" totalImagesPullingTime="2.268353162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:15:03.266615969 +0000 UTC m=+830.928585119" watchObservedRunningTime="2026-07-02 19:15:03.268941475 +0000 UTC m=+830.930910624" Jul 02 19:15:04.256783 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:15:04.256747 2559 generic.go:356] "Generic (PLEG): container finished" podID="4ef3d67e-93df-4285-8db7-30f0062f6f7b" containerID="e418943ff5eb3d481ffab93c984ea83ba8b4e02ca8dd8e259af7e201f0971d60" exitCode=0 Jul 02 19:15:04.256783 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:15:04.256786 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29716995-xjrhw" event={"ID":"4ef3d67e-93df-4285-8db7-30f0062f6f7b","Type":"ContainerDied","Data":"e418943ff5eb3d481ffab93c984ea83ba8b4e02ca8dd8e259af7e201f0971d60"} Jul 02 19:15:05.390822 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:15:05.390796 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29716995-xjrhw" Jul 02 19:15:05.482095 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:15:05.482057 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2sb4\" (UniqueName: \"kubernetes.io/projected/4ef3d67e-93df-4285-8db7-30f0062f6f7b-kube-api-access-k2sb4\") pod \"4ef3d67e-93df-4285-8db7-30f0062f6f7b\" (UID: \"4ef3d67e-93df-4285-8db7-30f0062f6f7b\") " Jul 02 19:15:05.484191 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:15:05.484159 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ef3d67e-93df-4285-8db7-30f0062f6f7b-kube-api-access-k2sb4" (OuterVolumeSpecName: "kube-api-access-k2sb4") pod "4ef3d67e-93df-4285-8db7-30f0062f6f7b" (UID: "4ef3d67e-93df-4285-8db7-30f0062f6f7b"). InnerVolumeSpecName "kube-api-access-k2sb4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:15:05.583525 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:15:05.583465 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2sb4\" (UniqueName: \"kubernetes.io/projected/4ef3d67e-93df-4285-8db7-30f0062f6f7b-kube-api-access-k2sb4\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:15:06.268146 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:15:06.268120 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29716995-xjrhw" Jul 02 19:15:06.268314 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:15:06.268117 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29716995-xjrhw" event={"ID":"4ef3d67e-93df-4285-8db7-30f0062f6f7b","Type":"ContainerDied","Data":"19155d314c4c137db68c817307e5b9a07b3cb61b3bfd10f6df7976eb94d53479"} Jul 02 19:15:06.268314 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:15:06.268243 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="19155d314c4c137db68c817307e5b9a07b3cb61b3bfd10f6df7976eb94d53479" Jul 02 19:15:11.400732 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:15:11.400700 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:15:13.891759 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:15:13.891720 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:15:29.644285 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:15:29.644252 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:15:29.706472 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:15:29.706448 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:16:12.822549 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:16:12.822459 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gf2s_a95b977b-6b92-411f-a185-ecc012668bff/ovn-acl-logging/0.log" Jul 02 19:16:12.825272 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:16:12.825247 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gf2s_a95b977b-6b92-411f-a185-ecc012668bff/ovn-acl-logging/0.log" Jul 02 19:16:13.474358 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:16:13.474327 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:16:32.315017 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:16:32.314967 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:16:32.411169 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:16:32.411144 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:16:33.448195 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:16:33.448158 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:16:33.644531 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:16:33.644499 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:17:01.189583 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:17:01.189546 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:17:12.123328 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:17:12.123292 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:17:12.784452 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:17:12.784420 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:17:23.195645 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:17:23.195608 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:17:31.885335 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:17:31.885303 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:17:42.293536 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:17:42.293450 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:17:45.062357 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:17:45.062317 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:17:46.429718 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:17:46.429684 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:18:14.574010 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:18:14.573978 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:18:19.973756 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:18:19.973722 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:18:20.071035 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:18:20.071004 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:18:20.179553 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:18:20.179521 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:18:26.081113 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:18:26.081081 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:18:26.186718 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:18:26.186692 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:18:26.279618 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:18:26.279593 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:18:26.453936 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:18:26.453905 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:18:32.396277 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:18:32.396240 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:18:32.477713 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:18:32.477682 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:18:49.284351 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:18:49.284322 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:18:58.792512 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:18:58.792466 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:19:09.084373 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:19:09.084296 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:19:18.294032 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:19:18.293997 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:19:29.653329 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:19:29.653295 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:19:38.891471 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:19:38.891438 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:19:50.085743 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:19:50.085707 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:19:57.300825 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:19:57.300790 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:20:04.590597 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:20:04.590564 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:20:10.301476 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:20:10.301446 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:20:13.208313 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:20:13.208267 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:20:25.385189 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:20:25.385149 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:20:35.986368 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:20:35.986294 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:21:00.683035 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:21:00.683002 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:21:12.861132 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:21:12.861105 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gf2s_a95b977b-6b92-411f-a185-ecc012668bff/ovn-acl-logging/0.log" Jul 02 19:21:12.864339 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:21:12.864321 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gf2s_a95b977b-6b92-411f-a185-ecc012668bff/ovn-acl-logging/0.log" Jul 02 19:21:13.008412 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:21:13.008368 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:21:27.084508 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:21:27.084472 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:21:38.415561 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:21:38.415525 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:21:47.800010 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:21:47.799968 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:21:57.296436 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:21:57.296401 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:22:05.793047 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:22:05.792970 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:22:06.911830 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:22:06.911795 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:23:56.485099 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:23:56.485061 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:24:05.194673 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:24:05.194635 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:24:09.301492 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:24:09.301461 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:24:20.290137 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:24:20.290103 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:24:28.889447 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:24:28.889413 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:24:38.098935 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:24:38.098902 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:24:47.698544 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:24:47.698508 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:24:58.300003 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:24:58.299956 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:25:08.786384 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:25:08.786295 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:25:18.396613 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:25:18.396573 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:25:28.890456 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:25:28.890421 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:25:41.591963 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:25:41.591921 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:25:48.785088 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:25:48.785054 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:26:07.097263 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:26:07.097230 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:26:12.895449 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:26:12.895420 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gf2s_a95b977b-6b92-411f-a185-ecc012668bff/ovn-acl-logging/0.log" Jul 02 19:26:12.900403 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:26:12.900385 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gf2s_a95b977b-6b92-411f-a185-ecc012668bff/ovn-acl-logging/0.log" Jul 02 19:26:15.995064 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:26:15.995026 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:26:26.987254 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:26:26.987222 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:26:39.487510 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:26:39.487473 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:26:53.490877 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:26:53.490829 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:27:04.687146 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:27:04.687111 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:27:13.491054 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:27:13.491021 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:27:24.292865 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:27:24.292809 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:27:28.736372 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:27:28.736342 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:27:32.998811 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:27:32.998777 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:27:42.684464 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:27:42.684421 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:27:54.804569 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:27:54.804535 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:28:04.786326 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:28:04.786289 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:28:16.395566 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:28:16.395536 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:28:25.735086 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:28:25.735053 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:28:37.983464 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:28:37.983431 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:28:46.195151 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:28:46.195115 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:28:58.488074 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:28:58.488041 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:29:10.894509 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:10.894475 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:29:24.478889 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:24.478842 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:29:26.902829 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:26.902795 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:32.992053 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:32.992021 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:29:36.629911 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:36.629808 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:43.889810 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:43.889775 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:29:44.856093 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:44.856055 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:47.937151 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:47.937112 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:48.037037 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:48.037003 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:50.027351 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:50.027310 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:52.698523 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:52.698490 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:29:53.058267 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:53.058179 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:53.161113 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:53.161086 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:53.590144 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:53.590110 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:59.418435 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.418395 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:59.518966 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.518931 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:59.616998 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.616955 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc"] Jul 02 19:29:59.617297 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.617285 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ef3d67e-93df-4285-8db7-30f0062f6f7b" containerName="cleanup" Jul 02 19:29:59.617340 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.617297 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ef3d67e-93df-4285-8db7-30f0062f6f7b" containerName="cleanup" Jul 02 19:29:59.617372 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.617349 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ef3d67e-93df-4285-8db7-30f0062f6f7b" containerName="cleanup" Jul 02 19:29:59.620268 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.620253 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:29:59.622633 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.622617 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-53a62efa-openshift-default-dockercfg-t6x7l\"" Jul 02 19:29:59.650642 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.650609 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:59.650964 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.650947 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc"] Jul 02 19:29:59.742008 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.741929 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:29:59.769073 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.769042 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istio-data\") pod \"e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:29:59.769073 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.769076 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istio-podinfo\") pod \"e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:29:59.769237 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.769101 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istio-envoy\") pod \"e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:29:59.769237 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.769208 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-workload-socket\") pod \"e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:29:59.769237 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.769230 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istio-token\") pod \"e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:29:59.769334 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.769246 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istiod-ca-cert\") pod \"e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:29:59.769334 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.769261 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bmw8\" (UniqueName: \"kubernetes.io/projected/f14858fd-ce01-49d7-9048-84bd2b1a6b71-kube-api-access-6bmw8\") pod \"e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:29:59.769334 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.769282 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-workload-certs\") pod \"e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:29:59.769334 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.769328 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-credential-socket\") pod \"e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:29:59.870571 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.870545 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-workload-socket\") pod \"e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:29:59.870665 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.870572 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istio-token\") pod \"e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:29:59.870665 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.870589 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istiod-ca-cert\") pod \"e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:29:59.870665 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.870605 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bmw8\" (UniqueName: \"kubernetes.io/projected/f14858fd-ce01-49d7-9048-84bd2b1a6b71-kube-api-access-6bmw8\") pod \"e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:29:59.870665 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.870622 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-workload-certs\") pod \"e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:29:59.870665 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.870655 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-credential-socket\") pod \"e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:29:59.870957 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.870709 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istio-data\") pod \"e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:29:59.870957 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.870727 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istio-podinfo\") pod \"e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:29:59.870957 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.870751 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istio-envoy\") pod \"e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:29:59.871106 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.871008 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-workload-socket\") pod \"e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:29:59.871597 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.871359 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-workload-certs\") pod \"e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:29:59.878442 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.871811 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-credential-socket\") pod \"e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:29:59.878442 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.871904 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istio-data\") pod \"e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:29:59.878442 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.873383 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istio-podinfo\") pod \"e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:29:59.878442 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.874470 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istio-envoy\") pod \"e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:29:59.878966 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.878946 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istiod-ca-cert\") pod \"e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:29:59.884985 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.884961 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bmw8\" (UniqueName: \"kubernetes.io/projected/f14858fd-ce01-49d7-9048-84bd2b1a6b71-kube-api-access-6bmw8\") pod \"e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:29:59.885150 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.885135 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istio-token\") pod \"e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:29:59.930255 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:29:59.930231 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:30:00.068232 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:00.068207 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc"] Jul 02 19:30:00.069533 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:30:00.069507 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf14858fd_ce01_49d7_9048_84bd2b1a6b71.slice/crio-1b0aea460fdba6f9e14c2a87992f227abb404d42500a39372de9a84849c31f0d WatchSource:0}: Error finding container 1b0aea460fdba6f9e14c2a87992f227abb404d42500a39372de9a84849c31f0d: Status 404 returned error can't find the container with id 1b0aea460fdba6f9e14c2a87992f227abb404d42500a39372de9a84849c31f0d Jul 02 19:30:00.071453 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:00.071422 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:30:00.071505 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:00.071486 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:30:00.071541 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:00.071516 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:30:00.701331 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:00.701297 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" event={"ID":"f14858fd-ce01-49d7-9048-84bd2b1a6b71","Type":"ContainerStarted","Data":"5ab2582738078feb0af15875cb40397b508538b8c445f6e592db81a710d26ee0"} Jul 02 19:30:00.701696 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:00.701347 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" event={"ID":"f14858fd-ce01-49d7-9048-84bd2b1a6b71","Type":"ContainerStarted","Data":"1b0aea460fdba6f9e14c2a87992f227abb404d42500a39372de9a84849c31f0d"} Jul 02 19:30:00.737124 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:00.737077 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" podStartSLOduration=1.737061879 podStartE2EDuration="1.737061879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:29:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:30:00.733403226 +0000 UTC m=+1728.395372377" watchObservedRunningTime="2026-07-02 19:30:00.737061879 +0000 UTC m=+1728.399031028" Jul 02 19:30:00.930832 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:00.930805 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:30:00.995417 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:00.995344 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:01.102241 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:01.102182 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:01.292819 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:01.292729 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:01.858563 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:01.858529 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:01.935745 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:01.935718 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:30:02.050924 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:02.050889 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:02.151368 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:02.151280 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:02.711115 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:02.711085 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:30:02.712075 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:02.712055 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:30:03.197117 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:03.197089 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:06.097234 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:06.097199 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:06.208978 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:06.208943 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc"] Jul 02 19:30:06.209175 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:06.209151 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" podUID="f14858fd-ce01-49d7-9048-84bd2b1a6b71" containerName="istio-proxy" containerID="cri-o://5ab2582738078feb0af15875cb40397b508538b8c445f6e592db81a710d26ee0" gracePeriod=30 Jul 02 19:30:06.254627 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:06.254593 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:06.355064 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:06.355032 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:06.624051 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:06.623964 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:07.190638 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:07.190597 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:30:07.952372 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:07.952343 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:11.448335 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.448310 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:30:11.583762 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.583671 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istio-data\") pod \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " Jul 02 19:30:11.583762 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.583704 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istio-envoy\") pod \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " Jul 02 19:30:11.583762 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.583731 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-workload-certs\") pod \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " Jul 02 19:30:11.583762 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.583757 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-workload-socket\") pod \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " Jul 02 19:30:11.584115 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.583809 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bmw8\" (UniqueName: \"kubernetes.io/projected/f14858fd-ce01-49d7-9048-84bd2b1a6b71-kube-api-access-6bmw8\") pod \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " Jul 02 19:30:11.584115 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.583824 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-credential-socket\") pod \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " Jul 02 19:30:11.584115 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.583866 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istio-token\") pod \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " Jul 02 19:30:11.584115 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.583896 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istiod-ca-cert\") pod \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " Jul 02 19:30:11.584115 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.583923 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istio-podinfo\") pod \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\" (UID: \"f14858fd-ce01-49d7-9048-84bd2b1a6b71\") " Jul 02 19:30:11.584115 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.583998 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istio-data" (OuterVolumeSpecName: "istio-data") pod "f14858fd-ce01-49d7-9048-84bd2b1a6b71" (UID: "f14858fd-ce01-49d7-9048-84bd2b1a6b71"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:30:11.584397 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.584149 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f14858fd-ce01-49d7-9048-84bd2b1a6b71" (UID: "f14858fd-ce01-49d7-9048-84bd2b1a6b71"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:30:11.584397 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.584182 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f14858fd-ce01-49d7-9048-84bd2b1a6b71" (UID: "f14858fd-ce01-49d7-9048-84bd2b1a6b71"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:30:11.584397 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.584211 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f14858fd-ce01-49d7-9048-84bd2b1a6b71" (UID: "f14858fd-ce01-49d7-9048-84bd2b1a6b71"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:30:11.584397 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.584234 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istio-data\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:30:11.584397 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.584253 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-workload-certs\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:30:11.584655 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.584418 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f14858fd-ce01-49d7-9048-84bd2b1a6b71" (UID: "f14858fd-ce01-49d7-9048-84bd2b1a6b71"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:30:11.586211 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.586175 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f14858fd-ce01-49d7-9048-84bd2b1a6b71" (UID: "f14858fd-ce01-49d7-9048-84bd2b1a6b71"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:30:11.586325 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.586208 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f14858fd-ce01-49d7-9048-84bd2b1a6b71" (UID: "f14858fd-ce01-49d7-9048-84bd2b1a6b71"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 19:30:11.586325 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.586239 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istio-token" (OuterVolumeSpecName: "istio-token") pod "f14858fd-ce01-49d7-9048-84bd2b1a6b71" (UID: "f14858fd-ce01-49d7-9048-84bd2b1a6b71"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:30:11.586325 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.586239 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f14858fd-ce01-49d7-9048-84bd2b1a6b71-kube-api-access-6bmw8" (OuterVolumeSpecName: "kube-api-access-6bmw8") pod "f14858fd-ce01-49d7-9048-84bd2b1a6b71" (UID: "f14858fd-ce01-49d7-9048-84bd2b1a6b71"). InnerVolumeSpecName "kube-api-access-6bmw8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:30:11.684940 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.684907 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istio-envoy\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:30:11.684940 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.684933 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-workload-socket\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:30:11.684940 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.684944 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bmw8\" (UniqueName: \"kubernetes.io/projected/f14858fd-ce01-49d7-9048-84bd2b1a6b71-kube-api-access-6bmw8\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:30:11.685173 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.684954 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f14858fd-ce01-49d7-9048-84bd2b1a6b71-credential-socket\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:30:11.685173 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.684963 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istio-token\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:30:11.685173 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.684971 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istiod-ca-cert\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:30:11.685173 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.684979 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f14858fd-ce01-49d7-9048-84bd2b1a6b71-istio-podinfo\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:30:11.758668 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.758634 2559 generic.go:356] "Generic (PLEG): container finished" podID="f14858fd-ce01-49d7-9048-84bd2b1a6b71" containerID="5ab2582738078feb0af15875cb40397b508538b8c445f6e592db81a710d26ee0" exitCode=0 Jul 02 19:30:11.758818 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.758681 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" Jul 02 19:30:11.758818 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.758694 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" event={"ID":"f14858fd-ce01-49d7-9048-84bd2b1a6b71","Type":"ContainerDied","Data":"5ab2582738078feb0af15875cb40397b508538b8c445f6e592db81a710d26ee0"} Jul 02 19:30:11.758818 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.758735 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc" event={"ID":"f14858fd-ce01-49d7-9048-84bd2b1a6b71","Type":"ContainerDied","Data":"1b0aea460fdba6f9e14c2a87992f227abb404d42500a39372de9a84849c31f0d"} Jul 02 19:30:11.758818 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.758755 2559 scope.go:117] "RemoveContainer" containerID="5ab2582738078feb0af15875cb40397b508538b8c445f6e592db81a710d26ee0" Jul 02 19:30:11.767617 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.767603 2559 scope.go:117] "RemoveContainer" containerID="5ab2582738078feb0af15875cb40397b508538b8c445f6e592db81a710d26ee0" Jul 02 19:30:11.767861 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:30:11.767831 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ab2582738078feb0af15875cb40397b508538b8c445f6e592db81a710d26ee0\": container with ID starting with 5ab2582738078feb0af15875cb40397b508538b8c445f6e592db81a710d26ee0 not found: ID does not exist" containerID="5ab2582738078feb0af15875cb40397b508538b8c445f6e592db81a710d26ee0" Jul 02 19:30:11.767914 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.767872 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ab2582738078feb0af15875cb40397b508538b8c445f6e592db81a710d26ee0"} err="failed to get container status \"5ab2582738078feb0af15875cb40397b508538b8c445f6e592db81a710d26ee0\": rpc error: code = NotFound desc = could not find container \"5ab2582738078feb0af15875cb40397b508538b8c445f6e592db81a710d26ee0\": container with ID starting with 5ab2582738078feb0af15875cb40397b508538b8c445f6e592db81a710d26ee0 not found: ID does not exist" Jul 02 19:30:11.799517 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.799483 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc"] Jul 02 19:30:11.808701 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:11.808675 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-53a62efa-openshift-default-6d4b68dc49-j84fc"] Jul 02 19:30:12.885776 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:12.885732 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f14858fd-ce01-49d7-9048-84bd2b1a6b71" path="/var/lib/kubelet/pods/f14858fd-ce01-49d7-9048-84bd2b1a6b71/volumes" Jul 02 19:30:13.346801 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:13.346725 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:13.447458 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:13.447418 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:13.553434 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:13.553406 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:13.601204 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:13.601174 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:30:13.651392 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:13.651334 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:14.751803 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:14.751773 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:15.236781 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:15.236748 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:15.336004 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:15.335964 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:15.496379 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:15.496294 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:15.595314 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:15.595285 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:16.705657 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:16.705627 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:19.936776 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:19.936738 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:20.349388 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:20.349301 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:26.281552 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:26.281519 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:26.390767 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:26.390738 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:28.289563 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:28.289530 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:32.595982 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.595950 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:32.670822 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.670787 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:32.776050 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.776019 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx"] Jul 02 19:30:32.776403 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.776382 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f14858fd-ce01-49d7-9048-84bd2b1a6b71" containerName="istio-proxy" Jul 02 19:30:32.776403 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.776399 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f14858fd-ce01-49d7-9048-84bd2b1a6b71" containerName="istio-proxy" Jul 02 19:30:32.776595 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.776475 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f14858fd-ce01-49d7-9048-84bd2b1a6b71" containerName="istio-proxy" Jul 02 19:30:32.779559 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.779538 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:32.781780 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.781757 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-6782a705-openshift-default-dockercfg-54wpb\"" Jul 02 19:30:32.794416 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.794391 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx"] Jul 02 19:30:32.819123 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.819092 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:32.864032 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.864002 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-credential-socket\") pod \"e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:32.864178 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.864035 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-istio-envoy\") pod \"e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:32.864178 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.864058 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btgdz\" (UniqueName: \"kubernetes.io/projected/ef7d1291-e051-40a4-813e-efc2593f835a-kube-api-access-btgdz\") pod \"e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:32.864178 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.864137 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef7d1291-e051-40a4-813e-efc2593f835a-istiod-ca-cert\") pod \"e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:32.864283 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.864188 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-workload-certs\") pod \"e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:32.864283 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.864204 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef7d1291-e051-40a4-813e-efc2593f835a-istio-token\") pod \"e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:32.864283 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.864233 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-istio-data\") pod \"e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:32.864283 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.864246 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef7d1291-e051-40a4-813e-efc2593f835a-istio-podinfo\") pod \"e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:32.864283 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.864274 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-workload-socket\") pod \"e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:32.912041 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.912003 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:32.964691 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.964659 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-workload-socket\") pod \"e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:32.964908 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.964734 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-credential-socket\") pod \"e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:32.964908 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.964752 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-istio-envoy\") pod \"e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:32.964908 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.964772 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btgdz\" (UniqueName: \"kubernetes.io/projected/ef7d1291-e051-40a4-813e-efc2593f835a-kube-api-access-btgdz\") pod \"e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:32.964908 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.964813 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef7d1291-e051-40a4-813e-efc2593f835a-istiod-ca-cert\") pod \"e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:32.964908 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.964839 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-workload-certs\") pod \"e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:32.964908 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.964888 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef7d1291-e051-40a4-813e-efc2593f835a-istio-token\") pod \"e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:32.965265 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.964935 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-istio-data\") pod \"e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:32.965265 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.964956 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef7d1291-e051-40a4-813e-efc2593f835a-istio-podinfo\") pod \"e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:32.965265 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.965099 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-workload-socket\") pod \"e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:32.965265 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.965186 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-credential-socket\") pod \"e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:32.965473 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.965343 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-istio-data\") pod \"e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:32.965473 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.965431 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-workload-certs\") pod \"e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:32.965712 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.965693 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef7d1291-e051-40a4-813e-efc2593f835a-istiod-ca-cert\") pod \"e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:32.966931 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.966916 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-istio-envoy\") pod \"e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:32.967299 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.967281 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef7d1291-e051-40a4-813e-efc2593f835a-istio-podinfo\") pod \"e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:32.973000 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.972980 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef7d1291-e051-40a4-813e-efc2593f835a-istio-token\") pod \"e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:32.973095 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:32.973045 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btgdz\" (UniqueName: \"kubernetes.io/projected/ef7d1291-e051-40a4-813e-efc2593f835a-kube-api-access-btgdz\") pod \"e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:33.090340 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:33.090314 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:33.229138 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:33.229112 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx"] Jul 02 19:30:33.230159 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:30:33.230134 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef7d1291_e051_40a4_813e_efc2593f835a.slice/crio-94ed700ef2aa7b12ba916d9175f4d74c41ec3a223bb93e1a6decc9943fd5e4e0 WatchSource:0}: Error finding container 94ed700ef2aa7b12ba916d9175f4d74c41ec3a223bb93e1a6decc9943fd5e4e0: Status 404 returned error can't find the container with id 94ed700ef2aa7b12ba916d9175f4d74c41ec3a223bb93e1a6decc9943fd5e4e0 Jul 02 19:30:33.232665 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:33.232634 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:30:33.232760 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:33.232691 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:30:33.232760 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:33.232717 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:30:33.879930 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:33.879882 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" event={"ID":"ef7d1291-e051-40a4-813e-efc2593f835a","Type":"ContainerStarted","Data":"df58f9741fcaeb560715675016ea5fd6a3ce59efd3a68378a9fa77a54bbe75f0"} Jul 02 19:30:33.880307 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:33.879962 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" event={"ID":"ef7d1291-e051-40a4-813e-efc2593f835a","Type":"ContainerStarted","Data":"94ed700ef2aa7b12ba916d9175f4d74c41ec3a223bb93e1a6decc9943fd5e4e0"} Jul 02 19:30:33.902836 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:33.902794 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" podStartSLOduration=1.902779351 podStartE2EDuration="1.902779351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:30:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:30:33.901917161 +0000 UTC m=+1761.563886309" watchObservedRunningTime="2026-07-02 19:30:33.902779351 +0000 UTC m=+1761.564748499" Jul 02 19:30:33.998986 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:33.998953 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:34.090940 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:34.090903 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:34.094539 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:34.094504 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:34.096252 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:34.096230 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:34.178817 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:34.178708 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:34.385681 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:34.385648 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:34.593127 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:34.593038 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:34.693043 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:34.693014 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:34.892193 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:34.889061 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:34.892810 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:34.892792 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:36.326252 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:36.326211 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:36.686460 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:36.686430 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:30:38.534638 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:38.534604 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:38.673951 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:38.673920 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx"] Jul 02 19:30:38.674144 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:38.674120 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" podUID="ef7d1291-e051-40a4-813e-efc2593f835a" containerName="istio-proxy" containerID="cri-o://df58f9741fcaeb560715675016ea5fd6a3ce59efd3a68378a9fa77a54bbe75f0" gracePeriod=30 Jul 02 19:30:38.711292 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:38.711178 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:38.867696 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:38.867664 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:39.068354 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:39.068319 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:40.291001 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:40.290971 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:44.333318 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.333295 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:44.470361 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.470272 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btgdz\" (UniqueName: \"kubernetes.io/projected/ef7d1291-e051-40a4-813e-efc2593f835a-kube-api-access-btgdz\") pod \"ef7d1291-e051-40a4-813e-efc2593f835a\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " Jul 02 19:30:44.470361 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.470330 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-istio-envoy\") pod \"ef7d1291-e051-40a4-813e-efc2593f835a\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " Jul 02 19:30:44.470588 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.470369 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef7d1291-e051-40a4-813e-efc2593f835a-istiod-ca-cert\") pod \"ef7d1291-e051-40a4-813e-efc2593f835a\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " Jul 02 19:30:44.470588 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.470412 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef7d1291-e051-40a4-813e-efc2593f835a-istio-podinfo\") pod \"ef7d1291-e051-40a4-813e-efc2593f835a\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " Jul 02 19:30:44.470588 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.470462 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-istio-data\") pod \"ef7d1291-e051-40a4-813e-efc2593f835a\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " Jul 02 19:30:44.470588 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.470517 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-workload-socket\") pod \"ef7d1291-e051-40a4-813e-efc2593f835a\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " Jul 02 19:30:44.470588 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.470546 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-workload-certs\") pod \"ef7d1291-e051-40a4-813e-efc2593f835a\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " Jul 02 19:30:44.470844 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.470643 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-credential-socket\") pod \"ef7d1291-e051-40a4-813e-efc2593f835a\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " Jul 02 19:30:44.470844 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.470665 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef7d1291-e051-40a4-813e-efc2593f835a-istio-token\") pod \"ef7d1291-e051-40a4-813e-efc2593f835a\" (UID: \"ef7d1291-e051-40a4-813e-efc2593f835a\") " Jul 02 19:30:44.470974 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.470876 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef7d1291-e051-40a4-813e-efc2593f835a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ef7d1291-e051-40a4-813e-efc2593f835a" (UID: "ef7d1291-e051-40a4-813e-efc2593f835a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:30:44.471032 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.470965 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ef7d1291-e051-40a4-813e-efc2593f835a" (UID: "ef7d1291-e051-40a4-813e-efc2593f835a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:30:44.471032 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.470981 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef7d1291-e051-40a4-813e-efc2593f835a-istiod-ca-cert\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:30:44.471251 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.471200 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ef7d1291-e051-40a4-813e-efc2593f835a" (UID: "ef7d1291-e051-40a4-813e-efc2593f835a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:30:44.471251 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.471219 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ef7d1291-e051-40a4-813e-efc2593f835a" (UID: "ef7d1291-e051-40a4-813e-efc2593f835a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:30:44.471436 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.471332 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-istio-data" (OuterVolumeSpecName: "istio-data") pod "ef7d1291-e051-40a4-813e-efc2593f835a" (UID: "ef7d1291-e051-40a4-813e-efc2593f835a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:30:44.472669 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.472646 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ef7d1291-e051-40a4-813e-efc2593f835a" (UID: "ef7d1291-e051-40a4-813e-efc2593f835a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:30:44.472981 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.472955 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef7d1291-e051-40a4-813e-efc2593f835a-kube-api-access-btgdz" (OuterVolumeSpecName: "kube-api-access-btgdz") pod "ef7d1291-e051-40a4-813e-efc2593f835a" (UID: "ef7d1291-e051-40a4-813e-efc2593f835a"). InnerVolumeSpecName "kube-api-access-btgdz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:30:44.473086 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.472991 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ef7d1291-e051-40a4-813e-efc2593f835a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ef7d1291-e051-40a4-813e-efc2593f835a" (UID: "ef7d1291-e051-40a4-813e-efc2593f835a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 19:30:44.473255 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.473236 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef7d1291-e051-40a4-813e-efc2593f835a-istio-token" (OuterVolumeSpecName: "istio-token") pod "ef7d1291-e051-40a4-813e-efc2593f835a" (UID: "ef7d1291-e051-40a4-813e-efc2593f835a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:30:44.572136 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.572111 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef7d1291-e051-40a4-813e-efc2593f835a-istio-podinfo\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:30:44.572136 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.572132 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-istio-data\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:30:44.572274 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.572141 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-workload-socket\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:30:44.572274 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.572150 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-workload-certs\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:30:44.572274 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.572158 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-credential-socket\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:30:44.572274 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.572167 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef7d1291-e051-40a4-813e-efc2593f835a-istio-token\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:30:44.572274 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.572175 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btgdz\" (UniqueName: \"kubernetes.io/projected/ef7d1291-e051-40a4-813e-efc2593f835a-kube-api-access-btgdz\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:30:44.572274 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.572183 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef7d1291-e051-40a4-813e-efc2593f835a-istio-envoy\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:30:44.670537 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.670508 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:44.730318 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.730225 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:44.901603 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.901574 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:30:44.941505 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.941481 2559 generic.go:356] "Generic (PLEG): container finished" podID="ef7d1291-e051-40a4-813e-efc2593f835a" containerID="df58f9741fcaeb560715675016ea5fd6a3ce59efd3a68378a9fa77a54bbe75f0" exitCode=0 Jul 02 19:30:44.941619 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.941519 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" Jul 02 19:30:44.941619 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.941563 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" event={"ID":"ef7d1291-e051-40a4-813e-efc2593f835a","Type":"ContainerDied","Data":"df58f9741fcaeb560715675016ea5fd6a3ce59efd3a68378a9fa77a54bbe75f0"} Jul 02 19:30:44.941619 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.941603 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx" event={"ID":"ef7d1291-e051-40a4-813e-efc2593f835a","Type":"ContainerDied","Data":"94ed700ef2aa7b12ba916d9175f4d74c41ec3a223bb93e1a6decc9943fd5e4e0"} Jul 02 19:30:44.941735 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.941625 2559 scope.go:117] "RemoveContainer" containerID="df58f9741fcaeb560715675016ea5fd6a3ce59efd3a68378a9fa77a54bbe75f0" Jul 02 19:30:44.950082 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.950067 2559 scope.go:117] "RemoveContainer" containerID="df58f9741fcaeb560715675016ea5fd6a3ce59efd3a68378a9fa77a54bbe75f0" Jul 02 19:30:44.950300 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:30:44.950280 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df58f9741fcaeb560715675016ea5fd6a3ce59efd3a68378a9fa77a54bbe75f0\": container with ID starting with df58f9741fcaeb560715675016ea5fd6a3ce59efd3a68378a9fa77a54bbe75f0 not found: ID does not exist" containerID="df58f9741fcaeb560715675016ea5fd6a3ce59efd3a68378a9fa77a54bbe75f0" Jul 02 19:30:44.950359 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.950307 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df58f9741fcaeb560715675016ea5fd6a3ce59efd3a68378a9fa77a54bbe75f0"} err="failed to get container status \"df58f9741fcaeb560715675016ea5fd6a3ce59efd3a68378a9fa77a54bbe75f0\": rpc error: code = NotFound desc = could not find container \"df58f9741fcaeb560715675016ea5fd6a3ce59efd3a68378a9fa77a54bbe75f0\": container with ID starting with df58f9741fcaeb560715675016ea5fd6a3ce59efd3a68378a9fa77a54bbe75f0 not found: ID does not exist" Jul 02 19:30:44.960890 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.960869 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx"] Jul 02 19:30:44.967462 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:44.967442 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-6782a705-openshift-default-794b4b75b7-c9psx"] Jul 02 19:30:45.262099 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:45.262066 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:45.392591 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:45.392553 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:46.886583 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:46.886551 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef7d1291-e051-40a4-813e-efc2593f835a" path="/var/lib/kubelet/pods/ef7d1291-e051-40a4-813e-efc2593f835a/volumes" Jul 02 19:30:46.894861 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:46.894826 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:52.579564 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:52.579533 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:52.689803 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:52.689771 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:52.787348 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:52.787319 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:52.887189 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:52.887156 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:30:53.363771 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:30:53.363737 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:12.935666 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:31:12.935637 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gf2s_a95b977b-6b92-411f-a185-ecc012668bff/ovn-acl-logging/0.log" Jul 02 19:31:12.938802 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:31:12.938779 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gf2s_a95b977b-6b92-411f-a185-ecc012668bff/ovn-acl-logging/0.log" Jul 02 19:31:19.351776 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:31:19.351737 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:25.210347 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:31:25.210286 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:25.277428 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:31:25.277398 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:25.364001 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:31:25.363959 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:25.461170 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:31:25.461103 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:41.423495 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:31:41.423460 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:47.616429 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:31:47.616392 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:47.718127 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:31:47.718094 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:47.817867 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:31:47.817827 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:58.349217 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:31:58.349171 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:31:59.155733 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:31:59.155699 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:05.064010 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:05.063979 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:05.129173 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:05.129140 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:05.226544 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:05.226510 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:05.319145 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:05.319065 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:05.418284 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:05.418258 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:06.165579 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:06.165536 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:06.265643 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:06.265606 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:06.365680 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:06.365643 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:07.606164 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:07.606124 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:32:08.079178 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:08.079048 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:13.880757 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:13.880721 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:13.947977 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:13.947946 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:14.605334 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:14.605298 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:15.092391 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:15.092316 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:32:20.520205 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:20.520175 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:20.619936 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:20.619905 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:20.751168 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:20.751138 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:21.112505 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:21.112466 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:21.186382 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:21.186335 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:23.489434 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:23.489402 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:32:24.420123 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:24.420087 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:24.576339 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:24.576303 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:24.673097 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:24.673011 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:24.797929 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:24.797896 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:25.151925 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:25.151895 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:25.270490 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:25.270451 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:28.820288 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:28.820254 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:29.481999 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:29.481968 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:29.583350 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:29.583314 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:29.929367 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:29.929333 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:32.929653 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:32.929618 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:32:35.762414 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:35.762334 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:35.864244 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:35.864210 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:36.208680 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:36.208637 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:36.629500 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:36.629470 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:36.711178 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:36.711155 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:39.494470 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:39.494441 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:32:42.310637 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:42.310596 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:42.393292 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:42.393242 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:42.579167 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:42.579083 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:42.814240 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:42.814206 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:42.928421 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:42.928378 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:43.029908 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:43.029877 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:43.182594 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:43.182495 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:49.052216 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:49.052181 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:49.114987 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:49.114956 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:49.201568 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:49.201535 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:49.304747 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:49.304645 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:49.435696 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:49.435662 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:55.332327 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:55.332273 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:32:55.402559 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:32:55.402523 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:33:02.212152 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:33:02.212119 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:33:02.522834 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:33:02.522749 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:33:02.745986 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:33:02.745951 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:33:05.468709 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:33:05.468660 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:33:05.580210 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:33:05.580172 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:33:05.747439 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:33:05.747349 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:33:06.171193 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:33:06.171162 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:33:06.271015 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:33:06.270984 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:33:06.656414 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:33:06.656383 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:33:07.985928 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:33:07.985887 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:33:08.084526 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:33:08.084488 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:33:09.972462 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:33:09.972424 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:33:11.025004 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:33:11.024964 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:33:15.126974 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:33:15.126940 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:33:18.891152 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:33:18.889111 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:33:27.591033 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:33:27.590996 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:33:27.689357 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:33:27.689322 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:33:34.593637 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:33:34.593604 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:33:37.348897 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:33:37.348863 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:33:37.662133 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:33:37.662094 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:33:43.440977 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:33:43.440939 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:33:48.470182 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:33:48.470151 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:33:48.591395 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:33:48.591361 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:33:52.353632 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:33:52.353590 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:11.885048 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:34:11.884964 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:25.755210 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:34:25.755173 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:25.912286 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:34:25.912253 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:28.880235 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:34:28.880198 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:34:31.626638 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:34:31.626601 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:33.291375 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:34:33.291343 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:34.189640 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:34:34.189610 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:34.281242 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:34:34.281206 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:35.763072 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:34:35.763034 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:41.122800 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:34:41.122772 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:34:41.997480 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:34:41.997444 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:42.096593 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:34:42.096562 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:42.769813 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:34:42.769778 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:48.945930 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:34:48.945895 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:49.048137 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:34:49.048101 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:49.147137 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:34:49.147107 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:34:50.591761 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:34:50.591727 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:34:59.687885 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:34:59.687827 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:00.066763 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:00.066683 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:21.067385 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:21.067343 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:27.194515 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:27.194476 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:27.640009 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:27.639972 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:27.716874 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:27.716830 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:27.900271 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:27.900188 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw"] Jul 02 19:35:27.900584 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:27.900569 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef7d1291-e051-40a4-813e-efc2593f835a" containerName="istio-proxy" Jul 02 19:35:27.900584 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:27.900584 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef7d1291-e051-40a4-813e-efc2593f835a" containerName="istio-proxy" Jul 02 19:35:27.900696 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:27.900644 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef7d1291-e051-40a4-813e-efc2593f835a" containerName="istio-proxy" Jul 02 19:35:27.903558 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:27.903514 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:27.906385 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:27.906371 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-6fdd24-openshift-default-dockercfg-ntcn6\"" Jul 02 19:35:27.918505 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:27.918480 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw"] Jul 02 19:35:27.933598 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:27.933571 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:28.031566 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.031528 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istio-podinfo\") pod \"e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:28.031746 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.031622 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istio-envoy\") pod \"e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:28.031746 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.031665 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-workload-socket\") pod \"e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:28.031746 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.031691 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istio-token\") pod \"e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:28.031746 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.031719 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istio-data\") pod \"e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:28.031746 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.031734 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:28.032026 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.031802 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-credential-socket\") pod \"e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:28.032026 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.031829 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-workload-certs\") pod \"e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:28.032026 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.031886 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istiod-ca-cert\") pod \"e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:28.032026 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.031954 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w6t6\" (UniqueName: \"kubernetes.io/projected/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-kube-api-access-5w6t6\") pod \"e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:28.133004 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.132973 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istio-podinfo\") pod \"e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:28.133156 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.133014 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istio-envoy\") pod \"e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:28.133156 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.133035 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-workload-socket\") pod \"e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:28.133156 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.133051 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istio-token\") pod \"e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:28.133156 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.133068 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istio-data\") pod \"e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:28.133368 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.133199 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-credential-socket\") pod \"e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:28.133368 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.133237 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-workload-certs\") pod \"e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:28.133368 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.133311 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istiod-ca-cert\") pod \"e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:28.133505 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.133387 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w6t6\" (UniqueName: \"kubernetes.io/projected/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-kube-api-access-5w6t6\") pod \"e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:28.133567 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.133549 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-workload-socket\") pod \"e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:28.133758 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.133732 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istio-data\") pod \"e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:28.133910 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.133842 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-credential-socket\") pod \"e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:28.133991 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.133913 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-workload-certs\") pod \"e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:28.134087 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.134009 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istiod-ca-cert\") pod \"e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:28.135208 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.135189 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istio-envoy\") pod \"e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:28.135535 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.135513 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istio-podinfo\") pod \"e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:28.144210 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.144186 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istio-token\") pod \"e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:28.144415 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.144400 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w6t6\" (UniqueName: \"kubernetes.io/projected/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-kube-api-access-5w6t6\") pod \"e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:28.214147 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.214083 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:28.347093 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.347068 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw"] Jul 02 19:35:28.348581 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:35:28.348558 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f3558e3_5c51_47fd_a1f8_1ef71a08fd9f.slice/crio-afc200bb69132e4bcde7020139c8ba6e71915b4d5050e72c0f35b6c958bc1a8b WatchSource:0}: Error finding container afc200bb69132e4bcde7020139c8ba6e71915b4d5050e72c0f35b6c958bc1a8b: Status 404 returned error can't find the container with id afc200bb69132e4bcde7020139c8ba6e71915b4d5050e72c0f35b6c958bc1a8b Jul 02 19:35:28.350546 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.350512 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:35:28.350614 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.350576 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:35:28.350614 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.350611 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:35:28.358975 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:28.358951 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" event={"ID":"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f","Type":"ContainerStarted","Data":"afc200bb69132e4bcde7020139c8ba6e71915b4d5050e72c0f35b6c958bc1a8b"} Jul 02 19:35:29.365243 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:29.365207 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" event={"ID":"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f","Type":"ContainerStarted","Data":"d3e48bbcca52bbb37cb962afd5732fbb754ab3b6ba1e2924eb4a85383edc8a03"} Jul 02 19:35:29.388066 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:29.388012 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" podStartSLOduration=2.387996671 podStartE2EDuration="2.387996671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:35:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:35:29.385266357 +0000 UTC m=+2057.047235506" watchObservedRunningTime="2026-07-02 19:35:29.387996671 +0000 UTC m=+2057.049965870" Jul 02 19:35:30.214731 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:30.214701 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:30.219237 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:30.219216 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:30.370057 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:30.370028 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:30.370933 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:30.370915 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:31.271423 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:31.271391 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:31.937727 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:31.937698 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:32.062648 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:32.062616 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:32.165075 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:32.165033 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:32.263270 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:32.263196 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:35.961336 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:35.961249 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:36.296954 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.296843 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:36.605343 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.605314 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5"] Jul 02 19:35:36.608950 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.608928 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:36.611775 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.611752 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-4fd26d-openshift-default-dockercfg-qcxjz\"" Jul 02 19:35:36.621268 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.621244 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5"] Jul 02 19:35:36.647733 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.647709 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:36.708332 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.708296 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istio-data\") pod \"e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:36.708491 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.708351 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn4p9\" (UniqueName: \"kubernetes.io/projected/073b0ebb-1b61-4fe2-9012-4e27f827ab51-kube-api-access-gn4p9\") pod \"e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:36.708491 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.708427 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istio-podinfo\") pod \"e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:36.708491 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.708471 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-workload-certs\") pod \"e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:36.708636 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.708495 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istio-token\") pod \"e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:36.708636 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.708563 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-workload-socket\") pod \"e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:36.708741 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.708655 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-credential-socket\") pod \"e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:36.708741 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.708709 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istiod-ca-cert\") pod \"e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:36.708837 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.708754 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istio-envoy\") pod \"e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:36.810272 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.810228 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istio-data\") pod \"e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:36.810475 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.810283 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn4p9\" (UniqueName: \"kubernetes.io/projected/073b0ebb-1b61-4fe2-9012-4e27f827ab51-kube-api-access-gn4p9\") pod \"e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:36.810475 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.810336 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istio-podinfo\") pod \"e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:36.810475 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.810362 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-workload-certs\") pod \"e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:36.810475 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.810385 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istio-token\") pod \"e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:36.810475 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.810436 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-workload-socket\") pod \"e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:36.810741 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.810512 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-credential-socket\") pod \"e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:36.810741 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.810555 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istiod-ca-cert\") pod \"e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:36.810741 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.810591 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istio-envoy\") pod \"e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:36.810741 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.810696 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istio-data\") pod \"e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:36.810986 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.810971 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-workload-certs\") pod \"e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:36.811231 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.811205 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-credential-socket\") pod \"e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:36.811353 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.811308 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-workload-socket\") pod \"e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:36.811448 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.811426 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istiod-ca-cert\") pod \"e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:36.813024 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.813005 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istio-podinfo\") pod \"e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:36.813198 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.813182 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istio-envoy\") pod \"e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:36.824796 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.824765 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn4p9\" (UniqueName: \"kubernetes.io/projected/073b0ebb-1b61-4fe2-9012-4e27f827ab51-kube-api-access-gn4p9\") pod \"e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:36.825499 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.825478 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istio-token\") pod \"e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:36.897442 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.897375 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:35:36.920773 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:36.920750 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:37.062694 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:37.062666 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5"] Jul 02 19:35:37.064804 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:35:37.064774 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod073b0ebb_1b61_4fe2_9012_4e27f827ab51.slice/crio-2f72713dda0a47d6eb4b89460acf78e0110c4521046e8caf2bf426e870717071 WatchSource:0}: Error finding container 2f72713dda0a47d6eb4b89460acf78e0110c4521046e8caf2bf426e870717071: Status 404 returned error can't find the container with id 2f72713dda0a47d6eb4b89460acf78e0110c4521046e8caf2bf426e870717071 Jul 02 19:35:37.066933 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:37.066899 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:35:37.067014 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:37.066993 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:35:37.067052 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:37.067023 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:35:37.263480 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:37.263405 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:37.409604 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:37.409569 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" event={"ID":"073b0ebb-1b61-4fe2-9012-4e27f827ab51","Type":"ContainerStarted","Data":"5980326aa9e4469c7b5e3445b0378f92a3be3e3dba0d0bcd0f4002e1b060476f"} Jul 02 19:35:37.409777 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:37.409633 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" event={"ID":"073b0ebb-1b61-4fe2-9012-4e27f827ab51","Type":"ContainerStarted","Data":"2f72713dda0a47d6eb4b89460acf78e0110c4521046e8caf2bf426e870717071"} Jul 02 19:35:37.432675 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:37.432621 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" podStartSLOduration=1.432607904 podStartE2EDuration="1.432607904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:35:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:35:37.430601575 +0000 UTC m=+2065.092570724" watchObservedRunningTime="2026-07-02 19:35:37.432607904 +0000 UTC m=+2065.094577053" Jul 02 19:35:37.921619 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:37.921592 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:38.927960 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:38.927922 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:39.422620 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:39.422584 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:39.428237 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:39.428207 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:39.538909 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:39.538877 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:39.636456 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:39.636423 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:39.768762 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:39.768683 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:39.922285 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:39.922249 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:40.701660 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:40.701631 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:40.801126 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:40.801088 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:43.995210 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:43.995179 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:45.793753 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:45.793716 2559 patch_prober.go:28] interesting pod/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": read tcp 10.132.0.2:51124->10.132.0.38:15021: read: connection reset by peer" start-of-body= Jul 02 19:35:45.794181 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:45.793873 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" podUID="8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": read tcp 10.132.0.2:51124->10.132.0.38:15021: read: connection reset by peer" Jul 02 19:35:46.462289 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:46.462253 2559 generic.go:356] "Generic (PLEG): container finished" podID="8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f" containerID="d3e48bbcca52bbb37cb962afd5732fbb754ab3b6ba1e2924eb4a85383edc8a03" exitCode=0 Jul 02 19:35:46.462458 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:46.462323 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" event={"ID":"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f","Type":"ContainerDied","Data":"d3e48bbcca52bbb37cb962afd5732fbb754ab3b6ba1e2924eb4a85383edc8a03"} Jul 02 19:35:46.462752 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:46.462725 2559 scope.go:117] "RemoveContainer" containerID="d3e48bbcca52bbb37cb962afd5732fbb754ab3b6ba1e2924eb4a85383edc8a03" Jul 02 19:35:46.463837 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:46.463809 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:35:46.463934 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:46.463913 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:35:46.463972 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:46.463949 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:35:47.475068 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:47.475032 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" event={"ID":"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f","Type":"ContainerStarted","Data":"e92af83d8331e318c240a2c624d9006375ce10a3436ebe2b6b2c2cc9b28c0fda"} Jul 02 19:35:48.215143 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:48.215103 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:48.215352 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:48.215229 2559 patch_prober.go:28] interesting pod/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jul 02 19:35:48.215352 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:48.215282 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" podUID="8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jul 02 19:35:48.299379 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:48.299348 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:35:49.214816 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:49.214780 2559 patch_prober.go:28] interesting pod/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jul 02 19:35:49.215779 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:49.215367 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" podUID="8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jul 02 19:35:50.215707 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:50.215224 2559 patch_prober.go:28] interesting pod/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jul 02 19:35:50.215707 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:50.215285 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" podUID="8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jul 02 19:35:50.492514 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:50.492482 2559 generic.go:356] "Generic (PLEG): container finished" podID="073b0ebb-1b61-4fe2-9012-4e27f827ab51" containerID="5980326aa9e4469c7b5e3445b0378f92a3be3e3dba0d0bcd0f4002e1b060476f" exitCode=0 Jul 02 19:35:50.492514 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:50.492517 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" event={"ID":"073b0ebb-1b61-4fe2-9012-4e27f827ab51","Type":"ContainerDied","Data":"5980326aa9e4469c7b5e3445b0378f92a3be3e3dba0d0bcd0f4002e1b060476f"} Jul 02 19:35:50.492884 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:50.492870 2559 scope.go:117] "RemoveContainer" containerID="5980326aa9e4469c7b5e3445b0378f92a3be3e3dba0d0bcd0f4002e1b060476f" Jul 02 19:35:50.493921 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:50.493896 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:35:50.493991 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:50.493965 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:35:50.494026 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:50.494005 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:35:51.215394 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:51.215361 2559 patch_prober.go:28] interesting pod/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jul 02 19:35:51.215601 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:51.215426 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" podUID="8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jul 02 19:35:51.498780 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:51.498700 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" event={"ID":"073b0ebb-1b61-4fe2-9012-4e27f827ab51","Type":"ContainerStarted","Data":"585f705437337012f3b512f956124d72743b952b6a6da84c16766e1495ab011f"} Jul 02 19:35:51.922980 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:51.922931 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:51.923289 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:51.923141 2559 patch_prober.go:28] interesting pod/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 02 19:35:51.923289 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:51.923195 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" podUID="073b0ebb-1b61-4fe2-9012-4e27f827ab51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 02 19:35:52.228327 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:52.228237 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:52.230063 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:52.230045 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:52.235174 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:52.235135 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:35:52.255702 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:52.255677 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:52.921306 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:52.921263 2559 patch_prober.go:28] interesting pod/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 02 19:35:52.921827 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:52.921346 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" podUID="073b0ebb-1b61-4fe2-9012-4e27f827ab51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 02 19:35:53.826808 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:53.826638 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:53.922036 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:53.922003 2559 patch_prober.go:28] interesting pod/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 02 19:35:53.922544 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:53.922515 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" podUID="073b0ebb-1b61-4fe2-9012-4e27f827ab51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 02 19:35:53.928581 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:53.928467 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:35:54.422775 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:54.422740 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:54.921175 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:54.921140 2559 patch_prober.go:28] interesting pod/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 02 19:35:54.921445 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:54.921417 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" podUID="073b0ebb-1b61-4fe2-9012-4e27f827ab51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 02 19:35:55.925476 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:55.925439 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:55.926500 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:55.926479 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:35:55.998749 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:35:55.998715 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:36:01.193699 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:36:01.193660 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:36:01.302063 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:36:01.302009 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:36:06.290419 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:36:06.290388 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:36:10.579391 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:36:10.579359 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:36:12.972656 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:36:12.972627 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gf2s_a95b977b-6b92-411f-a185-ecc012668bff/ovn-acl-logging/0.log" Jul 02 19:36:12.975977 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:36:12.975959 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gf2s_a95b977b-6b92-411f-a185-ecc012668bff/ovn-acl-logging/0.log" Jul 02 19:36:22.118907 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:36:22.118843 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:36:22.201463 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:36:22.201424 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:36:26.399979 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:36:26.399945 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:36:39.703727 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:36:39.703695 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:36:42.570667 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:36:42.570635 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:36:43.494720 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:36:43.494681 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:36:43.779692 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:36:43.779603 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:36:44.188264 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:36:44.188231 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:36:44.292655 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:36:44.292622 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:36:44.395379 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:36:44.395343 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:36:44.547302 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:36:44.547217 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:36:49.255299 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:36:49.255265 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:36:55.585057 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:36:55.585023 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:37:26.387549 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:26.387515 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:26.715721 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:26.715629 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw"] Jul 02 19:37:26.715902 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:26.715878 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" podUID="8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f" containerName="istio-proxy" containerID="cri-o://e92af83d8331e318c240a2c624d9006375ce10a3436ebe2b6b2c2cc9b28c0fda" gracePeriod=30 Jul 02 19:37:26.757318 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:26.757281 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:26.954347 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:26.954311 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:27.161657 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:27.161620 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:27.577581 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:27.577489 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:27.677968 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:27.677929 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:27.779286 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:27.779256 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:27.898288 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:27.898252 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:30.593766 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:30.593727 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:37:31.963646 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:31.963622 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:37:32.025439 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.025361 2559 generic.go:356] "Generic (PLEG): container finished" podID="8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f" containerID="e92af83d8331e318c240a2c624d9006375ce10a3436ebe2b6b2c2cc9b28c0fda" exitCode=0 Jul 02 19:37:32.025439 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.025405 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" Jul 02 19:37:32.025603 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.025456 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" event={"ID":"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f","Type":"ContainerDied","Data":"e92af83d8331e318c240a2c624d9006375ce10a3436ebe2b6b2c2cc9b28c0fda"} Jul 02 19:37:32.025603 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.025523 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw" event={"ID":"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f","Type":"ContainerDied","Data":"afc200bb69132e4bcde7020139c8ba6e71915b4d5050e72c0f35b6c958bc1a8b"} Jul 02 19:37:32.025603 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.025545 2559 scope.go:117] "RemoveContainer" containerID="e92af83d8331e318c240a2c624d9006375ce10a3436ebe2b6b2c2cc9b28c0fda" Jul 02 19:37:32.034103 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.034075 2559 scope.go:117] "RemoveContainer" containerID="d3e48bbcca52bbb37cb962afd5732fbb754ab3b6ba1e2924eb4a85383edc8a03" Jul 02 19:37:32.042039 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.042024 2559 scope.go:117] "RemoveContainer" containerID="e92af83d8331e318c240a2c624d9006375ce10a3436ebe2b6b2c2cc9b28c0fda" Jul 02 19:37:32.042277 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:37:32.042259 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e92af83d8331e318c240a2c624d9006375ce10a3436ebe2b6b2c2cc9b28c0fda\": container with ID starting with e92af83d8331e318c240a2c624d9006375ce10a3436ebe2b6b2c2cc9b28c0fda not found: ID does not exist" containerID="e92af83d8331e318c240a2c624d9006375ce10a3436ebe2b6b2c2cc9b28c0fda" Jul 02 19:37:32.042337 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.042289 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e92af83d8331e318c240a2c624d9006375ce10a3436ebe2b6b2c2cc9b28c0fda"} err="failed to get container status \"e92af83d8331e318c240a2c624d9006375ce10a3436ebe2b6b2c2cc9b28c0fda\": rpc error: code = NotFound desc = could not find container \"e92af83d8331e318c240a2c624d9006375ce10a3436ebe2b6b2c2cc9b28c0fda\": container with ID starting with e92af83d8331e318c240a2c624d9006375ce10a3436ebe2b6b2c2cc9b28c0fda not found: ID does not exist" Jul 02 19:37:32.042337 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.042308 2559 scope.go:117] "RemoveContainer" containerID="d3e48bbcca52bbb37cb962afd5732fbb754ab3b6ba1e2924eb4a85383edc8a03" Jul 02 19:37:32.042549 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:37:32.042534 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3e48bbcca52bbb37cb962afd5732fbb754ab3b6ba1e2924eb4a85383edc8a03\": container with ID starting with d3e48bbcca52bbb37cb962afd5732fbb754ab3b6ba1e2924eb4a85383edc8a03 not found: ID does not exist" containerID="d3e48bbcca52bbb37cb962afd5732fbb754ab3b6ba1e2924eb4a85383edc8a03" Jul 02 19:37:32.042592 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.042554 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3e48bbcca52bbb37cb962afd5732fbb754ab3b6ba1e2924eb4a85383edc8a03"} err="failed to get container status \"d3e48bbcca52bbb37cb962afd5732fbb754ab3b6ba1e2924eb4a85383edc8a03\": rpc error: code = NotFound desc = could not find container \"d3e48bbcca52bbb37cb962afd5732fbb754ab3b6ba1e2924eb4a85383edc8a03\": container with ID starting with d3e48bbcca52bbb37cb962afd5732fbb754ab3b6ba1e2924eb4a85383edc8a03 not found: ID does not exist" Jul 02 19:37:32.048819 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.048801 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5w6t6\" (UniqueName: \"kubernetes.io/projected/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-kube-api-access-5w6t6\") pod \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " Jul 02 19:37:32.048906 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.048833 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istio-podinfo\") pod \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " Jul 02 19:37:32.048906 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.048869 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istiod-ca-cert\") pod \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " Jul 02 19:37:32.049013 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.048972 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-workload-certs\") pod \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " Jul 02 19:37:32.049013 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.048999 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-credential-socket\") pod \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " Jul 02 19:37:32.049126 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.049041 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istio-envoy\") pod \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " Jul 02 19:37:32.049126 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.049073 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-workload-socket\") pod \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " Jul 02 19:37:32.049241 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.049135 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istio-data\") pod \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " Jul 02 19:37:32.049241 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.049209 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istio-token\") pod \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\" (UID: \"8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f\") " Jul 02 19:37:32.049344 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.049251 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f" (UID: "8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:37:32.049344 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.049259 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f" (UID: "8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:37:32.049344 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.049266 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f" (UID: "8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:37:32.049496 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.049456 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f" (UID: "8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:37:32.049555 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.049506 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istiod-ca-cert\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:37:32.049555 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.049524 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-workload-certs\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:37:32.049555 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.049538 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-credential-socket\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:37:32.049911 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.049892 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istio-data" (OuterVolumeSpecName: "istio-data") pod "8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f" (UID: "8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:37:32.051001 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.050980 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f" (UID: "8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 19:37:32.051227 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.051211 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istio-token" (OuterVolumeSpecName: "istio-token") pod "8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f" (UID: "8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:37:32.051394 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.051374 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-kube-api-access-5w6t6" (OuterVolumeSpecName: "kube-api-access-5w6t6") pod "8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f" (UID: "8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f"). InnerVolumeSpecName "kube-api-access-5w6t6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:37:32.051394 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.051380 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f" (UID: "8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:37:32.150198 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.150175 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istio-data\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:37:32.150198 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.150197 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istio-token\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:37:32.150318 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.150206 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5w6t6\" (UniqueName: \"kubernetes.io/projected/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-kube-api-access-5w6t6\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:37:32.150318 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.150216 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istio-podinfo\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:37:32.150318 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.150224 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-istio-envoy\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:37:32.150318 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.150232 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f-workload-socket\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:37:32.350882 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.350838 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw"] Jul 02 19:37:32.355403 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.355380 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-6fdd24-openshift-default-76dd5f7685-98vrw"] Jul 02 19:37:32.887492 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:32.887458 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f" path="/var/lib/kubelet/pods/8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f/volumes" Jul 02 19:37:33.314407 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:33.314306 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:33.408170 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:33.408134 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:33.571137 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:33.571060 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5"] Jul 02 19:37:33.571284 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:33.571263 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" podUID="073b0ebb-1b61-4fe2-9012-4e27f827ab51" containerName="istio-proxy" containerID="cri-o://585f705437337012f3b512f956124d72743b952b6a6da84c16766e1495ab011f" gracePeriod=30 Jul 02 19:37:33.600279 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:33.600257 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:33.859500 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:33.859473 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:34.221751 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:34.221671 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:34.557754 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:34.557664 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:34.958862 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:34.958810 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:38.059749 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:38.059717 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:38.156121 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:38.156087 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:38.253286 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:38.253258 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:38.666141 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:38.666097 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:38.809020 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:38.808973 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:38.830112 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:38.830081 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:37:38.908953 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:38.908924 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-workload-certs\") pod \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " Jul 02 19:37:38.909113 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:38.908970 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istio-podinfo\") pod \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " Jul 02 19:37:38.909113 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:38.909012 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istiod-ca-cert\") pod \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " Jul 02 19:37:38.909113 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:38.909032 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istio-token\") pod \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " Jul 02 19:37:38.909113 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:38.909047 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-workload-socket\") pod \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " Jul 02 19:37:38.909113 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:38.909090 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-credential-socket\") pod \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " Jul 02 19:37:38.909393 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:38.909116 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gn4p9\" (UniqueName: \"kubernetes.io/projected/073b0ebb-1b61-4fe2-9012-4e27f827ab51-kube-api-access-gn4p9\") pod \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " Jul 02 19:37:38.909393 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:38.909163 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istio-data\") pod \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " Jul 02 19:37:38.909393 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:38.909192 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istio-envoy\") pod \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\" (UID: \"073b0ebb-1b61-4fe2-9012-4e27f827ab51\") " Jul 02 19:37:38.909393 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:38.909229 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "073b0ebb-1b61-4fe2-9012-4e27f827ab51" (UID: "073b0ebb-1b61-4fe2-9012-4e27f827ab51"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:37:38.909393 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:38.909338 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "073b0ebb-1b61-4fe2-9012-4e27f827ab51" (UID: "073b0ebb-1b61-4fe2-9012-4e27f827ab51"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:37:38.909884 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:38.909476 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-workload-socket\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:37:38.909884 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:38.909495 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-workload-certs\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:37:38.909884 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:38.909635 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "073b0ebb-1b61-4fe2-9012-4e27f827ab51" (UID: "073b0ebb-1b61-4fe2-9012-4e27f827ab51"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:37:38.909884 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:38.909734 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "073b0ebb-1b61-4fe2-9012-4e27f827ab51" (UID: "073b0ebb-1b61-4fe2-9012-4e27f827ab51"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:37:38.910141 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:38.910122 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istio-data" (OuterVolumeSpecName: "istio-data") pod "073b0ebb-1b61-4fe2-9012-4e27f827ab51" (UID: "073b0ebb-1b61-4fe2-9012-4e27f827ab51"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:37:38.911428 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:38.911399 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istio-token" (OuterVolumeSpecName: "istio-token") pod "073b0ebb-1b61-4fe2-9012-4e27f827ab51" (UID: "073b0ebb-1b61-4fe2-9012-4e27f827ab51"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:37:38.911532 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:38.911406 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "073b0ebb-1b61-4fe2-9012-4e27f827ab51" (UID: "073b0ebb-1b61-4fe2-9012-4e27f827ab51"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:37:38.911651 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:38.911633 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "073b0ebb-1b61-4fe2-9012-4e27f827ab51" (UID: "073b0ebb-1b61-4fe2-9012-4e27f827ab51"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 19:37:38.911749 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:38.911732 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/073b0ebb-1b61-4fe2-9012-4e27f827ab51-kube-api-access-gn4p9" (OuterVolumeSpecName: "kube-api-access-gn4p9") pod "073b0ebb-1b61-4fe2-9012-4e27f827ab51" (UID: "073b0ebb-1b61-4fe2-9012-4e27f827ab51"). InnerVolumeSpecName "kube-api-access-gn4p9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:37:38.953662 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:38.953569 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:39.010301 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:39.010266 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istio-podinfo\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:37:39.010301 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:39.010297 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istiod-ca-cert\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:37:39.010301 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:39.010307 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istio-token\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:37:39.010569 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:39.010315 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-credential-socket\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:37:39.010569 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:39.010325 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gn4p9\" (UniqueName: \"kubernetes.io/projected/073b0ebb-1b61-4fe2-9012-4e27f827ab51-kube-api-access-gn4p9\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:37:39.010569 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:39.010336 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istio-data\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:37:39.010569 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:39.010344 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/073b0ebb-1b61-4fe2-9012-4e27f827ab51-istio-envoy\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:37:39.068606 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:39.068575 2559 generic.go:356] "Generic (PLEG): container finished" podID="073b0ebb-1b61-4fe2-9012-4e27f827ab51" containerID="585f705437337012f3b512f956124d72743b952b6a6da84c16766e1495ab011f" exitCode=0 Jul 02 19:37:39.069107 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:39.068629 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" event={"ID":"073b0ebb-1b61-4fe2-9012-4e27f827ab51","Type":"ContainerDied","Data":"585f705437337012f3b512f956124d72743b952b6a6da84c16766e1495ab011f"} Jul 02 19:37:39.069107 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:39.068635 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" Jul 02 19:37:39.069107 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:39.068671 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5" event={"ID":"073b0ebb-1b61-4fe2-9012-4e27f827ab51","Type":"ContainerDied","Data":"2f72713dda0a47d6eb4b89460acf78e0110c4521046e8caf2bf426e870717071"} Jul 02 19:37:39.069107 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:39.068692 2559 scope.go:117] "RemoveContainer" containerID="585f705437337012f3b512f956124d72743b952b6a6da84c16766e1495ab011f" Jul 02 19:37:39.078551 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:39.078533 2559 scope.go:117] "RemoveContainer" containerID="5980326aa9e4469c7b5e3445b0378f92a3be3e3dba0d0bcd0f4002e1b060476f" Jul 02 19:37:39.088499 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:39.088481 2559 scope.go:117] "RemoveContainer" containerID="585f705437337012f3b512f956124d72743b952b6a6da84c16766e1495ab011f" Jul 02 19:37:39.088771 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:37:39.088751 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"585f705437337012f3b512f956124d72743b952b6a6da84c16766e1495ab011f\": container with ID starting with 585f705437337012f3b512f956124d72743b952b6a6da84c16766e1495ab011f not found: ID does not exist" containerID="585f705437337012f3b512f956124d72743b952b6a6da84c16766e1495ab011f" Jul 02 19:37:39.088840 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:39.088780 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"585f705437337012f3b512f956124d72743b952b6a6da84c16766e1495ab011f"} err="failed to get container status \"585f705437337012f3b512f956124d72743b952b6a6da84c16766e1495ab011f\": rpc error: code = NotFound desc = could not find container \"585f705437337012f3b512f956124d72743b952b6a6da84c16766e1495ab011f\": container with ID starting with 585f705437337012f3b512f956124d72743b952b6a6da84c16766e1495ab011f not found: ID does not exist" Jul 02 19:37:39.088840 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:39.088797 2559 scope.go:117] "RemoveContainer" containerID="5980326aa9e4469c7b5e3445b0378f92a3be3e3dba0d0bcd0f4002e1b060476f" Jul 02 19:37:39.089032 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:37:39.089016 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5980326aa9e4469c7b5e3445b0378f92a3be3e3dba0d0bcd0f4002e1b060476f\": container with ID starting with 5980326aa9e4469c7b5e3445b0378f92a3be3e3dba0d0bcd0f4002e1b060476f not found: ID does not exist" containerID="5980326aa9e4469c7b5e3445b0378f92a3be3e3dba0d0bcd0f4002e1b060476f" Jul 02 19:37:39.089072 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:39.089038 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5980326aa9e4469c7b5e3445b0378f92a3be3e3dba0d0bcd0f4002e1b060476f"} err="failed to get container status \"5980326aa9e4469c7b5e3445b0378f92a3be3e3dba0d0bcd0f4002e1b060476f\": rpc error: code = NotFound desc = could not find container \"5980326aa9e4469c7b5e3445b0378f92a3be3e3dba0d0bcd0f4002e1b060476f\": container with ID starting with 5980326aa9e4469c7b5e3445b0378f92a3be3e3dba0d0bcd0f4002e1b060476f not found: ID does not exist" Jul 02 19:37:39.094870 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:39.094827 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5"] Jul 02 19:37:39.100118 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:39.100095 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-4fd26d-openshift-default-7c586cbd5f-nqrn5"] Jul 02 19:37:40.886243 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:40.886211 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="073b0ebb-1b61-4fe2-9012-4e27f827ab51" path="/var/lib/kubelet/pods/073b0ebb-1b61-4fe2-9012-4e27f827ab51/volumes" Jul 02 19:37:42.619153 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:42.619114 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:42.695955 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:42.695918 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:37:43.076385 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.076290 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:43.357675 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.357645 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj"] Jul 02 19:37:43.358035 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.358021 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f" containerName="istio-proxy" Jul 02 19:37:43.358093 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.358036 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f" containerName="istio-proxy" Jul 02 19:37:43.358093 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.358049 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="073b0ebb-1b61-4fe2-9012-4e27f827ab51" containerName="istio-proxy" Jul 02 19:37:43.358093 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.358055 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="073b0ebb-1b61-4fe2-9012-4e27f827ab51" containerName="istio-proxy" Jul 02 19:37:43.358093 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.358067 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f" containerName="istio-proxy" Jul 02 19:37:43.358093 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.358076 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f" containerName="istio-proxy" Jul 02 19:37:43.358093 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.358085 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="073b0ebb-1b61-4fe2-9012-4e27f827ab51" containerName="istio-proxy" Jul 02 19:37:43.358093 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.358093 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="073b0ebb-1b61-4fe2-9012-4e27f827ab51" containerName="istio-proxy" Jul 02 19:37:43.358363 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.358218 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f" containerName="istio-proxy" Jul 02 19:37:43.358363 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.358233 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="073b0ebb-1b61-4fe2-9012-4e27f827ab51" containerName="istio-proxy" Jul 02 19:37:43.362739 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.362721 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.365067 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.365046 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-05e617-openshift-default-dockercfg-lf6p2\"" Jul 02 19:37:43.374683 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.374656 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj"] Jul 02 19:37:43.395652 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.395618 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:43.448575 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.448519 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-credential-socket\") pod \"e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.448777 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.448644 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-workload-certs\") pod \"e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.448777 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.448668 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfd52f8f-7691-4e93-a501-ced54b7f7033-istio-podinfo\") pod \"e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.448777 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.448692 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfd52f8f-7691-4e93-a501-ced54b7f7033-istiod-ca-cert\") pod \"e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.448777 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.448715 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mfzz\" (UniqueName: \"kubernetes.io/projected/dfd52f8f-7691-4e93-a501-ced54b7f7033-kube-api-access-4mfzz\") pod \"e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.448777 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.448742 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-istio-envoy\") pod \"e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.448777 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.448764 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfd52f8f-7691-4e93-a501-ced54b7f7033-istio-token\") pod \"e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.449032 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.448813 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-workload-socket\") pod \"e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.449032 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.448903 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-istio-data\") pod \"e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.549575 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.549535 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-istio-data\") pod \"e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.549758 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.549598 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-credential-socket\") pod \"e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.549758 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.549680 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-workload-certs\") pod \"e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.549758 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.549703 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfd52f8f-7691-4e93-a501-ced54b7f7033-istio-podinfo\") pod \"e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.549758 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.549729 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfd52f8f-7691-4e93-a501-ced54b7f7033-istiod-ca-cert\") pod \"e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.549758 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.549752 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mfzz\" (UniqueName: \"kubernetes.io/projected/dfd52f8f-7691-4e93-a501-ced54b7f7033-kube-api-access-4mfzz\") pod \"e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.550039 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.549778 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-istio-envoy\") pod \"e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.550039 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.549802 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfd52f8f-7691-4e93-a501-ced54b7f7033-istio-token\") pod \"e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.550039 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.549872 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-workload-socket\") pod \"e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.550039 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.549990 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-istio-data\") pod \"e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.550240 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.550037 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-credential-socket\") pod \"e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.550240 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.550150 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-workload-certs\") pod \"e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.550553 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.550528 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfd52f8f-7691-4e93-a501-ced54b7f7033-istiod-ca-cert\") pod \"e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.550662 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.550582 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-workload-socket\") pod \"e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.551992 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.551977 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-istio-envoy\") pod \"e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.552712 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.552689 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfd52f8f-7691-4e93-a501-ced54b7f7033-istio-podinfo\") pod \"e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.557817 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.557787 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfd52f8f-7691-4e93-a501-ced54b7f7033-istio-token\") pod \"e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.558054 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.558033 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mfzz\" (UniqueName: \"kubernetes.io/projected/dfd52f8f-7691-4e93-a501-ced54b7f7033-kube-api-access-4mfzz\") pod \"e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.667720 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.667605 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:43.674570 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.674549 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:43.814240 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.814212 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj"] Jul 02 19:37:43.815767 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:37:43.815742 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfd52f8f_7691_4e93_a501_ced54b7f7033.slice/crio-b5dc2069651225e40fcee899f11243fb998a435ac1d4b9878cd11d6a2f387465 WatchSource:0}: Error finding container b5dc2069651225e40fcee899f11243fb998a435ac1d4b9878cd11d6a2f387465: Status 404 returned error can't find the container with id b5dc2069651225e40fcee899f11243fb998a435ac1d4b9878cd11d6a2f387465 Jul 02 19:37:43.817967 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.817933 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:37:43.818043 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.818019 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:37:43.818086 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:43.818063 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:37:44.098525 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:44.098435 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" event={"ID":"dfd52f8f-7691-4e93-a501-ced54b7f7033","Type":"ContainerStarted","Data":"a5a098f23b1dab6ccd45d836487ce3ab7e4e1654fdc405e6351d35c857d0b408"} Jul 02 19:37:44.098525 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:44.098486 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" event={"ID":"dfd52f8f-7691-4e93-a501-ced54b7f7033","Type":"ContainerStarted","Data":"b5dc2069651225e40fcee899f11243fb998a435ac1d4b9878cd11d6a2f387465"} Jul 02 19:37:44.119708 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:44.119657 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" podStartSLOduration=1.119637676 podStartE2EDuration="1.119637676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:37:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:37:44.116637545 +0000 UTC m=+2191.778606707" watchObservedRunningTime="2026-07-02 19:37:44.119637676 +0000 UTC m=+2191.781606825" Jul 02 19:37:44.675269 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:44.675237 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:44.679871 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:44.679820 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:45.104003 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:45.103969 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:45.106114 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:45.105323 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:37:46.184939 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:46.184887 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:46.283714 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:46.283680 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:46.430206 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:46.430166 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:46.769646 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:46.769609 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:47.115346 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:47.115314 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:47.219500 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:47.219476 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:50.679562 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:50.679524 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:53.193944 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:53.193910 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:37:58.821255 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:58.821211 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:59.225577 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:59.225540 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:59.328603 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:59.328572 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:59.425519 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:59.425482 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:37:59.497313 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:37:59.497233 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:00.646649 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:00.646616 2559 patch_prober.go:28] interesting pod/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": read tcp 10.132.0.2:39190->10.132.0.40:15021: read: connection reset by peer" start-of-body= Jul 02 19:38:00.647032 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:00.646698 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" podUID="dfd52f8f-7691-4e93-a501-ced54b7f7033" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": read tcp 10.132.0.2:39190->10.132.0.40:15021: read: connection reset by peer" Jul 02 19:38:01.190573 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:01.190538 2559 generic.go:356] "Generic (PLEG): container finished" podID="dfd52f8f-7691-4e93-a501-ced54b7f7033" containerID="a5a098f23b1dab6ccd45d836487ce3ab7e4e1654fdc405e6351d35c857d0b408" exitCode=0 Jul 02 19:38:01.190791 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:01.190617 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" event={"ID":"dfd52f8f-7691-4e93-a501-ced54b7f7033","Type":"ContainerDied","Data":"a5a098f23b1dab6ccd45d836487ce3ab7e4e1654fdc405e6351d35c857d0b408"} Jul 02 19:38:01.191070 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:01.191052 2559 scope.go:117] "RemoveContainer" containerID="a5a098f23b1dab6ccd45d836487ce3ab7e4e1654fdc405e6351d35c857d0b408" Jul 02 19:38:01.192020 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:01.191987 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:38:01.192134 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:01.192058 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:38:01.192134 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:01.192093 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:38:02.198502 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:02.198470 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" event={"ID":"dfd52f8f-7691-4e93-a501-ced54b7f7033","Type":"ContainerStarted","Data":"94191f9557ee5ea276675b38ddf9a1a1a935b5bc0ac7288536308249afae99eb"} Jul 02 19:38:02.675453 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:02.675418 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:38:02.675671 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:02.675649 2559 patch_prober.go:28] interesting pod/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 02 19:38:02.675729 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:02.675710 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" podUID="dfd52f8f-7691-4e93-a501-ced54b7f7033" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 02 19:38:03.675227 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:03.675182 2559 patch_prober.go:28] interesting pod/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 02 19:38:03.675708 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:03.675243 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" podUID="dfd52f8f-7691-4e93-a501-ced54b7f7033" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 02 19:38:04.487958 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:04.487926 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:38:04.675383 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:04.675336 2559 patch_prober.go:28] interesting pod/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 02 19:38:04.675779 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:04.675400 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" podUID="dfd52f8f-7691-4e93-a501-ced54b7f7033" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 02 19:38:05.668361 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:05.668322 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:05.675320 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:05.675289 2559 patch_prober.go:28] interesting pod/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 02 19:38:05.675405 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:05.675343 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" podUID="dfd52f8f-7691-4e93-a501-ced54b7f7033" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 02 19:38:05.754569 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:05.754525 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:06.090283 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:06.090166 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:06.315378 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:06.315344 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:06.678419 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:06.678390 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:38:06.678866 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:06.678834 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:38:06.679593 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:06.679576 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:38:06.725018 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:06.724970 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:06.822098 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:06.822059 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:06.924512 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:06.924463 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:07.025665 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:07.025581 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:08.690060 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:08.690012 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:08.790399 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:08.790362 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:12.555562 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:12.555526 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:12.656430 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:12.656399 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:12.815652 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:12.815579 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj"] Jul 02 19:38:12.815829 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:12.815786 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" podUID="dfd52f8f-7691-4e93-a501-ced54b7f7033" containerName="istio-proxy" containerID="cri-o://94191f9557ee5ea276675b38ddf9a1a1a935b5bc0ac7288536308249afae99eb" gracePeriod=30 Jul 02 19:38:12.839360 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:12.839324 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:13.105006 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.104977 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:13.476977 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.476879 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:13.783668 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.783591 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv"] Jul 02 19:38:13.784029 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.784008 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="073b0ebb-1b61-4fe2-9012-4e27f827ab51" containerName="istio-proxy" Jul 02 19:38:13.784029 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.784022 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f3558e3-5c51-47fd-a1f8-1ef71a08fd9f" containerName="istio-proxy" Jul 02 19:38:13.786635 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.786615 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:13.790159 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.790139 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-50666c-openshift-default-dockercfg-lnzr9\"" Jul 02 19:38:13.815784 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.815759 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv"] Jul 02 19:38:13.822404 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.822383 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sswjd\" (UniqueName: \"kubernetes.io/projected/25176944-ec32-49bb-bb89-69602058cda5-kube-api-access-sswjd\") pod \"e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:13.822513 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.822412 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-workload-certs\") pod \"e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:13.822513 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.822431 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-istio-data\") pod \"e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:13.822513 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.822466 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25176944-ec32-49bb-bb89-69602058cda5-istio-token\") pod \"e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:13.822513 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.822500 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25176944-ec32-49bb-bb89-69602058cda5-istiod-ca-cert\") pod \"e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:13.822672 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.822529 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-istio-envoy\") pod \"e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:13.822672 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.822575 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-workload-socket\") pod \"e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:13.822672 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.822650 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25176944-ec32-49bb-bb89-69602058cda5-istio-podinfo\") pod \"e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:13.822768 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.822686 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-credential-socket\") pod \"e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:13.828018 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.827988 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:13.907403 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.907375 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:13.923571 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.923539 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-workload-socket\") pod \"e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:13.923745 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.923586 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25176944-ec32-49bb-bb89-69602058cda5-istio-podinfo\") pod \"e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:13.923745 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.923613 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-credential-socket\") pod \"e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:13.923745 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.923639 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sswjd\" (UniqueName: \"kubernetes.io/projected/25176944-ec32-49bb-bb89-69602058cda5-kube-api-access-sswjd\") pod \"e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:13.923745 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.923668 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-workload-certs\") pod \"e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:13.923745 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.923685 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-istio-data\") pod \"e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:13.923745 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.923715 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25176944-ec32-49bb-bb89-69602058cda5-istio-token\") pod \"e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:13.924094 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.923762 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25176944-ec32-49bb-bb89-69602058cda5-istiod-ca-cert\") pod \"e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:13.924094 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.923801 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-istio-envoy\") pod \"e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:13.924094 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.924051 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-workload-socket\") pod \"e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:13.924424 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.924371 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-credential-socket\") pod \"e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:13.924677 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.924655 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-workload-certs\") pod \"e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:13.924757 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.924721 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25176944-ec32-49bb-bb89-69602058cda5-istiod-ca-cert\") pod \"e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:13.925047 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.924994 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-istio-data\") pod \"e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:13.927017 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.926997 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-istio-envoy\") pod \"e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:13.927376 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.927357 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25176944-ec32-49bb-bb89-69602058cda5-istio-podinfo\") pod \"e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:13.933301 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.933272 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25176944-ec32-49bb-bb89-69602058cda5-istio-token\") pod \"e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:13.933403 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:13.933384 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sswjd\" (UniqueName: \"kubernetes.io/projected/25176944-ec32-49bb-bb89-69602058cda5-kube-api-access-sswjd\") pod \"e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:14.096922 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:14.096807 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:14.231982 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:14.231953 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv"] Jul 02 19:38:14.233442 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:38:14.233419 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25176944_ec32_49bb_bb89_69602058cda5.slice/crio-92ad3c4f15e0ee086eca5030ee92585b3e51c0bc07da9bac6085574a416d1815 WatchSource:0}: Error finding container 92ad3c4f15e0ee086eca5030ee92585b3e51c0bc07da9bac6085574a416d1815: Status 404 returned error can't find the container with id 92ad3c4f15e0ee086eca5030ee92585b3e51c0bc07da9bac6085574a416d1815 Jul 02 19:38:14.236202 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:14.236173 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:38:14.236278 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:14.236235 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:38:14.236278 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:14.236262 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:38:14.269331 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:14.269309 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" event={"ID":"25176944-ec32-49bb-bb89-69602058cda5","Type":"ContainerStarted","Data":"92ad3c4f15e0ee086eca5030ee92585b3e51c0bc07da9bac6085574a416d1815"} Jul 02 19:38:15.275529 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:15.275489 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" event={"ID":"25176944-ec32-49bb-bb89-69602058cda5","Type":"ContainerStarted","Data":"38b282baedc37bd4bbaaf4745eeb16bffe28025c1a05744a3c5fc01ea95c13d1"} Jul 02 19:38:15.300393 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:15.300349 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" podStartSLOduration=2.300335198 podStartE2EDuration="2.300335198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:38:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:38:15.298883926 +0000 UTC m=+2222.960853088" watchObservedRunningTime="2026-07-02 19:38:15.300335198 +0000 UTC m=+2222.962304347" Jul 02 19:38:16.097612 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:16.097572 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:16.102099 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:16.102076 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:16.280650 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:16.280618 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:16.281688 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:16.281668 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:16.388103 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:16.388073 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:38:17.407716 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:17.407680 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:17.541757 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:17.541717 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:17.639337 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:17.639305 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:18.020986 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.020942 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:18.109574 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.109551 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:38:18.124925 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.124893 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:18.166992 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.166960 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mfzz\" (UniqueName: \"kubernetes.io/projected/dfd52f8f-7691-4e93-a501-ced54b7f7033-kube-api-access-4mfzz\") pod \"dfd52f8f-7691-4e93-a501-ced54b7f7033\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " Jul 02 19:38:18.167146 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.167031 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-workload-socket\") pod \"dfd52f8f-7691-4e93-a501-ced54b7f7033\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " Jul 02 19:38:18.167221 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.167202 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-istio-envoy\") pod \"dfd52f8f-7691-4e93-a501-ced54b7f7033\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " Jul 02 19:38:18.167276 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.167250 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfd52f8f-7691-4e93-a501-ced54b7f7033-istiod-ca-cert\") pod \"dfd52f8f-7691-4e93-a501-ced54b7f7033\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " Jul 02 19:38:18.167332 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.167307 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-istio-data\") pod \"dfd52f8f-7691-4e93-a501-ced54b7f7033\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " Jul 02 19:38:18.167332 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.167308 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dfd52f8f-7691-4e93-a501-ced54b7f7033" (UID: "dfd52f8f-7691-4e93-a501-ced54b7f7033"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:38:18.167448 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.167348 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-credential-socket\") pod \"dfd52f8f-7691-4e93-a501-ced54b7f7033\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " Jul 02 19:38:18.167448 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.167377 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-workload-certs\") pod \"dfd52f8f-7691-4e93-a501-ced54b7f7033\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " Jul 02 19:38:18.167448 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.167441 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfd52f8f-7691-4e93-a501-ced54b7f7033-istio-podinfo\") pod \"dfd52f8f-7691-4e93-a501-ced54b7f7033\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " Jul 02 19:38:18.167594 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.167484 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfd52f8f-7691-4e93-a501-ced54b7f7033-istio-token\") pod \"dfd52f8f-7691-4e93-a501-ced54b7f7033\" (UID: \"dfd52f8f-7691-4e93-a501-ced54b7f7033\") " Jul 02 19:38:18.167830 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.167762 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-workload-socket\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:38:18.168234 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.167994 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dfd52f8f-7691-4e93-a501-ced54b7f7033" (UID: "dfd52f8f-7691-4e93-a501-ced54b7f7033"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:38:18.168739 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.168511 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfd52f8f-7691-4e93-a501-ced54b7f7033-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dfd52f8f-7691-4e93-a501-ced54b7f7033" (UID: "dfd52f8f-7691-4e93-a501-ced54b7f7033"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:38:18.169117 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.168890 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dfd52f8f-7691-4e93-a501-ced54b7f7033" (UID: "dfd52f8f-7691-4e93-a501-ced54b7f7033"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:38:18.169117 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.169012 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-istio-data" (OuterVolumeSpecName: "istio-data") pod "dfd52f8f-7691-4e93-a501-ced54b7f7033" (UID: "dfd52f8f-7691-4e93-a501-ced54b7f7033"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:38:18.169768 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.169733 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfd52f8f-7691-4e93-a501-ced54b7f7033-kube-api-access-4mfzz" (OuterVolumeSpecName: "kube-api-access-4mfzz") pod "dfd52f8f-7691-4e93-a501-ced54b7f7033" (UID: "dfd52f8f-7691-4e93-a501-ced54b7f7033"). InnerVolumeSpecName "kube-api-access-4mfzz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:38:18.170004 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.169964 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dfd52f8f-7691-4e93-a501-ced54b7f7033" (UID: "dfd52f8f-7691-4e93-a501-ced54b7f7033"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:38:18.171075 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.171052 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dfd52f8f-7691-4e93-a501-ced54b7f7033-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dfd52f8f-7691-4e93-a501-ced54b7f7033" (UID: "dfd52f8f-7691-4e93-a501-ced54b7f7033"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 19:38:18.171142 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.171123 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfd52f8f-7691-4e93-a501-ced54b7f7033-istio-token" (OuterVolumeSpecName: "istio-token") pod "dfd52f8f-7691-4e93-a501-ced54b7f7033" (UID: "dfd52f8f-7691-4e93-a501-ced54b7f7033"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:38:18.268863 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.268825 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-istio-envoy\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:38:18.268863 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.268864 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfd52f8f-7691-4e93-a501-ced54b7f7033-istiod-ca-cert\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:38:18.269002 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.268873 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-istio-data\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:38:18.269002 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.268880 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-credential-socket\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:38:18.269002 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.268888 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfd52f8f-7691-4e93-a501-ced54b7f7033-workload-certs\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:38:18.269002 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.268896 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfd52f8f-7691-4e93-a501-ced54b7f7033-istio-podinfo\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:38:18.269002 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.268904 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfd52f8f-7691-4e93-a501-ced54b7f7033-istio-token\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:38:18.269002 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.268913 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mfzz\" (UniqueName: \"kubernetes.io/projected/dfd52f8f-7691-4e93-a501-ced54b7f7033-kube-api-access-4mfzz\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:38:18.291601 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.291576 2559 generic.go:356] "Generic (PLEG): container finished" podID="dfd52f8f-7691-4e93-a501-ced54b7f7033" containerID="94191f9557ee5ea276675b38ddf9a1a1a935b5bc0ac7288536308249afae99eb" exitCode=0 Jul 02 19:38:18.291688 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.291625 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" Jul 02 19:38:18.291688 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.291668 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" event={"ID":"dfd52f8f-7691-4e93-a501-ced54b7f7033","Type":"ContainerDied","Data":"94191f9557ee5ea276675b38ddf9a1a1a935b5bc0ac7288536308249afae99eb"} Jul 02 19:38:18.291760 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.291726 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj" event={"ID":"dfd52f8f-7691-4e93-a501-ced54b7f7033","Type":"ContainerDied","Data":"b5dc2069651225e40fcee899f11243fb998a435ac1d4b9878cd11d6a2f387465"} Jul 02 19:38:18.291796 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.291758 2559 scope.go:117] "RemoveContainer" containerID="94191f9557ee5ea276675b38ddf9a1a1a935b5bc0ac7288536308249afae99eb" Jul 02 19:38:18.301219 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.301203 2559 scope.go:117] "RemoveContainer" containerID="a5a098f23b1dab6ccd45d836487ce3ab7e4e1654fdc405e6351d35c857d0b408" Jul 02 19:38:18.309639 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.309621 2559 scope.go:117] "RemoveContainer" containerID="94191f9557ee5ea276675b38ddf9a1a1a935b5bc0ac7288536308249afae99eb" Jul 02 19:38:18.309884 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:38:18.309861 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94191f9557ee5ea276675b38ddf9a1a1a935b5bc0ac7288536308249afae99eb\": container with ID starting with 94191f9557ee5ea276675b38ddf9a1a1a935b5bc0ac7288536308249afae99eb not found: ID does not exist" containerID="94191f9557ee5ea276675b38ddf9a1a1a935b5bc0ac7288536308249afae99eb" Jul 02 19:38:18.309938 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.309894 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94191f9557ee5ea276675b38ddf9a1a1a935b5bc0ac7288536308249afae99eb"} err="failed to get container status \"94191f9557ee5ea276675b38ddf9a1a1a935b5bc0ac7288536308249afae99eb\": rpc error: code = NotFound desc = could not find container \"94191f9557ee5ea276675b38ddf9a1a1a935b5bc0ac7288536308249afae99eb\": container with ID starting with 94191f9557ee5ea276675b38ddf9a1a1a935b5bc0ac7288536308249afae99eb not found: ID does not exist" Jul 02 19:38:18.309938 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.309915 2559 scope.go:117] "RemoveContainer" containerID="a5a098f23b1dab6ccd45d836487ce3ab7e4e1654fdc405e6351d35c857d0b408" Jul 02 19:38:18.310196 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:38:18.310175 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5a098f23b1dab6ccd45d836487ce3ab7e4e1654fdc405e6351d35c857d0b408\": container with ID starting with a5a098f23b1dab6ccd45d836487ce3ab7e4e1654fdc405e6351d35c857d0b408 not found: ID does not exist" containerID="a5a098f23b1dab6ccd45d836487ce3ab7e4e1654fdc405e6351d35c857d0b408" Jul 02 19:38:18.310296 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.310198 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5a098f23b1dab6ccd45d836487ce3ab7e4e1654fdc405e6351d35c857d0b408"} err="failed to get container status \"a5a098f23b1dab6ccd45d836487ce3ab7e4e1654fdc405e6351d35c857d0b408\": rpc error: code = NotFound desc = could not find container \"a5a098f23b1dab6ccd45d836487ce3ab7e4e1654fdc405e6351d35c857d0b408\": container with ID starting with a5a098f23b1dab6ccd45d836487ce3ab7e4e1654fdc405e6351d35c857d0b408 not found: ID does not exist" Jul 02 19:38:18.315943 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.315923 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj"] Jul 02 19:38:18.322392 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.322374 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-05e617-openshift-default-546cfcbf-v6hmj"] Jul 02 19:38:18.404194 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.404169 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:18.886565 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:18.886528 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfd52f8f-7691-4e93-a501-ced54b7f7033" path="/var/lib/kubelet/pods/dfd52f8f-7691-4e93-a501-ced54b7f7033/volumes" Jul 02 19:38:21.881220 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:21.881178 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:22.229502 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.229415 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:22.517216 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.517133 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv"] Jul 02 19:38:22.517658 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.517635 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfd52f8f-7691-4e93-a501-ced54b7f7033" containerName="istio-proxy" Jul 02 19:38:22.517658 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.517659 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfd52f8f-7691-4e93-a501-ced54b7f7033" containerName="istio-proxy" Jul 02 19:38:22.517877 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.517684 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfd52f8f-7691-4e93-a501-ced54b7f7033" containerName="istio-proxy" Jul 02 19:38:22.517877 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.517695 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfd52f8f-7691-4e93-a501-ced54b7f7033" containerName="istio-proxy" Jul 02 19:38:22.517877 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.517784 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfd52f8f-7691-4e93-a501-ced54b7f7033" containerName="istio-proxy" Jul 02 19:38:22.517877 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.517795 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfd52f8f-7691-4e93-a501-ced54b7f7033" containerName="istio-proxy" Jul 02 19:38:22.521044 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.521024 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.523438 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.523421 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-6e39fb-openshift-default-dockercfg-4n4vr\"" Jul 02 19:38:22.531965 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.531943 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv"] Jul 02 19:38:22.552984 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.552955 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:22.605769 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.605738 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-workload-socket\") pod \"e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.605930 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.605775 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-credential-socket\") pod \"e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.605930 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.605803 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istio-envoy\") pod \"e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.605930 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.605894 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istio-podinfo\") pod \"e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.605930 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.605918 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swr2l\" (UniqueName: \"kubernetes.io/projected/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-kube-api-access-swr2l\") pod \"e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.606144 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.605941 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-workload-certs\") pod \"e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.606144 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.606062 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istio-data\") pod \"e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.606144 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.606101 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istiod-ca-cert\") pod \"e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.606280 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.606174 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istio-token\") pod \"e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.707528 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.707482 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-workload-socket\") pod \"e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.707528 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.707533 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-credential-socket\") pod \"e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.707776 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.707560 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istio-envoy\") pod \"e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.707776 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.707612 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istio-podinfo\") pod \"e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.707776 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.707637 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swr2l\" (UniqueName: \"kubernetes.io/projected/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-kube-api-access-swr2l\") pod \"e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.707776 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.707670 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-workload-certs\") pod \"e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.707776 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.707728 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istio-data\") pod \"e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.707776 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.707754 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istiod-ca-cert\") pod \"e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.708123 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.707800 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istio-token\") pod \"e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.708123 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.707971 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-credential-socket\") pod \"e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.708366 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.708338 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-workload-socket\") pod \"e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.708366 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.708363 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-workload-certs\") pod \"e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.708598 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.708575 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istio-data\") pod \"e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.708667 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.708649 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istiod-ca-cert\") pod \"e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.709994 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.709974 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istio-envoy\") pod \"e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.710126 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.710107 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istio-podinfo\") pod \"e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.715391 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.715357 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istio-token\") pod \"e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.715604 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.715586 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swr2l\" (UniqueName: \"kubernetes.io/projected/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-kube-api-access-swr2l\") pod \"e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.832133 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.832058 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:22.992811 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.992782 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv"] Jul 02 19:38:22.995536 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:38:22.995507 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2c54c8e_71b3_47b9_9ab4_9ddd66ed0d2d.slice/crio-3af278d6f5b2a9b38f288539f7fcca6033a1b2e1ad56d706282308a6ec6033b0 WatchSource:0}: Error finding container 3af278d6f5b2a9b38f288539f7fcca6033a1b2e1ad56d706282308a6ec6033b0: Status 404 returned error can't find the container with id 3af278d6f5b2a9b38f288539f7fcca6033a1b2e1ad56d706282308a6ec6033b0 Jul 02 19:38:22.998309 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.998272 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:38:22.998385 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.998355 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:38:22.998419 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:22.998397 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:38:23.049930 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:23.049815 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:23.330109 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:23.330061 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" event={"ID":"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d","Type":"ContainerStarted","Data":"b6e0480db5f18a845f4aa20acfbcca10691228ec215c67fc0e6cebfb704a8b60"} Jul 02 19:38:23.330505 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:23.330394 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" event={"ID":"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d","Type":"ContainerStarted","Data":"3af278d6f5b2a9b38f288539f7fcca6033a1b2e1ad56d706282308a6ec6033b0"} Jul 02 19:38:23.354111 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:23.354054 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" podStartSLOduration=1.354038624 podStartE2EDuration="1.354038624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:38:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:38:23.351881352 +0000 UTC m=+2231.013850505" watchObservedRunningTime="2026-07-02 19:38:23.354038624 +0000 UTC m=+2231.016007755" Jul 02 19:38:23.832434 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:23.832397 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:24.837077 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:24.837049 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:25.341413 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:25.341377 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:25.342461 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:25.342439 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:25.420562 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:25.420520 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:25.524540 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:25.524506 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:25.637885 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:25.637830 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:25.891671 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:25.891565 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:26.169760 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:26.169680 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:26.197688 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:26.197660 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:38:26.269546 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:26.269512 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:29.911721 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:29.911688 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:30.371936 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:30.371908 2559 generic.go:356] "Generic (PLEG): container finished" podID="25176944-ec32-49bb-bb89-69602058cda5" containerID="38b282baedc37bd4bbaaf4745eeb16bffe28025c1a05744a3c5fc01ea95c13d1" exitCode=0 Jul 02 19:38:30.372096 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:30.371983 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" event={"ID":"25176944-ec32-49bb-bb89-69602058cda5","Type":"ContainerDied","Data":"38b282baedc37bd4bbaaf4745eeb16bffe28025c1a05744a3c5fc01ea95c13d1"} Jul 02 19:38:30.372366 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:30.372351 2559 scope.go:117] "RemoveContainer" containerID="38b282baedc37bd4bbaaf4745eeb16bffe28025c1a05744a3c5fc01ea95c13d1" Jul 02 19:38:30.373421 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:30.373397 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:38:30.373481 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:30.373469 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:38:30.373519 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:30.373501 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:38:31.281354 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:31.281255 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:31.378966 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:31.378928 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" event={"ID":"25176944-ec32-49bb-bb89-69602058cda5","Type":"ContainerStarted","Data":"35b5179e1ef271c1d97e2ee476c583c50d678f7a90349243ced7140a03527c16"} Jul 02 19:38:32.097820 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:32.097777 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:32.098979 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:32.098954 2559 patch_prober.go:28] interesting pod/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 02 19:38:32.099090 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:32.099002 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" podUID="25176944-ec32-49bb-bb89-69602058cda5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 02 19:38:33.097839 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:33.097798 2559 patch_prober.go:28] interesting pod/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 02 19:38:33.098270 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:33.097888 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" podUID="25176944-ec32-49bb-bb89-69602058cda5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 02 19:38:34.097727 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:34.097670 2559 patch_prober.go:28] interesting pod/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 02 19:38:34.097953 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:34.097746 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" podUID="25176944-ec32-49bb-bb89-69602058cda5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 02 19:38:34.988908 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:34.988814 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:38:35.097424 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:35.097389 2559 patch_prober.go:28] interesting pod/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 02 19:38:35.097620 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:35.097447 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" podUID="25176944-ec32-49bb-bb89-69602058cda5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 02 19:38:36.101715 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:36.101684 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:36.102121 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:36.101964 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:36.102636 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:36.102615 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:38:38.420463 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:38.420431 2559 generic.go:356] "Generic (PLEG): container finished" podID="d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d" containerID="b6e0480db5f18a845f4aa20acfbcca10691228ec215c67fc0e6cebfb704a8b60" exitCode=0 Jul 02 19:38:38.420893 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:38.420487 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" event={"ID":"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d","Type":"ContainerDied","Data":"b6e0480db5f18a845f4aa20acfbcca10691228ec215c67fc0e6cebfb704a8b60"} Jul 02 19:38:38.420893 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:38.420828 2559 scope.go:117] "RemoveContainer" containerID="b6e0480db5f18a845f4aa20acfbcca10691228ec215c67fc0e6cebfb704a8b60" Jul 02 19:38:38.421762 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:38.421736 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:38:38.421816 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:38.421798 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:38:38.421876 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:38.421828 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 19:38:38.737055 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:38.736969 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:38.838547 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:38.838513 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:39.431087 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:39.431051 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" event={"ID":"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d","Type":"ContainerStarted","Data":"ef24da45d557d7d7e656d0029be66c05f980501838736475025d627cdd77b0fd"} Jul 02 19:38:39.495822 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:39.495788 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:39.833238 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:39.833137 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:39.834344 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:39.834317 2559 patch_prober.go:28] interesting pod/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 02 19:38:39.834457 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:39.834370 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" podUID="d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 02 19:38:40.342381 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:40.342348 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:40.833004 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:40.832966 2559 patch_prober.go:28] interesting pod/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 02 19:38:40.833376 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:40.833025 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" podUID="d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 02 19:38:41.832635 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:41.832595 2559 patch_prober.go:28] interesting pod/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 02 19:38:41.832816 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:41.832668 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" podUID="d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 02 19:38:41.893969 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:41.893931 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:38:42.832603 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:42.832564 2559 patch_prober.go:28] interesting pod/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 02 19:38:42.832795 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:42.832626 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" podUID="d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 02 19:38:43.837152 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:43.837117 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:43.838092 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:43.838071 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:38:47.164903 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:47.164867 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:38:47.288054 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:38:47.288020 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:39:08.455704 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:39:08.455650 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:39:10.122302 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:39:10.122265 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:39:10.222641 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:39:10.222604 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:39:11.694022 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:39:11.693981 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:39:36.587240 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:39:36.587197 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:39:51.185230 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:39:51.185194 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:40:05.283590 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:40:05.283503 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:40:23.088598 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:40:23.088556 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:40:38.596062 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:40:38.596023 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:40:53.085785 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:40:53.085748 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:41:07.189565 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:41:07.189522 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:41:08.687190 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:41:08.687153 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:41:10.395389 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:41:10.395356 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:41:13.007824 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:41:13.007785 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gf2s_a95b977b-6b92-411f-a185-ecc012668bff/ovn-acl-logging/0.log" Jul 02 19:41:13.011837 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:41:13.011816 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gf2s_a95b977b-6b92-411f-a185-ecc012668bff/ovn-acl-logging/0.log" Jul 02 19:41:24.391716 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:41:24.391679 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:41:34.981992 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:41:34.981909 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:41:38.689925 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:41:38.689896 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:42:01.892898 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:42:01.892830 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:42:05.895203 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:42:05.895154 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:42:21.685386 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:42:21.685350 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:42:21.765917 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:42:21.765886 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:42:37.358663 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:42:37.358632 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:42:38.204398 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:42:38.204364 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:42:40.488225 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:42:40.488191 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:42:41.594966 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:42:41.594930 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:42:54.994706 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:42:54.994664 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:43:09.638124 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:43:09.638036 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:43:09.735219 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:43:09.735186 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:43:23.193747 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:43:23.193705 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:43:26.902425 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:43:26.902391 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:43:39.482987 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:43:39.482948 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:43:39.582867 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:43:39.582829 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:43:46.187337 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:43:46.187305 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:43:47.956333 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:43:47.956300 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:43:48.058661 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:43:48.058630 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:00.389189 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:00.389152 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:44:07.789049 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:07.789014 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:08.669716 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:08.669684 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:09.732193 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:09.732160 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:10.120346 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:10.120310 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:10.223046 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:10.223015 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:10.321942 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:10.321890 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:10.424130 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:10.424050 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:12.991489 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:12.991460 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:44:15.438276 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:15.438248 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:34.548067 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:34.548035 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:34.603653 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:34.603623 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:41.896565 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:41.896519 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:52.476666 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:52.476633 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:52.738224 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:52.738133 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv"] Jul 02 19:44:52.738387 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:52.738327 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" podUID="25176944-ec32-49bb-bb89-69602058cda5" containerName="istio-proxy" containerID="cri-o://35b5179e1ef271c1d97e2ee476c583c50d678f7a90349243ced7140a03527c16" gracePeriod=30 Jul 02 19:44:52.771170 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:52.771143 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:52.998006 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:52.997884 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:53.261377 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:53.261295 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:53.639225 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:53.639198 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:53.740223 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:53.740201 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:53.845306 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:53.845266 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:53.936086 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:53.935998 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:56.797258 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:56.797227 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsfzn"] Jul 02 19:44:57.986035 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:57.986013 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:44:58.081134 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.081062 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-workload-certs\") pod \"25176944-ec32-49bb-bb89-69602058cda5\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " Jul 02 19:44:58.081134 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.081105 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sswjd\" (UniqueName: \"kubernetes.io/projected/25176944-ec32-49bb-bb89-69602058cda5-kube-api-access-sswjd\") pod \"25176944-ec32-49bb-bb89-69602058cda5\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " Jul 02 19:44:58.081134 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.081130 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-istio-data\") pod \"25176944-ec32-49bb-bb89-69602058cda5\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " Jul 02 19:44:58.081374 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.081158 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25176944-ec32-49bb-bb89-69602058cda5-istio-token\") pod \"25176944-ec32-49bb-bb89-69602058cda5\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " Jul 02 19:44:58.081374 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.081240 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-workload-socket\") pod \"25176944-ec32-49bb-bb89-69602058cda5\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " Jul 02 19:44:58.081374 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.081268 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-istio-envoy\") pod \"25176944-ec32-49bb-bb89-69602058cda5\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " Jul 02 19:44:58.081374 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.081292 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-credential-socket\") pod \"25176944-ec32-49bb-bb89-69602058cda5\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " Jul 02 19:44:58.081374 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.081314 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25176944-ec32-49bb-bb89-69602058cda5-istio-podinfo\") pod \"25176944-ec32-49bb-bb89-69602058cda5\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " Jul 02 19:44:58.081374 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.081344 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25176944-ec32-49bb-bb89-69602058cda5-istiod-ca-cert\") pod \"25176944-ec32-49bb-bb89-69602058cda5\" (UID: \"25176944-ec32-49bb-bb89-69602058cda5\") " Jul 02 19:44:58.081659 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.081351 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "25176944-ec32-49bb-bb89-69602058cda5" (UID: "25176944-ec32-49bb-bb89-69602058cda5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:44:58.081659 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.081515 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "25176944-ec32-49bb-bb89-69602058cda5" (UID: "25176944-ec32-49bb-bb89-69602058cda5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:44:58.081659 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.081532 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "25176944-ec32-49bb-bb89-69602058cda5" (UID: "25176944-ec32-49bb-bb89-69602058cda5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:44:58.081659 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.081628 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-workload-socket\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:44:58.081659 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.081645 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-credential-socket\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:44:58.081884 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.081687 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-workload-certs\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:44:58.081884 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.081802 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25176944-ec32-49bb-bb89-69602058cda5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "25176944-ec32-49bb-bb89-69602058cda5" (UID: "25176944-ec32-49bb-bb89-69602058cda5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:44:58.082199 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.082160 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-istio-data" (OuterVolumeSpecName: "istio-data") pod "25176944-ec32-49bb-bb89-69602058cda5" (UID: "25176944-ec32-49bb-bb89-69602058cda5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:44:58.083356 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.083332 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25176944-ec32-49bb-bb89-69602058cda5-kube-api-access-sswjd" (OuterVolumeSpecName: "kube-api-access-sswjd") pod "25176944-ec32-49bb-bb89-69602058cda5" (UID: "25176944-ec32-49bb-bb89-69602058cda5"). InnerVolumeSpecName "kube-api-access-sswjd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:44:58.083474 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.083354 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25176944-ec32-49bb-bb89-69602058cda5-istio-token" (OuterVolumeSpecName: "istio-token") pod "25176944-ec32-49bb-bb89-69602058cda5" (UID: "25176944-ec32-49bb-bb89-69602058cda5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:44:58.083523 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.083462 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/25176944-ec32-49bb-bb89-69602058cda5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "25176944-ec32-49bb-bb89-69602058cda5" (UID: "25176944-ec32-49bb-bb89-69602058cda5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 19:44:58.083581 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.083562 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "25176944-ec32-49bb-bb89-69602058cda5" (UID: "25176944-ec32-49bb-bb89-69602058cda5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:44:58.182249 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.182215 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25176944-ec32-49bb-bb89-69602058cda5-istio-podinfo\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:44:58.182249 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.182247 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25176944-ec32-49bb-bb89-69602058cda5-istiod-ca-cert\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:44:58.182441 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.182264 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sswjd\" (UniqueName: \"kubernetes.io/projected/25176944-ec32-49bb-bb89-69602058cda5-kube-api-access-sswjd\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:44:58.182441 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.182280 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-istio-data\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:44:58.182441 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.182293 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25176944-ec32-49bb-bb89-69602058cda5-istio-token\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:44:58.182441 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.182304 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25176944-ec32-49bb-bb89-69602058cda5-istio-envoy\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:44:58.418730 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.418697 2559 generic.go:356] "Generic (PLEG): container finished" podID="25176944-ec32-49bb-bb89-69602058cda5" containerID="35b5179e1ef271c1d97e2ee476c583c50d678f7a90349243ced7140a03527c16" exitCode=0 Jul 02 19:44:58.418918 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.418742 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" Jul 02 19:44:58.418918 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.418786 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" event={"ID":"25176944-ec32-49bb-bb89-69602058cda5","Type":"ContainerDied","Data":"35b5179e1ef271c1d97e2ee476c583c50d678f7a90349243ced7140a03527c16"} Jul 02 19:44:58.418918 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.418844 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv" event={"ID":"25176944-ec32-49bb-bb89-69602058cda5","Type":"ContainerDied","Data":"92ad3c4f15e0ee086eca5030ee92585b3e51c0bc07da9bac6085574a416d1815"} Jul 02 19:44:58.418918 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.418872 2559 scope.go:117] "RemoveContainer" containerID="35b5179e1ef271c1d97e2ee476c583c50d678f7a90349243ced7140a03527c16" Jul 02 19:44:58.432009 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.431980 2559 scope.go:117] "RemoveContainer" containerID="38b282baedc37bd4bbaaf4745eeb16bffe28025c1a05744a3c5fc01ea95c13d1" Jul 02 19:44:58.439783 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.439764 2559 scope.go:117] "RemoveContainer" containerID="35b5179e1ef271c1d97e2ee476c583c50d678f7a90349243ced7140a03527c16" Jul 02 19:44:58.440027 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:44:58.440009 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35b5179e1ef271c1d97e2ee476c583c50d678f7a90349243ced7140a03527c16\": container with ID starting with 35b5179e1ef271c1d97e2ee476c583c50d678f7a90349243ced7140a03527c16 not found: ID does not exist" containerID="35b5179e1ef271c1d97e2ee476c583c50d678f7a90349243ced7140a03527c16" Jul 02 19:44:58.440078 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.440034 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35b5179e1ef271c1d97e2ee476c583c50d678f7a90349243ced7140a03527c16"} err="failed to get container status \"35b5179e1ef271c1d97e2ee476c583c50d678f7a90349243ced7140a03527c16\": rpc error: code = NotFound desc = could not find container \"35b5179e1ef271c1d97e2ee476c583c50d678f7a90349243ced7140a03527c16\": container with ID starting with 35b5179e1ef271c1d97e2ee476c583c50d678f7a90349243ced7140a03527c16 not found: ID does not exist" Jul 02 19:44:58.440078 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.440049 2559 scope.go:117] "RemoveContainer" containerID="38b282baedc37bd4bbaaf4745eeb16bffe28025c1a05744a3c5fc01ea95c13d1" Jul 02 19:44:58.440244 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:44:58.440227 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38b282baedc37bd4bbaaf4745eeb16bffe28025c1a05744a3c5fc01ea95c13d1\": container with ID starting with 38b282baedc37bd4bbaaf4745eeb16bffe28025c1a05744a3c5fc01ea95c13d1 not found: ID does not exist" containerID="38b282baedc37bd4bbaaf4745eeb16bffe28025c1a05744a3c5fc01ea95c13d1" Jul 02 19:44:58.440291 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.440248 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38b282baedc37bd4bbaaf4745eeb16bffe28025c1a05744a3c5fc01ea95c13d1"} err="failed to get container status \"38b282baedc37bd4bbaaf4745eeb16bffe28025c1a05744a3c5fc01ea95c13d1\": rpc error: code = NotFound desc = could not find container \"38b282baedc37bd4bbaaf4745eeb16bffe28025c1a05744a3c5fc01ea95c13d1\": container with ID starting with 38b282baedc37bd4bbaaf4745eeb16bffe28025c1a05744a3c5fc01ea95c13d1 not found: ID does not exist" Jul 02 19:44:58.444329 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.444309 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv"] Jul 02 19:44:58.448461 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.448441 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-50666c-openshift-default-7dc6d5ddf5-pq2gv"] Jul 02 19:44:58.886685 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:58.886650 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25176944-ec32-49bb-bb89-69602058cda5" path="/var/lib/kubelet/pods/25176944-ec32-49bb-bb89-69602058cda5/volumes" Jul 02 19:44:59.472310 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:59.472281 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:59.572740 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:59.572710 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:59.729383 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:59.729311 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv"] Jul 02 19:44:59.729523 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:59.729507 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" podUID="d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d" containerName="istio-proxy" containerID="cri-o://ef24da45d557d7d7e656d0029be66c05f980501838736475025d627cdd77b0fd" gracePeriod=30 Jul 02 19:44:59.757524 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:59.757496 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:44:59.990114 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:44:59.990030 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:45:04.984233 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:04.984209 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:45:05.037736 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.037675 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istio-token\") pod \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " Jul 02 19:45:05.037736 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.037708 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istiod-ca-cert\") pod \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " Jul 02 19:45:05.037957 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.037745 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swr2l\" (UniqueName: \"kubernetes.io/projected/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-kube-api-access-swr2l\") pod \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " Jul 02 19:45:05.037957 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.037765 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-credential-socket\") pod \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " Jul 02 19:45:05.037957 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.037779 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istio-data\") pod \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " Jul 02 19:45:05.037957 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.037797 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-workload-socket\") pod \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " Jul 02 19:45:05.037957 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.037817 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-workload-certs\") pod \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " Jul 02 19:45:05.037957 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.037870 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istio-podinfo\") pod \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " Jul 02 19:45:05.037957 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.037920 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istio-envoy\") pod \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\" (UID: \"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d\") " Jul 02 19:45:05.038293 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.038128 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d" (UID: "d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:45:05.038293 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.038143 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d" (UID: "d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:45:05.038293 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.038212 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d" (UID: "d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:45:05.038470 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.038450 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d" (UID: "d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:45:05.038722 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.038701 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istio-data" (OuterVolumeSpecName: "istio-data") pod "d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d" (UID: "d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:45:05.040060 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.040031 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d" (UID: "d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:45:05.040144 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.040078 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d" (UID: "d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 19:45:05.040286 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.040265 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-kube-api-access-swr2l" (OuterVolumeSpecName: "kube-api-access-swr2l") pod "d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d" (UID: "d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d"). InnerVolumeSpecName "kube-api-access-swr2l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:45:05.040341 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.040327 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istio-token" (OuterVolumeSpecName: "istio-token") pod "d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d" (UID: "d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:45:05.138786 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.138768 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istio-token\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:45:05.138786 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.138786 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istiod-ca-cert\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:45:05.138930 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.138796 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swr2l\" (UniqueName: \"kubernetes.io/projected/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-kube-api-access-swr2l\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:45:05.138930 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.138807 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-credential-socket\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:45:05.138930 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.138815 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istio-data\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:45:05.138930 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.138823 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-workload-socket\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:45:05.138930 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.138831 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-workload-certs\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:45:05.138930 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.138838 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istio-podinfo\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:45:05.138930 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.138845 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d-istio-envoy\") on node \"ip-10-0-130-197.ec2.internal\" DevicePath \"\"" Jul 02 19:45:05.457211 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.457178 2559 generic.go:356] "Generic (PLEG): container finished" podID="d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d" containerID="ef24da45d557d7d7e656d0029be66c05f980501838736475025d627cdd77b0fd" exitCode=0 Jul 02 19:45:05.457361 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.457228 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" Jul 02 19:45:05.457361 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.457265 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" event={"ID":"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d","Type":"ContainerDied","Data":"ef24da45d557d7d7e656d0029be66c05f980501838736475025d627cdd77b0fd"} Jul 02 19:45:05.457361 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.457331 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv" event={"ID":"d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d","Type":"ContainerDied","Data":"3af278d6f5b2a9b38f288539f7fcca6033a1b2e1ad56d706282308a6ec6033b0"} Jul 02 19:45:05.457529 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.457362 2559 scope.go:117] "RemoveContainer" containerID="ef24da45d557d7d7e656d0029be66c05f980501838736475025d627cdd77b0fd" Jul 02 19:45:05.466587 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.466571 2559 scope.go:117] "RemoveContainer" containerID="b6e0480db5f18a845f4aa20acfbcca10691228ec215c67fc0e6cebfb704a8b60" Jul 02 19:45:05.474187 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.474169 2559 scope.go:117] "RemoveContainer" containerID="ef24da45d557d7d7e656d0029be66c05f980501838736475025d627cdd77b0fd" Jul 02 19:45:05.474412 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:45:05.474395 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef24da45d557d7d7e656d0029be66c05f980501838736475025d627cdd77b0fd\": container with ID starting with ef24da45d557d7d7e656d0029be66c05f980501838736475025d627cdd77b0fd not found: ID does not exist" containerID="ef24da45d557d7d7e656d0029be66c05f980501838736475025d627cdd77b0fd" Jul 02 19:45:05.474455 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.474418 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef24da45d557d7d7e656d0029be66c05f980501838736475025d627cdd77b0fd"} err="failed to get container status \"ef24da45d557d7d7e656d0029be66c05f980501838736475025d627cdd77b0fd\": rpc error: code = NotFound desc = could not find container \"ef24da45d557d7d7e656d0029be66c05f980501838736475025d627cdd77b0fd\": container with ID starting with ef24da45d557d7d7e656d0029be66c05f980501838736475025d627cdd77b0fd not found: ID does not exist" Jul 02 19:45:05.474455 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.474433 2559 scope.go:117] "RemoveContainer" containerID="b6e0480db5f18a845f4aa20acfbcca10691228ec215c67fc0e6cebfb704a8b60" Jul 02 19:45:05.474677 ip-10-0-130-197 kubenswrapper[2559]: E0702 19:45:05.474659 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6e0480db5f18a845f4aa20acfbcca10691228ec215c67fc0e6cebfb704a8b60\": container with ID starting with b6e0480db5f18a845f4aa20acfbcca10691228ec215c67fc0e6cebfb704a8b60 not found: ID does not exist" containerID="b6e0480db5f18a845f4aa20acfbcca10691228ec215c67fc0e6cebfb704a8b60" Jul 02 19:45:05.474720 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.474682 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6e0480db5f18a845f4aa20acfbcca10691228ec215c67fc0e6cebfb704a8b60"} err="failed to get container status \"b6e0480db5f18a845f4aa20acfbcca10691228ec215c67fc0e6cebfb704a8b60\": rpc error: code = NotFound desc = could not find container \"b6e0480db5f18a845f4aa20acfbcca10691228ec215c67fc0e6cebfb704a8b60\": container with ID starting with b6e0480db5f18a845f4aa20acfbcca10691228ec215c67fc0e6cebfb704a8b60 not found: ID does not exist" Jul 02 19:45:05.478938 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.478906 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv"] Jul 02 19:45:05.484315 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.484295 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-6e39fb-openshift-default-7bcd97b9c5-26qwv"] Jul 02 19:45:05.606831 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:05.606815 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29716995-xjrhw_4ef3d67e-93df-4285-8db7-30f0062f6f7b/cleanup/0.log" Jul 02 19:45:06.303494 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:06.303464 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d984f5d94-b7wvc_bcae5632-4ce0-4beb-86dc-9a7dbbb317c8/copy-manifests/0.log" Jul 02 19:45:06.309903 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:06.309886 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d984f5d94-b7wvc_bcae5632-4ce0-4beb-86dc-9a7dbbb317c8/manager/0.log" Jul 02 19:45:06.885993 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:06.885961 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d" path="/var/lib/kubelet/pods/d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d/volumes" Jul 02 19:45:07.488949 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:07.488921 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc_6fa1c139-3c9d-4252-8f3e-4da234afa1df/extract/0.log" Jul 02 19:45:07.495579 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:07.495558 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc_6fa1c139-3c9d-4252-8f3e-4da234afa1df/util/0.log" Jul 02 19:45:07.501913 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:07.501891 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc_6fa1c139-3c9d-4252-8f3e-4da234afa1df/pull/0.log" Jul 02 19:45:07.616262 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:07.616234 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg_493b5e47-74ca-44b1-9bf0-783592e85e0d/util/0.log" Jul 02 19:45:07.622498 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:07.622475 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg_493b5e47-74ca-44b1-9bf0-783592e85e0d/pull/0.log" Jul 02 19:45:07.628911 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:07.628896 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg_493b5e47-74ca-44b1-9bf0-783592e85e0d/extract/0.log" Jul 02 19:45:07.755346 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:07.755268 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4_02021470-d4db-4cdc-bf9b-552dda77d22e/extract/0.log" Jul 02 19:45:07.761916 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:07.761897 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4_02021470-d4db-4cdc-bf9b-552dda77d22e/util/0.log" Jul 02 19:45:07.768588 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:07.768569 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4_02021470-d4db-4cdc-bf9b-552dda77d22e/pull/0.log" Jul 02 19:45:07.879753 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:07.879727 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz_4442a8e3-4a92-4cad-a51c-c0e9a6c1d271/util/0.log" Jul 02 19:45:07.886071 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:07.886049 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz_4442a8e3-4a92-4cad-a51c-c0e9a6c1d271/pull/0.log" Jul 02 19:45:07.892621 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:07.892602 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz_4442a8e3-4a92-4cad-a51c-c0e9a6c1d271/extract/0.log" Jul 02 19:45:08.760294 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:08.760262 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-bsfzn_c077dd56-5a5b-4111-9eb4-b039ab766156/limitador/0.log" Jul 02 19:45:09.249701 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:09.249673 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mdjxd_728b9481-425c-42f3-9ec4-d82af992fd98/istio-proxy/0.log" Jul 02 19:45:09.368339 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:09.368310 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zbb24_a26358e2-c342-4623-b048-537ecf0b715a/discovery/0.log" Jul 02 19:45:14.993523 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:14.993486 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:45:15.058677 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:15.058650 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" limit=1024 Jul 02 19:45:17.822791 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:17.822764 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-z4j2p_92b042c6-6b86-452c-8f9f-2341729e81c5/global-pull-secret-syncer/0.log" Jul 02 19:45:17.906259 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:17.906233 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6zv56_92ce22b9-a9ce-4f08-b4d1-b770c2e317ae/konnectivity-agent/0.log" Jul 02 19:45:18.005524 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:18.005494 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-197.ec2.internal_05cb7619a8b4cf72df33e4bbdca9093f/haproxy/0.log" Jul 02 19:45:22.167807 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:22.167783 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc_6fa1c139-3c9d-4252-8f3e-4da234afa1df/extract/0.log" Jul 02 19:45:22.194353 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:22.194325 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc_6fa1c139-3c9d-4252-8f3e-4da234afa1df/util/0.log" Jul 02 19:45:22.218470 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:22.218448 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zc7vc_6fa1c139-3c9d-4252-8f3e-4da234afa1df/pull/0.log" Jul 02 19:45:22.246057 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:22.246017 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg_493b5e47-74ca-44b1-9bf0-783592e85e0d/extract/0.log" Jul 02 19:45:22.270068 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:22.270044 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg_493b5e47-74ca-44b1-9bf0-783592e85e0d/util/0.log" Jul 02 19:45:22.294104 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:22.294080 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xhsqg_493b5e47-74ca-44b1-9bf0-783592e85e0d/pull/0.log" Jul 02 19:45:22.324324 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:22.324304 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4_02021470-d4db-4cdc-bf9b-552dda77d22e/extract/0.log" Jul 02 19:45:22.354091 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:22.354073 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4_02021470-d4db-4cdc-bf9b-552dda77d22e/util/0.log" Jul 02 19:45:22.379012 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:22.378993 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vsbg4_02021470-d4db-4cdc-bf9b-552dda77d22e/pull/0.log" Jul 02 19:45:22.412486 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:22.412463 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz_4442a8e3-4a92-4cad-a51c-c0e9a6c1d271/extract/0.log" Jul 02 19:45:22.447426 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:22.447358 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz_4442a8e3-4a92-4cad-a51c-c0e9a6c1d271/util/0.log" Jul 02 19:45:22.487731 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:22.487710 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k6gjz_4442a8e3-4a92-4cad-a51c-c0e9a6c1d271/pull/0.log" Jul 02 19:45:23.337870 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:23.337827 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-bsfzn_c077dd56-5a5b-4111-9eb4-b039ab766156/limitador/0.log" Jul 02 19:45:25.704136 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:25.704113 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nth4p_2a84becc-fd52-4aff-938e-87560dcba2b8/node-exporter/0.log" Jul 02 19:45:25.730043 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:25.730017 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nth4p_2a84becc-fd52-4aff-938e-87560dcba2b8/kube-rbac-proxy/0.log" Jul 02 19:45:25.752891 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:25.752872 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nth4p_2a84becc-fd52-4aff-938e-87560dcba2b8/init-textfile/0.log" Jul 02 19:45:25.780938 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:25.780918 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-z7ljn_9f104f54-b9ee-4ceb-acc5-01a18ddfebe4/kube-rbac-proxy-main/0.log" Jul 02 19:45:25.804528 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:25.804509 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-z7ljn_9f104f54-b9ee-4ceb-acc5-01a18ddfebe4/kube-rbac-proxy-self/0.log" Jul 02 19:45:25.831307 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:25.831291 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-z7ljn_9f104f54-b9ee-4ceb-acc5-01a18ddfebe4/openshift-state-metrics/0.log" Jul 02 19:45:25.892375 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:25.892359 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a7891db4-79f7-46c5-b934-5e32fac70f6a/prometheus/0.log" Jul 02 19:45:25.936785 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:25.936716 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a7891db4-79f7-46c5-b934-5e32fac70f6a/config-reloader/0.log" Jul 02 19:45:26.007256 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:26.007239 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a7891db4-79f7-46c5-b934-5e32fac70f6a/thanos-sidecar/0.log" Jul 02 19:45:26.062417 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:26.062396 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a7891db4-79f7-46c5-b934-5e32fac70f6a/kube-rbac-proxy-web/0.log" Jul 02 19:45:26.117644 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:26.117628 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a7891db4-79f7-46c5-b934-5e32fac70f6a/kube-rbac-proxy/0.log" Jul 02 19:45:26.156006 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:26.155988 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a7891db4-79f7-46c5-b934-5e32fac70f6a/kube-rbac-proxy-thanos/0.log" Jul 02 19:45:26.181845 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:26.181830 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a7891db4-79f7-46c5-b934-5e32fac70f6a/init-config-reloader/0.log" Jul 02 19:45:26.219265 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:26.219207 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-w7xvw_fa9fa43f-a19d-4c28-827f-2c5b23fcd79d/prometheus-operator/0.log" Jul 02 19:45:26.241466 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:26.241442 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-w7xvw_fa9fa43f-a19d-4c28-827f-2c5b23fcd79d/kube-rbac-proxy/0.log" Jul 02 19:45:26.268029 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:26.268004 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-pkhb4_373597c2-a645-495b-83b1-d14489fa5ea0/prometheus-operator-admission-webhook/0.log" Jul 02 19:45:26.369756 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:26.369735 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f7554c578-xwxrn_8fe564a4-0d37-4e82-9fa4-c0a979068141/thanos-query/0.log" Jul 02 19:45:26.391817 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:26.391800 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f7554c578-xwxrn_8fe564a4-0d37-4e82-9fa4-c0a979068141/kube-rbac-proxy-web/0.log" Jul 02 19:45:26.415445 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:26.415410 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f7554c578-xwxrn_8fe564a4-0d37-4e82-9fa4-c0a979068141/kube-rbac-proxy/0.log" Jul 02 19:45:26.436939 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:26.436911 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f7554c578-xwxrn_8fe564a4-0d37-4e82-9fa4-c0a979068141/prom-label-proxy/0.log" Jul 02 19:45:26.459398 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:26.459382 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f7554c578-xwxrn_8fe564a4-0d37-4e82-9fa4-c0a979068141/kube-rbac-proxy-rules/0.log" Jul 02 19:45:26.481830 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:26.481775 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f7554c578-xwxrn_8fe564a4-0d37-4e82-9fa4-c0a979068141/kube-rbac-proxy-metrics/0.log" Jul 02 19:45:27.606304 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:27.606271 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-5vxtw_f062450f-7c16-491d-84f1-445c4b169765/networking-console-plugin/0.log" Jul 02 19:45:27.867017 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:27.866943 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-srs74/perf-node-gather-daemonset-mbkdb"] Jul 02 19:45:27.867299 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:27.867285 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d" containerName="istio-proxy" Jul 02 19:45:27.867351 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:27.867300 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d" containerName="istio-proxy" Jul 02 19:45:27.867351 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:27.867311 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d" containerName="istio-proxy" Jul 02 19:45:27.867351 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:27.867317 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d" containerName="istio-proxy" Jul 02 19:45:27.867351 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:27.867332 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25176944-ec32-49bb-bb89-69602058cda5" containerName="istio-proxy" Jul 02 19:45:27.867351 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:27.867338 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="25176944-ec32-49bb-bb89-69602058cda5" containerName="istio-proxy" Jul 02 19:45:27.867351 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:27.867351 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25176944-ec32-49bb-bb89-69602058cda5" containerName="istio-proxy" Jul 02 19:45:27.867609 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:27.867356 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="25176944-ec32-49bb-bb89-69602058cda5" containerName="istio-proxy" Jul 02 19:45:27.867609 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:27.867406 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="25176944-ec32-49bb-bb89-69602058cda5" containerName="istio-proxy" Jul 02 19:45:27.867609 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:27.867413 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d" containerName="istio-proxy" Jul 02 19:45:27.867609 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:27.867418 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2c54c8e-71b3-47b9-9ab4-9ddd66ed0d2d" containerName="istio-proxy" Jul 02 19:45:27.867609 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:27.867424 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="25176944-ec32-49bb-bb89-69602058cda5" containerName="istio-proxy" Jul 02 19:45:27.870882 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:27.870841 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-srs74/perf-node-gather-daemonset-mbkdb" Jul 02 19:45:27.872996 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:27.872967 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-srs74\"/\"openshift-service-ca.crt\"" Jul 02 19:45:27.873095 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:27.872973 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-srs74\"/\"kube-root-ca.crt\"" Jul 02 19:45:27.873095 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:27.873054 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-srs74\"/\"default-dockercfg-5b97m\"" Jul 02 19:45:27.876729 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:27.876708 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-srs74/perf-node-gather-daemonset-mbkdb"] Jul 02 19:45:27.921488 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:27.921452 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/985a55de-593c-450a-92c6-e6c159b6e0bd-proc\") pod \"perf-node-gather-daemonset-mbkdb\" (UID: \"985a55de-593c-450a-92c6-e6c159b6e0bd\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-mbkdb" Jul 02 19:45:27.921657 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:27.921505 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/985a55de-593c-450a-92c6-e6c159b6e0bd-podres\") pod \"perf-node-gather-daemonset-mbkdb\" (UID: \"985a55de-593c-450a-92c6-e6c159b6e0bd\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-mbkdb" Jul 02 19:45:27.921657 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:27.921616 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/985a55de-593c-450a-92c6-e6c159b6e0bd-lib-modules\") pod \"perf-node-gather-daemonset-mbkdb\" (UID: \"985a55de-593c-450a-92c6-e6c159b6e0bd\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-mbkdb" Jul 02 19:45:27.922371 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:27.922131 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/985a55de-593c-450a-92c6-e6c159b6e0bd-sys\") pod \"perf-node-gather-daemonset-mbkdb\" (UID: \"985a55de-593c-450a-92c6-e6c159b6e0bd\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-mbkdb" Jul 02 19:45:27.922371 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:27.922297 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p88cc\" (UniqueName: \"kubernetes.io/projected/985a55de-593c-450a-92c6-e6c159b6e0bd-kube-api-access-p88cc\") pod \"perf-node-gather-daemonset-mbkdb\" (UID: \"985a55de-593c-450a-92c6-e6c159b6e0bd\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-mbkdb" Jul 02 19:45:28.023326 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:28.023295 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/985a55de-593c-450a-92c6-e6c159b6e0bd-podres\") pod \"perf-node-gather-daemonset-mbkdb\" (UID: \"985a55de-593c-450a-92c6-e6c159b6e0bd\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-mbkdb" Jul 02 19:45:28.023476 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:28.023335 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/985a55de-593c-450a-92c6-e6c159b6e0bd-lib-modules\") pod \"perf-node-gather-daemonset-mbkdb\" (UID: \"985a55de-593c-450a-92c6-e6c159b6e0bd\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-mbkdb" Jul 02 19:45:28.023476 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:28.023377 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/985a55de-593c-450a-92c6-e6c159b6e0bd-sys\") pod \"perf-node-gather-daemonset-mbkdb\" (UID: \"985a55de-593c-450a-92c6-e6c159b6e0bd\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-mbkdb" Jul 02 19:45:28.023476 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:28.023409 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p88cc\" (UniqueName: \"kubernetes.io/projected/985a55de-593c-450a-92c6-e6c159b6e0bd-kube-api-access-p88cc\") pod \"perf-node-gather-daemonset-mbkdb\" (UID: \"985a55de-593c-450a-92c6-e6c159b6e0bd\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-mbkdb" Jul 02 19:45:28.023476 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:28.023427 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/985a55de-593c-450a-92c6-e6c159b6e0bd-proc\") pod \"perf-node-gather-daemonset-mbkdb\" (UID: \"985a55de-593c-450a-92c6-e6c159b6e0bd\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-mbkdb" Jul 02 19:45:28.023630 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:28.023479 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/985a55de-593c-450a-92c6-e6c159b6e0bd-podres\") pod \"perf-node-gather-daemonset-mbkdb\" (UID: \"985a55de-593c-450a-92c6-e6c159b6e0bd\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-mbkdb" Jul 02 19:45:28.023630 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:28.023486 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/985a55de-593c-450a-92c6-e6c159b6e0bd-sys\") pod \"perf-node-gather-daemonset-mbkdb\" (UID: \"985a55de-593c-450a-92c6-e6c159b6e0bd\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-mbkdb" Jul 02 19:45:28.023630 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:28.023496 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/985a55de-593c-450a-92c6-e6c159b6e0bd-lib-modules\") pod \"perf-node-gather-daemonset-mbkdb\" (UID: \"985a55de-593c-450a-92c6-e6c159b6e0bd\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-mbkdb" Jul 02 19:45:28.023630 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:28.023487 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/985a55de-593c-450a-92c6-e6c159b6e0bd-proc\") pod \"perf-node-gather-daemonset-mbkdb\" (UID: \"985a55de-593c-450a-92c6-e6c159b6e0bd\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-mbkdb" Jul 02 19:45:28.030832 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:28.030809 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p88cc\" (UniqueName: \"kubernetes.io/projected/985a55de-593c-450a-92c6-e6c159b6e0bd-kube-api-access-p88cc\") pod \"perf-node-gather-daemonset-mbkdb\" (UID: \"985a55de-593c-450a-92c6-e6c159b6e0bd\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-mbkdb" Jul 02 19:45:28.181255 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:28.181162 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-srs74/perf-node-gather-daemonset-mbkdb" Jul 02 19:45:28.306626 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:28.306601 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-srs74/perf-node-gather-daemonset-mbkdb"] Jul 02 19:45:28.308978 ip-10-0-130-197 kubenswrapper[2559]: W0702 19:45:28.308952 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod985a55de_593c_450a_92c6_e6c159b6e0bd.slice/crio-54e829c043f642596b29038e0267e322864a06e97cf66cef754505ed88383641 WatchSource:0}: Error finding container 54e829c043f642596b29038e0267e322864a06e97cf66cef754505ed88383641: Status 404 returned error can't find the container with id 54e829c043f642596b29038e0267e322864a06e97cf66cef754505ed88383641 Jul 02 19:45:28.573288 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:28.573211 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-srs74/perf-node-gather-daemonset-mbkdb" event={"ID":"985a55de-593c-450a-92c6-e6c159b6e0bd","Type":"ContainerStarted","Data":"b3cd1a1b4ce20e4587e3f4c9016818d2e63b407c692753eb70c2742ed946cb42"} Jul 02 19:45:28.573288 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:28.573264 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-srs74/perf-node-gather-daemonset-mbkdb" event={"ID":"985a55de-593c-450a-92c6-e6c159b6e0bd","Type":"ContainerStarted","Data":"54e829c043f642596b29038e0267e322864a06e97cf66cef754505ed88383641"} Jul 02 19:45:28.573464 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:28.573348 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-srs74/perf-node-gather-daemonset-mbkdb" Jul 02 19:45:28.589919 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:28.589869 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-srs74/perf-node-gather-daemonset-mbkdb" podStartSLOduration=1.5898290670000002 podStartE2EDuration="1.589829067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:45:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:45:28.589231167 +0000 UTC m=+2656.251200318" watchObservedRunningTime="2026-07-02 19:45:28.589829067 +0000 UTC m=+2656.251798216" Jul 02 19:45:28.820954 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:28.820928 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-pgcqf_357ddcc5-5598-480d-98b3-9a9f5427ba9d/download-server/0.log" Jul 02 19:45:30.449602 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:30.449567 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p49mf_70a52588-f819-40d5-9001-04b49d26d494/dns/0.log" Jul 02 19:45:30.469500 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:30.469478 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p49mf_70a52588-f819-40d5-9001-04b49d26d494/kube-rbac-proxy/0.log" Jul 02 19:45:30.580018 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:30.579997 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wwdxl_ef58dd71-af47-44a1-8c47-d4e98378651d/dns-node-resolver/0.log" Jul 02 19:45:31.131324 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:31.131297 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dk7fw_4660d4a5-2ff9-49c1-948d-22fb52579391/node-ca/0.log" Jul 02 19:45:32.139040 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:32.139014 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mdjxd_728b9481-425c-42f3-9ec4-d82af992fd98/istio-proxy/0.log" Jul 02 19:45:32.238545 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:32.238518 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zbb24_a26358e2-c342-4623-b048-537ecf0b715a/discovery/0.log" Jul 02 19:45:33.155424 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:33.155393 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5gfh8_69fee9e5-3794-4491-ad5d-47031dedddd5/serve-healthcheck-canary/0.log" Jul 02 19:45:33.675295 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:33.675273 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9qj2l_cd2bdd50-294e-4ae4-81f7-4c3c556595dd/kube-rbac-proxy/0.log" Jul 02 19:45:33.701403 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:33.701386 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9qj2l_cd2bdd50-294e-4ae4-81f7-4c3c556595dd/exporter/0.log" Jul 02 19:45:33.723079 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:33.723061 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9qj2l_cd2bdd50-294e-4ae4-81f7-4c3c556595dd/extractor/0.log" Jul 02 19:45:34.587881 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:34.587840 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-srs74/perf-node-gather-daemonset-mbkdb" Jul 02 19:45:36.450271 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:36.450243 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29716995-xjrhw_4ef3d67e-93df-4285-8db7-30f0062f6f7b/cleanup/0.log" Jul 02 19:45:36.738101 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:36.738008 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d984f5d94-b7wvc_bcae5632-4ce0-4beb-86dc-9a7dbbb317c8/manager/0.log" Jul 02 19:45:36.759535 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:36.759515 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d984f5d94-b7wvc_bcae5632-4ce0-4beb-86dc-9a7dbbb317c8/copy-manifests/0.log" Jul 02 19:45:38.326860 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:38.326815 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mdjxd_728b9481-425c-42f3-9ec4-d82af992fd98/istio-proxy/0.log" Jul 02 19:45:38.335517 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:38.335494 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7965745c7f-9rcsz_4d02bde4-1da7-494a-a02a-925489357cc7/manager/0.log" Jul 02 19:45:38.365169 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:38.365139 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-l7npk_a69701c1-bc60-4adc-ad4d-7f4a6fe77d3a/openshift-lws-operator/0.log" Jul 02 19:45:38.433595 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:38.433567 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zbb24_a26358e2-c342-4623-b048-537ecf0b715a/discovery/0.log" Jul 02 19:45:39.674933 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:39.674906 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mdjxd_728b9481-425c-42f3-9ec4-d82af992fd98/istio-proxy/0.log" Jul 02 19:45:39.776838 ip-10-0-130-197 kubenswrapper[2559]: I0702 19:45:39.776805 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zbb24_a26358e2-c342-4623-b048-537ecf0b715a/discovery/0.log"