Jul 17 18:42:40.686080 ip-10-0-131-36 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 17 18:42:40.686088 ip-10-0-131-36 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 17 18:42:40.686095 ip-10-0-131-36 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 17 18:42:40.686362 ip-10-0-131-36 systemd[1]: Failed to start Kubernetes Kubelet. Jul 17 18:42:50.799923 ip-10-0-131-36 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 17 18:42:50.799938 ip-10-0-131-36 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 93f8f934a4f04cb1b9e1cadc61abb91e -- Jul 17 18:44:50.851596 ip-10-0-131-36 systemd[1]: Starting Kubernetes Kubelet... Jul 17 18:44:51.263772 ip-10-0-131-36 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 18:44:51.263772 ip-10-0-131-36 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 17 18:44:51.263772 ip-10-0-131-36 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 18:44:51.263772 ip-10-0-131-36 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 17 18:44:51.263772 ip-10-0-131-36 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 18:44:51.265421 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.265332 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 17 18:44:51.270859 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270843 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 18:44:51.270859 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270859 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 18:44:51.270927 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270863 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 18:44:51.270927 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270866 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 18:44:51.270927 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270870 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 18:44:51.270927 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270874 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 18:44:51.270927 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270877 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 18:44:51.270927 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270880 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 18:44:51.270927 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270883 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 18:44:51.270927 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270886 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 18:44:51.270927 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270889 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 18:44:51.270927 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270892 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 18:44:51.270927 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270895 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 18:44:51.270927 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270900 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 18:44:51.270927 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270904 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 18:44:51.270927 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270906 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 18:44:51.270927 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270909 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 18:44:51.270927 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270912 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 18:44:51.270927 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270915 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 18:44:51.270927 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270918 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 18:44:51.270927 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270921 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 18:44:51.271401 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270926 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 18:44:51.271401 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270929 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 18:44:51.271401 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270932 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 18:44:51.271401 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270935 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 18:44:51.271401 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270939 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 18:44:51.271401 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270942 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 18:44:51.271401 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270945 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 18:44:51.271401 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270948 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 18:44:51.271401 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270951 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 18:44:51.271401 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270954 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 18:44:51.271401 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270956 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 18:44:51.271401 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270960 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 18:44:51.271401 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270963 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 18:44:51.271401 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270966 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 18:44:51.271401 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270968 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 18:44:51.271401 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270971 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 18:44:51.271401 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270973 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 18:44:51.271401 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270976 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 18:44:51.271401 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270978 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 18:44:51.271961 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270981 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 18:44:51.271961 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270983 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 18:44:51.271961 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270986 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 18:44:51.271961 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270988 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 18:44:51.271961 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270991 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 17 18:44:51.271961 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270993 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 18:44:51.271961 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270996 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 18:44:51.271961 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.270999 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 18:44:51.271961 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271001 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 18:44:51.271961 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271004 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 18:44:51.271961 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271006 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 18:44:51.271961 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271008 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 18:44:51.271961 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271011 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 18:44:51.271961 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271014 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 18:44:51.271961 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271018 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 18:44:51.271961 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271020 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 18:44:51.271961 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271023 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 18:44:51.271961 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271025 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 18:44:51.271961 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271028 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 18:44:51.271961 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271030 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 18:44:51.272470 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271033 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 18:44:51.272470 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271035 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 18:44:51.272470 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271038 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 18:44:51.272470 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271042 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 18:44:51.272470 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271044 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 18:44:51.272470 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271046 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 18:44:51.272470 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271049 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 18:44:51.272470 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271052 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 18:44:51.272470 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271054 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 18:44:51.272470 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271057 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 18:44:51.272470 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271059 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 18:44:51.272470 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271061 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 18:44:51.272470 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271064 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 18:44:51.272470 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271066 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 18:44:51.272470 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271069 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 18:44:51.272470 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271071 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 18:44:51.272470 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271074 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 18:44:51.272470 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271078 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 18:44:51.272470 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271080 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 18:44:51.272931 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271083 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 18:44:51.272931 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271085 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 18:44:51.272931 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271088 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 18:44:51.272931 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271090 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 18:44:51.272931 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271093 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 18:44:51.272931 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271095 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 18:44:51.272931 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271098 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 18:44:51.272931 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271101 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 18:44:51.272931 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271104 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 18:44:51.272931 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271107 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 18:44:51.272931 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271109 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 18:44:51.272931 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271112 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 18:44:51.272931 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271114 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 18:44:51.272931 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271118 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 18:44:51.272931 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271120 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 18:44:51.272931 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271123 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 18:44:51.272931 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271126 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 18:44:51.272931 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271128 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 18:44:51.272931 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271131 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 18:44:51.272931 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271133 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 18:44:51.273433 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271862 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 18:44:51.273433 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271868 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 18:44:51.273433 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271871 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 18:44:51.273433 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271874 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 18:44:51.273433 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271877 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 18:44:51.273433 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271880 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 18:44:51.273433 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271883 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 18:44:51.273433 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271886 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 18:44:51.273433 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271888 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 18:44:51.273433 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271891 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 17 18:44:51.273433 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271894 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 18:44:51.273433 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271897 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 18:44:51.273433 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271900 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 18:44:51.273433 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271904 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 18:44:51.273433 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271908 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 18:44:51.273433 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271911 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 18:44:51.273433 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271913 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 18:44:51.273433 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271916 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 18:44:51.273433 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271919 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 18:44:51.274101 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271921 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 18:44:51.274101 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271924 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 18:44:51.274101 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271926 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 18:44:51.274101 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271929 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 18:44:51.274101 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271932 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 18:44:51.274101 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271934 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 18:44:51.274101 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271937 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 18:44:51.274101 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271940 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 18:44:51.274101 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271942 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 18:44:51.274101 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271945 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 18:44:51.274101 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271948 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 18:44:51.274101 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271950 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 18:44:51.274101 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271953 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 18:44:51.274101 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271955 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 18:44:51.274101 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271958 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 18:44:51.274101 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271961 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 18:44:51.274101 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271963 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 18:44:51.274101 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271967 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 18:44:51.274101 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271970 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 18:44:51.274836 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271974 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 18:44:51.274836 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271978 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 18:44:51.274836 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271982 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 18:44:51.274836 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271985 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 18:44:51.274836 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271988 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 18:44:51.274836 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271991 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 18:44:51.274836 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271995 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 18:44:51.274836 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.271997 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 18:44:51.274836 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272000 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 18:44:51.274836 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272003 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 18:44:51.274836 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272006 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 18:44:51.274836 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272009 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 18:44:51.274836 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272011 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 18:44:51.274836 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272014 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 18:44:51.274836 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272017 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 18:44:51.274836 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272020 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 18:44:51.274836 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272022 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 18:44:51.274836 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272025 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 18:44:51.274836 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272027 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 18:44:51.275390 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272030 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 18:44:51.275390 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272033 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 18:44:51.275390 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272035 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 18:44:51.275390 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272038 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 18:44:51.275390 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272041 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 18:44:51.275390 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272043 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 18:44:51.275390 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272046 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 18:44:51.275390 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272049 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 18:44:51.275390 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272052 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 18:44:51.275390 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272055 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 18:44:51.275390 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272057 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 18:44:51.275390 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272061 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 18:44:51.275390 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272065 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 18:44:51.275390 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272067 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 18:44:51.275390 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272070 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 18:44:51.275390 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272073 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 18:44:51.275390 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272076 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 18:44:51.275390 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272079 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 18:44:51.275390 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272082 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 18:44:51.275390 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272084 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 18:44:51.275972 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272087 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 18:44:51.275972 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272090 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 18:44:51.275972 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272092 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 18:44:51.275972 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272095 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 18:44:51.275972 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272097 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 18:44:51.275972 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272100 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 18:44:51.275972 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272104 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 18:44:51.275972 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272106 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 18:44:51.275972 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272110 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 18:44:51.275972 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272114 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 18:44:51.275972 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272116 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 18:44:51.275972 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272119 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 18:44:51.275972 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272122 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 18:44:51.275972 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272125 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 18:44:51.275972 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272128 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 18:44:51.275972 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272130 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 18:44:51.275972 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272132 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 18:44:51.275972 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272135 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 18:44:51.275972 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272137 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 18:44:51.275972 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272140 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 18:44:51.276628 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272142 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 18:44:51.276628 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272145 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 18:44:51.276628 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272539 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 18:44:51.276628 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272544 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 18:44:51.276628 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272547 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 18:44:51.276628 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272550 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 18:44:51.276628 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272553 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 18:44:51.276628 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272556 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 18:44:51.276628 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272558 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 18:44:51.276628 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272561 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 18:44:51.276628 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272565 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 18:44:51.276628 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272569 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 18:44:51.276628 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272573 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 18:44:51.276628 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272576 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 18:44:51.276628 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272579 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 18:44:51.276628 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272582 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 18:44:51.276628 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272584 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 18:44:51.276628 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272587 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 18:44:51.276628 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272590 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 18:44:51.277194 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272593 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 18:44:51.277194 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272595 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 18:44:51.277194 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272597 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 18:44:51.277194 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272600 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 18:44:51.277194 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272602 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 18:44:51.277194 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272605 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 18:44:51.277194 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272607 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 18:44:51.277194 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272609 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 18:44:51.277194 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272612 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 18:44:51.277194 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272614 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 18:44:51.277194 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272617 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 18:44:51.277194 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272619 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 18:44:51.277194 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272622 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 18:44:51.277194 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272624 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 18:44:51.277194 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272627 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 18:44:51.277194 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272629 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 18:44:51.277194 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272632 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 18:44:51.277194 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272635 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 18:44:51.277194 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272637 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 18:44:51.277194 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272641 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 18:44:51.277693 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272645 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 18:44:51.277693 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272649 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 18:44:51.277693 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272651 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 18:44:51.277693 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272654 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 18:44:51.277693 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272657 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 18:44:51.277693 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272660 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 18:44:51.277693 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272664 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 18:44:51.277693 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272666 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 18:44:51.277693 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272669 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 18:44:51.277693 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272671 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 18:44:51.277693 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272674 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 18:44:51.277693 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272677 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 18:44:51.277693 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272679 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 18:44:51.277693 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272681 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 18:44:51.277693 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272684 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 18:44:51.277693 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272686 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 18:44:51.277693 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272689 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 18:44:51.277693 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272691 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 18:44:51.277693 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272693 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 18:44:51.278255 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272696 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 18:44:51.278255 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272698 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 17 18:44:51.278255 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272700 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 18:44:51.278255 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272703 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 18:44:51.278255 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272705 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 18:44:51.278255 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272708 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 18:44:51.278255 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272711 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 18:44:51.278255 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272713 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 18:44:51.278255 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272715 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 18:44:51.278255 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272718 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 18:44:51.278255 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272721 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 18:44:51.278255 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272723 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 18:44:51.278255 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272725 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 18:44:51.278255 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272728 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 18:44:51.278255 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272730 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 18:44:51.278255 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272733 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 18:44:51.278255 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272735 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 18:44:51.278255 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272737 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 18:44:51.278255 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272740 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 18:44:51.278255 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272742 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 18:44:51.278763 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272746 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 18:44:51.278763 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272748 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 18:44:51.278763 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272750 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 18:44:51.278763 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272754 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 18:44:51.278763 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272756 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 18:44:51.278763 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272759 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 18:44:51.278763 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272761 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 18:44:51.278763 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272763 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 18:44:51.278763 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272766 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 18:44:51.278763 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272769 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 18:44:51.278763 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272772 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 18:44:51.278763 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272774 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 18:44:51.278763 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272776 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 18:44:51.278763 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272779 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 18:44:51.278763 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272781 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 18:44:51.278763 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272784 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 18:44:51.278763 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272786 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 18:44:51.278763 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272789 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 18:44:51.278763 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272791 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 18:44:51.279267 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272793 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 18:44:51.279267 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272796 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 18:44:51.279267 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272801 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 18:44:51.279267 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.272803 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 18:44:51.279267 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.272898 2559 flags.go:64] FLAG: --address="0.0.0.0" Jul 17 18:44:51.279267 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.272912 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 17 18:44:51.279267 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.272920 2559 flags.go:64] FLAG: --anonymous-auth="true" Jul 17 18:44:51.279267 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.272924 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 17 18:44:51.279267 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.272928 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 17 18:44:51.279267 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.272931 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 17 18:44:51.279267 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.272940 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 17 18:44:51.279267 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.272945 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 17 18:44:51.279267 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.272948 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 17 18:44:51.279267 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.272951 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 17 18:44:51.279267 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.272955 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 17 18:44:51.279267 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.272958 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 17 18:44:51.279267 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.272961 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 17 18:44:51.279267 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.272964 2559 flags.go:64] FLAG: --cgroup-root="" Jul 17 18:44:51.279267 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.272967 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 17 18:44:51.279267 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.272970 2559 flags.go:64] FLAG: --client-ca-file="" Jul 17 18:44:51.279267 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.272973 2559 flags.go:64] FLAG: --cloud-provider="external" Jul 17 18:44:51.279267 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.272976 2559 flags.go:64] FLAG: --cluster-dns="[]" Jul 17 18:44:51.279267 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.272979 2559 flags.go:64] FLAG: --cluster-domain="" Jul 17 18:44:51.279834 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.272982 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 17 18:44:51.279834 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.272985 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 17 18:44:51.279834 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.272988 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 17 18:44:51.279834 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.272991 2559 flags.go:64] FLAG: --container-log-max-files="5" Jul 17 18:44:51.279834 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.272995 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 17 18:44:51.279834 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.272998 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 17 18:44:51.279834 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273001 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 17 18:44:51.279834 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273004 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 17 18:44:51.279834 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273007 2559 flags.go:64] FLAG: --contention-profiling="false" Jul 17 18:44:51.279834 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273010 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 17 18:44:51.279834 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273013 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 17 18:44:51.279834 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273017 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 17 18:44:51.279834 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273020 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 17 18:44:51.279834 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273024 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 17 18:44:51.279834 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273029 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 17 18:44:51.279834 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273031 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 17 18:44:51.279834 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273034 2559 flags.go:64] FLAG: --enable-load-reader="false" Jul 17 18:44:51.279834 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273037 2559 flags.go:64] FLAG: --enable-server="true" Jul 17 18:44:51.279834 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273040 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 17 18:44:51.279834 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273045 2559 flags.go:64] FLAG: --event-burst="100" Jul 17 18:44:51.279834 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273048 2559 flags.go:64] FLAG: --event-qps="50" Jul 17 18:44:51.279834 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273051 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 17 18:44:51.279834 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273054 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 17 18:44:51.279834 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273056 2559 flags.go:64] FLAG: --eviction-hard="" Jul 17 18:44:51.280433 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273061 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 17 18:44:51.280433 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273064 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 17 18:44:51.280433 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273067 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 17 18:44:51.280433 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273070 2559 flags.go:64] FLAG: --eviction-soft="" Jul 17 18:44:51.280433 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273073 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 17 18:44:51.280433 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273076 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 17 18:44:51.280433 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273079 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 17 18:44:51.280433 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273081 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jul 17 18:44:51.280433 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273084 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 17 18:44:51.280433 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273087 2559 flags.go:64] FLAG: --fail-swap-on="true" Jul 17 18:44:51.280433 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273090 2559 flags.go:64] FLAG: --feature-gates="" Jul 17 18:44:51.280433 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273094 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jul 17 18:44:51.280433 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273096 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 17 18:44:51.280433 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273099 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 17 18:44:51.280433 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273102 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 17 18:44:51.280433 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273105 2559 flags.go:64] FLAG: --healthz-port="10248" Jul 17 18:44:51.280433 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273108 2559 flags.go:64] FLAG: --help="false" Jul 17 18:44:51.280433 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273110 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-131-36.ec2.internal" Jul 17 18:44:51.280433 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273114 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 17 18:44:51.280433 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273118 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jul 17 18:44:51.280433 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273121 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 17 18:44:51.280433 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273124 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 17 18:44:51.280433 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273129 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 17 18:44:51.281033 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273132 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 17 18:44:51.281033 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273134 2559 flags.go:64] FLAG: --image-service-endpoint="" Jul 17 18:44:51.281033 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273137 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 17 18:44:51.281033 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273140 2559 flags.go:64] FLAG: --kube-api-burst="100" Jul 17 18:44:51.281033 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273143 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 17 18:44:51.281033 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273146 2559 flags.go:64] FLAG: --kube-api-qps="50" Jul 17 18:44:51.281033 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273149 2559 flags.go:64] FLAG: --kube-reserved="" Jul 17 18:44:51.281033 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273152 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 17 18:44:51.281033 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273154 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 17 18:44:51.281033 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273157 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jul 17 18:44:51.281033 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273161 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 17 18:44:51.281033 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273163 2559 flags.go:64] FLAG: --lock-file="" Jul 17 18:44:51.281033 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273166 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 17 18:44:51.281033 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273169 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 17 18:44:51.281033 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273172 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 17 18:44:51.281033 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273178 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jul 17 18:44:51.281033 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273181 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 17 18:44:51.281033 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273184 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jul 17 18:44:51.281033 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273187 2559 flags.go:64] FLAG: --logging-format="text" Jul 17 18:44:51.281033 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273190 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 17 18:44:51.281033 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273193 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 17 18:44:51.281033 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273196 2559 flags.go:64] FLAG: --manifest-url="" Jul 17 18:44:51.281033 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273198 2559 flags.go:64] FLAG: --manifest-url-header="" Jul 17 18:44:51.281033 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273202 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 17 18:44:51.281033 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273205 2559 flags.go:64] FLAG: --max-open-files="1000000" Jul 17 18:44:51.281719 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273209 2559 flags.go:64] FLAG: --max-pods="110" Jul 17 18:44:51.281719 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273212 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 17 18:44:51.281719 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273215 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 17 18:44:51.281719 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273219 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jul 17 18:44:51.281719 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273222 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 17 18:44:51.281719 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273225 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 17 18:44:51.281719 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273229 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 17 18:44:51.281719 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273232 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 17 18:44:51.281719 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273239 2559 flags.go:64] FLAG: --node-status-max-images="50" Jul 17 18:44:51.281719 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273242 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 17 18:44:51.281719 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273245 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jul 17 18:44:51.281719 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273248 2559 flags.go:64] FLAG: --pod-cidr="" Jul 17 18:44:51.281719 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273251 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 17 18:44:51.281719 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273256 2559 flags.go:64] FLAG: --pod-manifest-path="" Jul 17 18:44:51.281719 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273259 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jul 17 18:44:51.281719 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273262 2559 flags.go:64] FLAG: --pods-per-core="0" Jul 17 18:44:51.281719 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273265 2559 flags.go:64] FLAG: --port="10250" Jul 17 18:44:51.281719 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273268 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 17 18:44:51.281719 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273271 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d4f6f44ccd20c899" Jul 17 18:44:51.281719 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273274 2559 flags.go:64] FLAG: --qos-reserved="" Jul 17 18:44:51.281719 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273277 2559 flags.go:64] FLAG: --read-only-port="10255" Jul 17 18:44:51.281719 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273280 2559 flags.go:64] FLAG: --register-node="true" Jul 17 18:44:51.281719 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273283 2559 flags.go:64] FLAG: --register-with-taints="" Jul 17 18:44:51.281719 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273286 2559 flags.go:64] FLAG: --registry-burst="10" Jul 17 18:44:51.282331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273290 2559 flags.go:64] FLAG: --registry-qps="5" Jul 17 18:44:51.282331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273293 2559 flags.go:64] FLAG: --reserved-cpus="" Jul 17 18:44:51.282331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273295 2559 flags.go:64] FLAG: --reserved-memory="" Jul 17 18:44:51.282331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273299 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 17 18:44:51.282331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273302 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 17 18:44:51.282331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273305 2559 flags.go:64] FLAG: --rotate-certificates="false" Jul 17 18:44:51.282331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273321 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 17 18:44:51.282331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273324 2559 flags.go:64] FLAG: --runonce="false" Jul 17 18:44:51.282331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273327 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 17 18:44:51.282331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273330 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 17 18:44:51.282331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273333 2559 flags.go:64] FLAG: --seccomp-default="false" Jul 17 18:44:51.282331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273337 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 17 18:44:51.282331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273340 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 17 18:44:51.282331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273343 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 17 18:44:51.282331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273346 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 17 18:44:51.282331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273350 2559 flags.go:64] FLAG: --storage-driver-password="root" Jul 17 18:44:51.282331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273353 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jul 17 18:44:51.282331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273356 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jul 17 18:44:51.282331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273359 2559 flags.go:64] FLAG: --storage-driver-user="root" Jul 17 18:44:51.282331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273362 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 17 18:44:51.282331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273365 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 17 18:44:51.282331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273368 2559 flags.go:64] FLAG: --system-cgroups="" Jul 17 18:44:51.282331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273370 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 17 18:44:51.282331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273376 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 17 18:44:51.282331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273379 2559 flags.go:64] FLAG: --tls-cert-file="" Jul 17 18:44:51.282976 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273381 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 17 18:44:51.282976 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273384 2559 flags.go:64] FLAG: --tls-min-version="" Jul 17 18:44:51.282976 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273388 2559 flags.go:64] FLAG: --tls-private-key-file="" Jul 17 18:44:51.282976 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273390 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jul 17 18:44:51.282976 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273393 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 17 18:44:51.282976 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273396 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jul 17 18:44:51.282976 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273399 2559 flags.go:64] FLAG: --v="2" Jul 17 18:44:51.282976 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273402 2559 flags.go:64] FLAG: --version="false" Jul 17 18:44:51.282976 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273406 2559 flags.go:64] FLAG: --vmodule="" Jul 17 18:44:51.282976 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273409 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 17 18:44:51.282976 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.273412 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 17 18:44:51.282976 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274238 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 18:44:51.282976 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274259 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 18:44:51.282976 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274266 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 18:44:51.282976 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274272 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 18:44:51.282976 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274277 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 18:44:51.282976 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274281 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 18:44:51.282976 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274286 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 18:44:51.282976 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274291 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 18:44:51.282976 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274303 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 18:44:51.282976 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274326 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 18:44:51.282976 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274331 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 18:44:51.283540 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274336 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 18:44:51.283540 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274341 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 18:44:51.283540 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274345 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 18:44:51.283540 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274350 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 18:44:51.283540 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274354 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 18:44:51.283540 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274359 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 18:44:51.283540 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274363 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 18:44:51.283540 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274366 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 18:44:51.283540 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274370 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 18:44:51.283540 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274374 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 18:44:51.283540 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274383 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 18:44:51.283540 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274387 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 18:44:51.283540 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274391 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 18:44:51.283540 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274395 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 18:44:51.283540 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274399 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 18:44:51.283540 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274403 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 18:44:51.283540 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274407 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 18:44:51.283540 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274411 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 18:44:51.283540 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274415 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 18:44:51.283540 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274419 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 18:44:51.284025 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274424 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 18:44:51.284025 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274428 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 18:44:51.284025 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274440 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 18:44:51.284025 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274444 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 18:44:51.284025 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274448 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 18:44:51.284025 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274453 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 18:44:51.284025 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274457 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 18:44:51.284025 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274461 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 18:44:51.284025 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274465 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 18:44:51.284025 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274469 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 18:44:51.284025 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274474 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 18:44:51.284025 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274478 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 18:44:51.284025 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274482 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 18:44:51.284025 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274529 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 18:44:51.284025 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274536 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 18:44:51.284025 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274542 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 18:44:51.284025 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274548 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 18:44:51.284025 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274552 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 18:44:51.284025 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274558 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 18:44:51.284025 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274563 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 18:44:51.284531 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274569 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 18:44:51.284531 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274574 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 18:44:51.284531 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274578 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 18:44:51.284531 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274582 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 18:44:51.284531 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274586 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 18:44:51.284531 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274596 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 18:44:51.284531 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274600 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 18:44:51.284531 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274604 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 18:44:51.284531 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274646 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 18:44:51.284531 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274776 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 18:44:51.284531 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274783 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 18:44:51.284531 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274787 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 18:44:51.284531 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274792 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 18:44:51.284531 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274797 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 18:44:51.284531 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274802 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 18:44:51.284531 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274808 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 18:44:51.284531 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274812 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 18:44:51.284531 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274816 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 18:44:51.284531 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274822 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 18:44:51.285006 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274826 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 18:44:51.285006 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274830 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 18:44:51.285006 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274834 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 18:44:51.285006 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274838 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 18:44:51.285006 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274842 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 18:44:51.285006 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274846 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 18:44:51.285006 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274850 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 18:44:51.285006 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274856 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 18:44:51.285006 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274863 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 18:44:51.285006 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274868 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 18:44:51.285006 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274873 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 18:44:51.285006 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274878 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 18:44:51.285006 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274883 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 18:44:51.285006 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274887 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 18:44:51.285006 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274891 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 18:44:51.285006 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274895 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 18:44:51.285006 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274900 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 18:44:51.285006 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274904 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 18:44:51.285006 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274909 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 18:44:51.285557 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274916 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 18:44:51.285557 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274921 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 18:44:51.285557 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274926 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 18:44:51.285557 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274931 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 18:44:51.285557 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274935 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 18:44:51.285557 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274940 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 18:44:51.285557 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274944 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 18:44:51.285557 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274949 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 18:44:51.285557 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274953 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 18:44:51.285557 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.274957 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 17 18:44:51.285557 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.275641 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 18:44:51.285557 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.282583 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 17 18:44:51.285557 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.282599 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 17 18:44:51.285557 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.282617 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 17 18:44:51.285914 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.282626 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 17 18:44:51.285914 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282717 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 18:44:51.285914 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282722 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 18:44:51.285914 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282725 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 18:44:51.285914 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282728 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 18:44:51.285914 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282731 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 18:44:51.285914 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282734 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 18:44:51.285914 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282737 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 18:44:51.285914 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282740 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 18:44:51.285914 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282742 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 18:44:51.285914 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282745 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 18:44:51.285914 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282749 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 18:44:51.285914 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282752 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 18:44:51.285914 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282755 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 18:44:51.285914 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282757 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 18:44:51.285914 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282760 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 18:44:51.285914 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282762 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 18:44:51.285914 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282765 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 18:44:51.285914 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282768 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 18:44:51.286387 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282770 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 18:44:51.286387 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282773 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 18:44:51.286387 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282776 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 18:44:51.286387 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282779 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 18:44:51.286387 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282781 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 18:44:51.286387 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282784 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 18:44:51.286387 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282787 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 18:44:51.286387 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282790 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 18:44:51.286387 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282792 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 18:44:51.286387 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282795 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 18:44:51.286387 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282798 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 18:44:51.286387 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282801 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 18:44:51.286387 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282804 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 18:44:51.286387 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282806 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 18:44:51.286387 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282809 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 18:44:51.286387 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282813 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 18:44:51.286387 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282816 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 18:44:51.286387 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282819 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 18:44:51.286387 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282822 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 18:44:51.286832 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282824 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 18:44:51.286832 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282827 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 18:44:51.286832 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282830 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 18:44:51.286832 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282832 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 18:44:51.286832 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282835 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 18:44:51.286832 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282837 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 18:44:51.286832 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282839 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 18:44:51.286832 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282842 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 18:44:51.286832 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282844 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 18:44:51.286832 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282847 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 18:44:51.286832 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282850 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 18:44:51.286832 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282852 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 18:44:51.286832 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282854 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 18:44:51.286832 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282857 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 18:44:51.286832 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282860 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 18:44:51.286832 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282862 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 18:44:51.286832 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282865 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 18:44:51.286832 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282868 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 18:44:51.286832 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282871 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 18:44:51.286832 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282874 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 18:44:51.287336 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282876 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 18:44:51.287336 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282879 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 18:44:51.287336 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282882 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 18:44:51.287336 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282884 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 18:44:51.287336 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282888 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 18:44:51.287336 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282890 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 18:44:51.287336 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282893 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 18:44:51.287336 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282895 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 18:44:51.287336 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282898 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 18:44:51.287336 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282900 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 18:44:51.287336 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282903 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 18:44:51.287336 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282906 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 18:44:51.287336 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282909 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 18:44:51.287336 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282913 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 18:44:51.287336 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282916 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 18:44:51.287336 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282919 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 18:44:51.287336 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282922 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 18:44:51.287336 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282924 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 18:44:51.287336 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282927 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 18:44:51.287804 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282930 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 18:44:51.287804 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282932 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 18:44:51.287804 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282935 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 18:44:51.287804 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282937 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 18:44:51.287804 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282940 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 18:44:51.287804 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282942 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 18:44:51.287804 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282945 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 18:44:51.287804 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282947 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 18:44:51.287804 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282950 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 18:44:51.287804 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282953 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 18:44:51.287804 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282955 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 18:44:51.287804 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282958 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 17 18:44:51.287804 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282961 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 18:44:51.287804 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282964 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 18:44:51.287804 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282966 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 18:44:51.287804 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282969 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 18:44:51.287804 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282971 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 18:44:51.287804 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282974 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 18:44:51.287804 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282976 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 18:44:51.287804 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282979 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 18:44:51.288277 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282982 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 18:44:51.288277 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282984 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 18:44:51.288277 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.282987 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 18:44:51.288277 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.282992 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 18:44:51.288277 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283109 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 18:44:51.288277 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283113 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 18:44:51.288277 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283116 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 18:44:51.288277 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283119 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 17 18:44:51.288277 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283122 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 18:44:51.288277 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283125 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 18:44:51.288277 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283128 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 18:44:51.288277 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283131 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 18:44:51.288277 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283133 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 18:44:51.288277 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283136 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 18:44:51.288277 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283139 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 18:44:51.288680 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283141 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 18:44:51.288680 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283143 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 18:44:51.288680 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283146 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 18:44:51.288680 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283148 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 18:44:51.288680 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283151 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 18:44:51.288680 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283153 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 18:44:51.288680 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283156 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 18:44:51.288680 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283158 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 18:44:51.288680 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283161 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 18:44:51.288680 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283164 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 18:44:51.288680 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283166 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 18:44:51.288680 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283169 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 18:44:51.288680 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283171 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 18:44:51.288680 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283174 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 18:44:51.288680 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283176 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 18:44:51.288680 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283179 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 18:44:51.288680 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283182 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 18:44:51.288680 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283184 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 18:44:51.288680 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283187 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 18:44:51.289141 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283189 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 18:44:51.289141 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283192 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 18:44:51.289141 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283194 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 18:44:51.289141 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283197 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 18:44:51.289141 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283200 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 18:44:51.289141 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283202 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 18:44:51.289141 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283205 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 18:44:51.289141 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283207 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 18:44:51.289141 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283210 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 18:44:51.289141 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283212 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 18:44:51.289141 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283214 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 18:44:51.289141 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283217 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 18:44:51.289141 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283219 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 18:44:51.289141 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283221 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 18:44:51.289141 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283224 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 18:44:51.289141 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283226 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 18:44:51.289141 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283229 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 18:44:51.289141 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283232 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 18:44:51.289141 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283234 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 18:44:51.289141 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283236 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 18:44:51.289665 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283239 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 18:44:51.289665 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283241 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 18:44:51.289665 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283243 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 18:44:51.289665 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283246 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 18:44:51.289665 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283249 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 18:44:51.289665 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283252 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 18:44:51.289665 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283254 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 18:44:51.289665 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283258 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 18:44:51.289665 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283261 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 18:44:51.289665 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283264 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 18:44:51.289665 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283267 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 18:44:51.289665 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283270 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 18:44:51.289665 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283273 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 18:44:51.289665 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283276 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 18:44:51.289665 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283278 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 18:44:51.289665 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283282 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 18:44:51.289665 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283285 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 18:44:51.289665 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283288 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 18:44:51.289665 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283290 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 18:44:51.290148 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283293 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 18:44:51.290148 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283296 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 18:44:51.290148 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283298 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 18:44:51.290148 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283301 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 18:44:51.290148 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283304 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 18:44:51.290148 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283324 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 18:44:51.290148 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283329 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 18:44:51.290148 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283332 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 18:44:51.290148 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283335 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 18:44:51.290148 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283338 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 18:44:51.290148 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283340 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 18:44:51.290148 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283343 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 18:44:51.290148 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283346 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 18:44:51.290148 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283348 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 18:44:51.290148 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283351 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 18:44:51.290148 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283353 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 18:44:51.290148 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283356 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 18:44:51.290148 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283359 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 18:44:51.290148 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283362 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 18:44:51.290148 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283364 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 18:44:51.290886 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283366 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 18:44:51.290886 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283369 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 18:44:51.290886 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283371 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 18:44:51.290886 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283374 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 18:44:51.290886 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283376 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 18:44:51.290886 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283378 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 18:44:51.290886 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283381 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 18:44:51.290886 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283383 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 18:44:51.290886 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283386 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 18:44:51.290886 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:51.283389 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 18:44:51.290886 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.283395 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 18:44:51.290886 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.283512 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jul 17 18:44:51.290886 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.285700 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 17 18:44:51.290886 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.287140 2559 server.go:1019] "Starting client certificate rotation" Jul 17 18:44:51.291354 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.287241 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 18:44:51.291354 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.287271 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 18:44:51.291354 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.289405 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 18:44:51.291354 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.290565 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 18:44:51.305770 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.305751 2559 log.go:25] "Validated CRI v1 runtime API" Jul 17 18:44:51.308499 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.308483 2559 log.go:25] "Validated CRI v1 image API" Jul 17 18:44:51.309245 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.309228 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 17 18:44:51.311866 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.311845 2559 fs.go:135] Filesystem UUIDs: map[3d8b86f5-f001-4456-8316-237496d870b2:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d99179dc-a71c-4f92-b20e-f496830fcfc0:/dev/nvme0n1p3] Jul 17 18:44:51.311916 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.311867 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 17 18:44:51.317014 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.316899 2559 manager.go:216] Machine: {Timestamp:2026-07-17 18:44:51.315597083 +0000 UTC m=+0.347209947 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2953603 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26916cbafe2e0fbb11bcbe450efcc6 SystemUUID:ec26916c-bafe-2e0f-bb11-bcbe450efcc6 BootID:93f8f934-a4f0-4cb1-b9e1-cadc61abb91e Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2b:e5:7c:c1:07 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2b:e5:7c:c1:07 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:e7:bd:c4:97:1c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 17 18:44:51.317014 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.317012 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 17 18:44:51.317145 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.317133 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 17 18:44:51.320483 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.320440 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 17 18:44:51.320653 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.320487 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-36.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 17 18:44:51.321208 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.321196 2559 topology_manager.go:138] "Creating topology manager with none policy" Jul 17 18:44:51.321208 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.321210 2559 container_manager_linux.go:309] "Creating device plugin manager" Jul 17 18:44:51.321285 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.321218 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 18:44:51.322947 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.322935 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 18:44:51.324486 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.324476 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 17 18:44:51.324898 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.324879 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 18:44:51.327403 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.327391 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 17 18:44:51.327520 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.327510 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 17 18:44:51.327560 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.327540 2559 kubelet.go:486] "Attempting to sync node with API server" Jul 17 18:44:51.327560 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.327550 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 17 18:44:51.327633 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.327564 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 17 18:44:51.327633 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.327574 2559 kubelet.go:398] "Adding apiserver pod source" Jul 17 18:44:51.327633 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.327583 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 17 18:44:51.327948 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.327936 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 18:44:51.328010 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.327957 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 18:44:51.331090 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.331075 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 17 18:44:51.332452 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.332438 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 17 18:44:51.332512 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.332501 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 17 18:44:51.333098 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.333083 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 17 18:44:51.333141 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.333113 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 17 18:44:51.333141 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.333128 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 17 18:44:51.333195 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.333167 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 17 18:44:51.333195 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.333186 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 17 18:44:51.333250 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.333197 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 17 18:44:51.333305 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.333297 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 17 18:44:51.333352 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.333323 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 17 18:44:51.333352 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.333332 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 17 18:44:51.333352 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.333338 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 17 18:44:51.333352 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.333350 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 17 18:44:51.333461 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.333358 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 17 18:44:51.334238 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.334229 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 17 18:44:51.334270 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.334239 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 17 18:44:51.338014 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.337998 2559 server.go:1268] "Started kubelet" Jul 17 18:44:51.338227 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.338150 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 17 18:44:51.338463 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.338242 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 17 18:44:51.338706 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.338689 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 17 18:44:51.339369 ip-10-0-131-36 systemd[1]: Started Kubernetes Kubelet. Jul 17 18:44:51.339537 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:51.339513 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-36.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 17 18:44:51.339537 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:51.339528 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 17 18:44:51.339688 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.339667 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-36.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 17 18:44:51.340099 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.340045 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 17 18:44:51.340661 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.340648 2559 server.go:310] "Adding debug handlers to kubelet server" Jul 17 18:44:51.344956 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:51.344933 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 17 18:44:51.346770 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.346751 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 17 18:44:51.346770 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.346752 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 17 18:44:51.346911 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:51.346859 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-36.ec2.internal\" not found" Jul 17 18:44:51.347216 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:51.346098 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-36.ec2.internal.18c32807ccfe6938 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-36.ec2.internal,UID:ip-10-0-131-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-36.ec2.internal,},FirstTimestamp:2026-07-17 18:44:51.33795564 +0000 UTC m=+0.369568503,LastTimestamp:2026-07-17 18:44:51.33795564 +0000 UTC m=+0.369568503,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-36.ec2.internal,}" Jul 17 18:44:51.347449 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.347432 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 17 18:44:51.347549 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.347432 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 17 18:44:51.347638 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.347620 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 17 18:44:51.347729 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.347720 2559 factory.go:55] Registering systemd factory Jul 17 18:44:51.347780 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.347732 2559 factory.go:223] Registration of the systemd container factory successfully Jul 17 18:44:51.347829 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.347804 2559 reconstruct.go:97] "Volume reconstruction finished" Jul 17 18:44:51.347829 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.347826 2559 reconciler.go:29] "Reconciler: start to sync state" Jul 17 18:44:51.348088 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.347965 2559 factory.go:153] Registering CRI-O factory Jul 17 18:44:51.348088 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.347980 2559 factory.go:223] Registration of the crio container factory successfully Jul 17 18:44:51.348088 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.348022 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 17 18:44:51.348088 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.348041 2559 factory.go:103] Registering Raw factory Jul 17 18:44:51.348088 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.348056 2559 manager.go:1196] Started watching for new ooms in manager Jul 17 18:44:51.348523 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.348497 2559 manager.go:349] Starting recovery of all containers Jul 17 18:44:51.354617 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:51.354489 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-36.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 17 18:44:51.354722 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:51.354704 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 17 18:44:51.360172 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.360150 2559 manager.go:354] Recovery completed Jul 17 18:44:51.364131 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.364119 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 18:44:51.366127 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.366104 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasSufficientMemory" Jul 17 18:44:51.366191 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.366141 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 18:44:51.366191 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.366151 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasSufficientPID" Jul 17 18:44:51.366670 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.366656 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 17 18:44:51.366670 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.366667 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 17 18:44:51.366794 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.366683 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 17 18:44:51.366794 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.366711 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 18:44:51.367511 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.367493 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasSufficientMemory" Jul 17 18:44:51.367579 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.367520 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 18:44:51.367579 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.367530 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasSufficientPID" Jul 17 18:44:51.367975 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.367964 2559 policy_none.go:49] "None policy: Start" Jul 17 18:44:51.368005 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.367980 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 17 18:44:51.368005 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.367990 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 17 18:44:51.369452 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.369438 2559 policy_none.go:47] "Start" Jul 17 18:44:51.371203 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:51.371136 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-36.ec2.internal.18c32807ceac47f1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-36.ec2.internal,UID:ip-10-0-131-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-36.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-36.ec2.internal,},FirstTimestamp:2026-07-17 18:44:51.366127601 +0000 UTC m=+0.397740466,LastTimestamp:2026-07-17 18:44:51.366127601 +0000 UTC m=+0.397740466,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-36.ec2.internal,}" Jul 17 18:44:51.376702 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.376686 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5vh9f" Jul 17 18:44:51.383115 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:51.383056 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-36.ec2.internal.18c32807ceac8f80 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-36.ec2.internal,UID:ip-10-0-131-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-36.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-36.ec2.internal,},FirstTimestamp:2026-07-17 18:44:51.36614592 +0000 UTC m=+0.397758784,LastTimestamp:2026-07-17 18:44:51.36614592 +0000 UTC m=+0.397758784,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-36.ec2.internal,}" Jul 17 18:44:51.385781 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.385767 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5vh9f" Jul 17 18:44:51.417988 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.417965 2559 manager.go:337] "Starting Device Plugin manager" Jul 17 18:44:51.418137 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:51.418015 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 17 18:44:51.418137 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.418026 2559 server.go:87] "Starting device plugin registration server" Jul 17 18:44:51.418353 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.418338 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 17 18:44:51.418409 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.418357 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 17 18:44:51.418453 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.418433 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 17 18:44:51.418514 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.418502 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 17 18:44:51.418555 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.418516 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 17 18:44:51.419089 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:51.419068 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 17 18:44:51.419181 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:51.419116 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-36.ec2.internal\" not found" Jul 17 18:44:51.479813 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.479772 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 17 18:44:51.481161 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.481142 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 17 18:44:51.481252 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.481180 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 17 18:44:51.481252 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.481203 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jul 17 18:44:51.481252 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:51.481237 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 17 18:44:51.483963 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.483939 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 18:44:51.519036 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.518990 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 18:44:51.519985 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.519971 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasSufficientMemory" Jul 17 18:44:51.520050 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.520001 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 18:44:51.520050 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.520014 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasSufficientPID" Jul 17 18:44:51.520050 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.520036 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-36.ec2.internal" Jul 17 18:44:51.529917 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.529904 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-36.ec2.internal" Jul 17 18:44:51.529978 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:51.529925 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-36.ec2.internal\": node \"ip-10-0-131-36.ec2.internal\" not found" Jul 17 18:44:51.560107 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:51.560088 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-36.ec2.internal\" not found" Jul 17 18:44:51.581941 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.581923 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-36.ec2.internal"] Jul 17 18:44:51.582018 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.581983 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 18:44:51.583422 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.583401 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasSufficientMemory" Jul 17 18:44:51.583504 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.583433 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 18:44:51.583504 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.583443 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasSufficientPID" Jul 17 18:44:51.584760 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.584748 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 18:44:51.584898 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.584884 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal" Jul 17 18:44:51.584960 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.584914 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 18:44:51.585440 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.585425 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasSufficientMemory" Jul 17 18:44:51.585497 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.585450 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 18:44:51.585497 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.585461 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasSufficientPID" Jul 17 18:44:51.585497 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.585486 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasSufficientMemory" Jul 17 18:44:51.585594 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.585504 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 18:44:51.585594 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.585513 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasSufficientPID" Jul 17 18:44:51.586889 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.586876 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-36.ec2.internal" Jul 17 18:44:51.586946 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.586900 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 18:44:51.587548 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.587530 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasSufficientMemory" Jul 17 18:44:51.587634 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.587558 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 18:44:51.587634 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.587569 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasSufficientPID" Jul 17 18:44:51.613940 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:51.613907 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-36.ec2.internal\" not found" node="ip-10-0-131-36.ec2.internal" Jul 17 18:44:51.618463 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:51.618448 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-36.ec2.internal\" not found" node="ip-10-0-131-36.ec2.internal" Jul 17 18:44:51.650048 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.650028 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0b5419f7cb1e64a2ab16d7fe91c43a1c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal\" (UID: \"0b5419f7cb1e64a2ab16d7fe91c43a1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal" Jul 17 18:44:51.650147 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.650060 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b5419f7cb1e64a2ab16d7fe91c43a1c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal\" (UID: \"0b5419f7cb1e64a2ab16d7fe91c43a1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal" Jul 17 18:44:51.650147 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.650086 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/17cbee2f05534142fef47f5b2283ef20-config\") pod \"kube-apiserver-proxy-ip-10-0-131-36.ec2.internal\" (UID: \"17cbee2f05534142fef47f5b2283ef20\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-36.ec2.internal" Jul 17 18:44:51.660441 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:51.660423 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-36.ec2.internal\" not found" Jul 17 18:44:51.750388 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.750367 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0b5419f7cb1e64a2ab16d7fe91c43a1c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal\" (UID: \"0b5419f7cb1e64a2ab16d7fe91c43a1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal" Jul 17 18:44:51.750449 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.750400 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b5419f7cb1e64a2ab16d7fe91c43a1c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal\" (UID: \"0b5419f7cb1e64a2ab16d7fe91c43a1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal" Jul 17 18:44:51.750449 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.750416 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/17cbee2f05534142fef47f5b2283ef20-config\") pod \"kube-apiserver-proxy-ip-10-0-131-36.ec2.internal\" (UID: \"17cbee2f05534142fef47f5b2283ef20\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-36.ec2.internal" Jul 17 18:44:51.750516 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.750458 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/17cbee2f05534142fef47f5b2283ef20-config\") pod \"kube-apiserver-proxy-ip-10-0-131-36.ec2.internal\" (UID: \"17cbee2f05534142fef47f5b2283ef20\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-36.ec2.internal" Jul 17 18:44:51.750516 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.750468 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0b5419f7cb1e64a2ab16d7fe91c43a1c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal\" (UID: \"0b5419f7cb1e64a2ab16d7fe91c43a1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal" Jul 17 18:44:51.750516 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.750472 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b5419f7cb1e64a2ab16d7fe91c43a1c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal\" (UID: \"0b5419f7cb1e64a2ab16d7fe91c43a1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal" Jul 17 18:44:51.761465 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:51.761448 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-36.ec2.internal\" not found" Jul 17 18:44:51.862129 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:51.862049 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-36.ec2.internal\" not found" Jul 17 18:44:51.916274 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.916248 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal" Jul 17 18:44:51.922561 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:51.922541 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-36.ec2.internal" Jul 17 18:44:51.963133 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:51.963108 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-36.ec2.internal\" not found" Jul 17 18:44:52.063766 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:52.063719 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-36.ec2.internal\" not found" Jul 17 18:44:52.164283 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:52.164195 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-36.ec2.internal\" not found" Jul 17 18:44:52.264768 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:52.264734 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-36.ec2.internal\" not found" Jul 17 18:44:52.286066 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:52.286042 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 17 18:44:52.286204 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:52.286185 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 17 18:44:52.365409 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:52.365370 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-36.ec2.internal\" not found" Jul 17 18:44:52.390524 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:52.390493 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 18:39:50 +0000 UTC" deadline="2028-02-22 17:08:21.966593623 +0000 UTC" Jul 17 18:44:52.390524 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:52.390522 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14038h23m29.576075651s" Jul 17 18:44:52.417842 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:52.417775 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 18:44:52.465823 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:52.465785 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-36.ec2.internal\" not found" Jul 17 18:44:52.536643 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:52.536622 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 18:44:52.537402 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:52.537387 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasSufficientMemory" Jul 17 18:44:52.537470 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:52.537414 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 18:44:52.537470 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:52.537424 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeHasSufficientPID" Jul 17 18:44:52.566491 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:52.566469 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-36.ec2.internal\" not found" Jul 17 18:44:52.655552 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:52.655523 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 18:44:52.667505 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:52.667476 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-36.ec2.internal\" not found" Jul 17 18:44:52.694297 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:52.694270 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17cbee2f05534142fef47f5b2283ef20.slice/crio-3ce3c46ea4282e44bd700155209f8ba21c1414f0bfeb209e959ffed959ded85a WatchSource:0}: Error finding container 3ce3c46ea4282e44bd700155209f8ba21c1414f0bfeb209e959ffed959ded85a: Status 404 returned error can't find the container with id 3ce3c46ea4282e44bd700155209f8ba21c1414f0bfeb209e959ffed959ded85a Jul 17 18:44:52.694601 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:52.694583 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b5419f7cb1e64a2ab16d7fe91c43a1c.slice/crio-3e4e24f0352b8ce58ca47b22af3e0879cf27e1762bdb815731de8c0beabfa4cd WatchSource:0}: Error finding container 3e4e24f0352b8ce58ca47b22af3e0879cf27e1762bdb815731de8c0beabfa4cd: Status 404 returned error can't find the container with id 3e4e24f0352b8ce58ca47b22af3e0879cf27e1762bdb815731de8c0beabfa4cd Jul 17 18:44:52.699414 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:52.699401 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 18:44:52.768582 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:52.768550 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-36.ec2.internal\" not found" Jul 17 18:44:52.869226 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:52.869195 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-36.ec2.internal\" not found" Jul 17 18:44:52.969694 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:52.969629 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-36.ec2.internal\" not found" Jul 17 18:44:53.069956 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:53.069924 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-36.ec2.internal\" not found" Jul 17 18:44:53.170458 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:53.170426 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-36.ec2.internal\" not found" Jul 17 18:44:53.270851 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:53.270775 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-36.ec2.internal\" not found" Jul 17 18:44:53.289333 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.289210 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 18:44:53.328468 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.328441 2559 apiserver.go:52] "Watching apiserver" Jul 17 18:44:53.336044 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.336012 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 17 18:44:53.336413 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.336390 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv","openshift-cluster-node-tuning-operator/tuned-wc2sl","openshift-image-registry/node-ca-sps5m","openshift-dns/node-resolver-v6ttl","openshift-multus/multus-7vqds","openshift-multus/multus-additional-cni-plugins-jgrm5","openshift-multus/network-metrics-daemon-l957z","openshift-network-diagnostics/network-check-target-tpstx","openshift-network-operator/iptables-alerter-zzg9j","openshift-ovn-kubernetes/ovnkube-node-jpl4k","kube-system/global-pull-secret-syncer-fwzx9","kube-system/konnectivity-agent-7shq8"] Jul 17 18:44:53.337904 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.337882 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv" Jul 17 18:44:53.339572 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.339490 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.340148 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.340130 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 17 18:44:53.340391 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.340372 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tm5vz\"" Jul 17 18:44:53.340611 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.340597 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 17 18:44:53.340789 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.340773 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 17 18:44:53.342462 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.342433 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 17 18:44:53.342929 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.342912 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vrj5m\"" Jul 17 18:44:53.343900 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.343164 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sps5m" Jul 17 18:44:53.343900 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.343362 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 17 18:44:53.345260 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.344150 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v6ttl" Jul 17 18:44:53.345260 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.344263 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.346331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.346136 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dwgm4\"" Jul 17 18:44:53.346331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.346241 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 17 18:44:53.346331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.346293 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 17 18:44:53.346802 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.346665 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 17 18:44:53.346802 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.346798 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 17 18:44:53.346973 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.346954 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hh542\"" Jul 17 18:44:53.347062 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.346988 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 17 18:44:53.347367 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.347350 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 17 18:44:53.348436 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.347488 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 17 18:44:53.348436 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.348218 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal" Jul 17 18:44:53.348545 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.348484 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 17 18:44:53.348588 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.348571 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jgrm5" Jul 17 18:44:53.348703 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.348679 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rzt9w\"" Jul 17 18:44:53.348912 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.348899 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 17 18:44:53.349023 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.349008 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 17 18:44:53.350629 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.350593 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 17 18:44:53.350720 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.350687 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-plzgx\"" Jul 17 18:44:53.350720 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.350709 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 17 18:44:53.350965 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.350944 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:44:53.351024 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:53.350996 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l957z" podUID="7362711c-acf1-4dc6-ae17-c6bf043f12c7" Jul 17 18:44:53.352409 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.352394 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:44:53.352485 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:53.352469 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tpstx" podUID="6875c8e0-71a7-49b7-a799-5720b2f9b244" Jul 17 18:44:53.353671 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.353654 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zzg9j" Jul 17 18:44:53.355594 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.355006 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.355803 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.355787 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 17 18:44:53.355861 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.355805 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 17 18:44:53.356082 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.356063 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hm8g7\"" Jul 17 18:44:53.356592 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.356573 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 17 18:44:53.356897 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.356882 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:44:53.356983 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:53.356936 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwzx9" podUID="e17f75b8-ee10-4328-bb53-f83b188ad149" Jul 17 18:44:53.357615 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.357590 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7shq8" Jul 17 18:44:53.357910 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.357898 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 17 18:44:53.358260 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.358146 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dhvpt\"" Jul 17 18:44:53.358260 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.358146 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 17 18:44:53.358840 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.358823 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-etc-kubernetes\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.359181 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.359162 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5d27024b-f44e-4530-af19-cff3ed46fe13-socket-dir\") pod \"aws-ebs-csi-driver-node-p2rgv\" (UID: \"5d27024b-f44e-4530-af19-cff3ed46fe13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv" Jul 17 18:44:53.359550 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.359439 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5d27024b-f44e-4530-af19-cff3ed46fe13-sys-fs\") pod \"aws-ebs-csi-driver-node-p2rgv\" (UID: \"5d27024b-f44e-4530-af19-cff3ed46fe13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv" Jul 17 18:44:53.359702 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.359671 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2frs\" (UniqueName: \"kubernetes.io/projected/5d27024b-f44e-4530-af19-cff3ed46fe13-kube-api-access-w2frs\") pod \"aws-ebs-csi-driver-node-p2rgv\" (UID: \"5d27024b-f44e-4530-af19-cff3ed46fe13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv" Jul 17 18:44:53.359808 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.359795 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-etc-modprobe-d\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.359970 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.359953 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-etc-systemd\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.360044 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.359978 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-cnibin\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.360044 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.359999 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7d97951-9dd3-466c-9d91-6d2bf2930d40-system-cni-dir\") pod \"multus-additional-cni-plugins-jgrm5\" (UID: \"d7d97951-9dd3-466c-9d91-6d2bf2930d40\") " pod="openshift-multus/multus-additional-cni-plugins-jgrm5" Jul 17 18:44:53.360044 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360020 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-etc-sysctl-d\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.360044 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360039 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-run\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.360226 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360058 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-host\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.360226 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360078 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-etc-tuned\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.360226 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360098 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-multus-socket-dir-parent\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.360226 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360121 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-host-var-lib-kubelet\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.360226 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360141 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-hostroot\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.360226 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360170 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7d97951-9dd3-466c-9d91-6d2bf2930d40-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jgrm5\" (UID: \"d7d97951-9dd3-466c-9d91-6d2bf2930d40\") " pod="openshift-multus/multus-additional-cni-plugins-jgrm5" Jul 17 18:44:53.360226 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360201 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d7d97951-9dd3-466c-9d91-6d2bf2930d40-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jgrm5\" (UID: \"d7d97951-9dd3-466c-9d91-6d2bf2930d40\") " pod="openshift-multus/multus-additional-cni-plugins-jgrm5" Jul 17 18:44:53.360556 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360227 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d7d97951-9dd3-466c-9d91-6d2bf2930d40-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jgrm5\" (UID: \"d7d97951-9dd3-466c-9d91-6d2bf2930d40\") " pod="openshift-multus/multus-additional-cni-plugins-jgrm5" Jul 17 18:44:53.360556 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360252 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmvgv\" (UniqueName: \"kubernetes.io/projected/d7d97951-9dd3-466c-9d91-6d2bf2930d40-kube-api-access-rmvgv\") pod \"multus-additional-cni-plugins-jgrm5\" (UID: \"d7d97951-9dd3-466c-9d91-6d2bf2930d40\") " pod="openshift-multus/multus-additional-cni-plugins-jgrm5" Jul 17 18:44:53.360556 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360284 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-etc-sysctl-conf\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.360556 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360343 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxcmx\" (UniqueName: \"kubernetes.io/projected/8b17e270-da8c-4293-b8e5-952a51cb976a-kube-api-access-pxcmx\") pod \"node-resolver-v6ttl\" (UID: \"8b17e270-da8c-4293-b8e5-952a51cb976a\") " pod="openshift-dns/node-resolver-v6ttl" Jul 17 18:44:53.360556 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360350 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal"] Jul 17 18:44:53.360556 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360367 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-host-var-lib-cni-multus\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.360556 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.359059 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 17 18:44:53.360556 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360394 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-sys\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.360556 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360415 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-tmp\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.360556 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360436 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8b17e270-da8c-4293-b8e5-952a51cb976a-hosts-file\") pod \"node-resolver-v6ttl\" (UID: \"8b17e270-da8c-4293-b8e5-952a51cb976a\") " pod="openshift-dns/node-resolver-v6ttl" Jul 17 18:44:53.360556 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360458 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b17e270-da8c-4293-b8e5-952a51cb976a-tmp-dir\") pod \"node-resolver-v6ttl\" (UID: \"8b17e270-da8c-4293-b8e5-952a51cb976a\") " pod="openshift-dns/node-resolver-v6ttl" Jul 17 18:44:53.360556 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360481 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-host-run-k8s-cni-cncf-io\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.360556 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.359390 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 17 18:44:53.360556 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360518 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-multus-conf-dir\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.361131 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360572 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5d27024b-f44e-4530-af19-cff3ed46fe13-device-dir\") pod \"aws-ebs-csi-driver-node-p2rgv\" (UID: \"5d27024b-f44e-4530-af19-cff3ed46fe13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv" Jul 17 18:44:53.361131 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360598 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-etc-sysconfig\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.361131 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360632 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-system-cni-dir\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.361131 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.359386 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 18:44:53.361131 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360661 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-host-var-lib-cni-bin\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.361131 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360684 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf8bb\" (UniqueName: \"kubernetes.io/projected/021237e7-89fc-4f95-a71e-ba92f8d9b743-kube-api-access-bf8bb\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.361131 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360705 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-lib-modules\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.361131 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360712 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-36.ec2.internal" Jul 17 18:44:53.361131 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360731 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/071af57d-fffa-4c23-8505-329bba791a74-host\") pod \"node-ca-sps5m\" (UID: \"071af57d-fffa-4c23-8505-329bba791a74\") " pod="openshift-image-registry/node-ca-sps5m" Jul 17 18:44:53.361131 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360755 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwc92\" (UniqueName: \"kubernetes.io/projected/071af57d-fffa-4c23-8505-329bba791a74-kube-api-access-nwc92\") pod \"node-ca-sps5m\" (UID: \"071af57d-fffa-4c23-8505-329bba791a74\") " pod="openshift-image-registry/node-ca-sps5m" Jul 17 18:44:53.361131 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360792 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-host-run-netns\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.361131 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360813 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7d97951-9dd3-466c-9d91-6d2bf2930d40-os-release\") pod \"multus-additional-cni-plugins-jgrm5\" (UID: \"d7d97951-9dd3-466c-9d91-6d2bf2930d40\") " pod="openshift-multus/multus-additional-cni-plugins-jgrm5" Jul 17 18:44:53.361131 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360836 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5d27024b-f44e-4530-af19-cff3ed46fe13-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p2rgv\" (UID: \"5d27024b-f44e-4530-af19-cff3ed46fe13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv" Jul 17 18:44:53.361131 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360869 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5d27024b-f44e-4530-af19-cff3ed46fe13-registration-dir\") pod \"aws-ebs-csi-driver-node-p2rgv\" (UID: \"5d27024b-f44e-4530-af19-cff3ed46fe13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv" Jul 17 18:44:53.361131 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360893 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5d27024b-f44e-4530-af19-cff3ed46fe13-etc-selinux\") pod \"aws-ebs-csi-driver-node-p2rgv\" (UID: \"5d27024b-f44e-4530-af19-cff3ed46fe13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv" Jul 17 18:44:53.361131 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.359058 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 17 18:44:53.361131 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.359537 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 17 18:44:53.361897 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.359107 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 18:44:53.361897 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.360921 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-etc-kubernetes\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.361897 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.361205 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh87b\" (UniqueName: \"kubernetes.io/projected/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-kube-api-access-rh87b\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.361897 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.361261 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-multus-cni-dir\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.361897 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.361282 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-os-release\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.361897 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.361325 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7d97951-9dd3-466c-9d91-6d2bf2930d40-cnibin\") pod \"multus-additional-cni-plugins-jgrm5\" (UID: \"d7d97951-9dd3-466c-9d91-6d2bf2930d40\") " pod="openshift-multus/multus-additional-cni-plugins-jgrm5" Jul 17 18:44:53.361897 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.361347 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7d97951-9dd3-466c-9d91-6d2bf2930d40-cni-binary-copy\") pod \"multus-additional-cni-plugins-jgrm5\" (UID: \"d7d97951-9dd3-466c-9d91-6d2bf2930d40\") " pod="openshift-multus/multus-additional-cni-plugins-jgrm5" Jul 17 18:44:53.361897 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.361368 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-var-lib-kubelet\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.361897 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.361388 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/071af57d-fffa-4c23-8505-329bba791a74-serviceca\") pod \"node-ca-sps5m\" (UID: \"071af57d-fffa-4c23-8505-329bba791a74\") " pod="openshift-image-registry/node-ca-sps5m" Jul 17 18:44:53.361897 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.361408 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/021237e7-89fc-4f95-a71e-ba92f8d9b743-cni-binary-copy\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.361897 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.361428 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/021237e7-89fc-4f95-a71e-ba92f8d9b743-multus-daemon-config\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.361897 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.361448 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-host-run-multus-certs\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.363984 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.362731 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 17 18:44:53.363984 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.363595 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-425pv\"" Jul 17 18:44:53.363984 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.363820 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 17 18:44:53.369169 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.369071 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 18:44:53.369390 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.369371 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-36.ec2.internal"] Jul 17 18:44:53.397983 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.397959 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-j8b7t" Jul 17 18:44:53.405732 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.405709 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j8b7t" Jul 17 18:44:53.449394 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.449367 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 17 18:44:53.461863 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.461833 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5d27024b-f44e-4530-af19-cff3ed46fe13-device-dir\") pod \"aws-ebs-csi-driver-node-p2rgv\" (UID: \"5d27024b-f44e-4530-af19-cff3ed46fe13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv" Jul 17 18:44:53.462006 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.461872 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-host-var-lib-cni-bin\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.462006 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.461894 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-host-slash\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.462006 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.461907 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5d27024b-f44e-4530-af19-cff3ed46fe13-device-dir\") pod \"aws-ebs-csi-driver-node-p2rgv\" (UID: \"5d27024b-f44e-4530-af19-cff3ed46fe13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv" Jul 17 18:44:53.462006 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.461911 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-host-cni-bin\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.462006 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.461946 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-host-var-lib-cni-bin\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.462006 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.461947 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d9bb01d7-7fed-4275-9a94-df46852eeb39-ovn-node-metrics-cert\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.462006 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.461974 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d9bb01d7-7fed-4275-9a94-df46852eeb39-ovnkube-script-lib\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.462006 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.461992 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-host-run-netns\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.462253 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462013 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7d97951-9dd3-466c-9d91-6d2bf2930d40-os-release\") pod \"multus-additional-cni-plugins-jgrm5\" (UID: \"d7d97951-9dd3-466c-9d91-6d2bf2930d40\") " pod="openshift-multus/multus-additional-cni-plugins-jgrm5" Jul 17 18:44:53.462253 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462046 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh87b\" (UniqueName: \"kubernetes.io/projected/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-kube-api-access-rh87b\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.462253 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462112 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-host-run-netns\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.462253 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462112 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-multus-cni-dir\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.462253 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462145 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-os-release\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.462253 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462164 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-multus-cni-dir\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.462253 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462194 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-host-cni-netd\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.462253 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462199 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7d97951-9dd3-466c-9d91-6d2bf2930d40-os-release\") pod \"multus-additional-cni-plugins-jgrm5\" (UID: \"d7d97951-9dd3-466c-9d91-6d2bf2930d40\") " pod="openshift-multus/multus-additional-cni-plugins-jgrm5" Jul 17 18:44:53.462253 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462218 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbxw8\" (UniqueName: \"kubernetes.io/projected/7362711c-acf1-4dc6-ae17-c6bf043f12c7-kube-api-access-hbxw8\") pod \"network-metrics-daemon-l957z\" (UID: \"7362711c-acf1-4dc6-ae17-c6bf043f12c7\") " pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:44:53.462253 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462241 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-os-release\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.462253 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462243 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d89553d-8d41-4909-9b1e-4bb03803e1ec-host-slash\") pod \"iptables-alerter-zzg9j\" (UID: \"1d89553d-8d41-4909-9b1e-4bb03803e1ec\") " pod="openshift-network-operator/iptables-alerter-zzg9j" Jul 17 18:44:53.462608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462270 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-host-run-multus-certs\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.462608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462301 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-run-openvswitch\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.462608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462339 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5d27024b-f44e-4530-af19-cff3ed46fe13-socket-dir\") pod \"aws-ebs-csi-driver-node-p2rgv\" (UID: \"5d27024b-f44e-4530-af19-cff3ed46fe13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv" Jul 17 18:44:53.462608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462348 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-host-run-multus-certs\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.462608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462367 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2frs\" (UniqueName: \"kubernetes.io/projected/5d27024b-f44e-4530-af19-cff3ed46fe13-kube-api-access-w2frs\") pod \"aws-ebs-csi-driver-node-p2rgv\" (UID: \"5d27024b-f44e-4530-af19-cff3ed46fe13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv" Jul 17 18:44:53.462608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462387 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-etc-modprobe-d\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.462608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462406 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-cnibin\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.462608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462438 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/917437f2-fc59-467c-a077-d0f905356f21-konnectivity-ca\") pod \"konnectivity-agent-7shq8\" (UID: \"917437f2-fc59-467c-a077-d0f905356f21\") " pod="kube-system/konnectivity-agent-7shq8" Jul 17 18:44:53.462608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462456 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5d27024b-f44e-4530-af19-cff3ed46fe13-socket-dir\") pod \"aws-ebs-csi-driver-node-p2rgv\" (UID: \"5d27024b-f44e-4530-af19-cff3ed46fe13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv" Jul 17 18:44:53.462608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462464 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7362711c-acf1-4dc6-ae17-c6bf043f12c7-metrics-certs\") pod \"network-metrics-daemon-l957z\" (UID: \"7362711c-acf1-4dc6-ae17-c6bf043f12c7\") " pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:44:53.462608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462485 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-etc-tuned\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.462608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462505 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-hostroot\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.462608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462523 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d7d97951-9dd3-466c-9d91-6d2bf2930d40-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jgrm5\" (UID: \"d7d97951-9dd3-466c-9d91-6d2bf2930d40\") " pod="openshift-multus/multus-additional-cni-plugins-jgrm5" Jul 17 18:44:53.462608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462557 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-etc-modprobe-d\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.462608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462553 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxcmx\" (UniqueName: \"kubernetes.io/projected/8b17e270-da8c-4293-b8e5-952a51cb976a-kube-api-access-pxcmx\") pod \"node-resolver-v6ttl\" (UID: \"8b17e270-da8c-4293-b8e5-952a51cb976a\") " pod="openshift-dns/node-resolver-v6ttl" Jul 17 18:44:53.462608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462591 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-host-var-lib-cni-multus\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.462608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462613 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/917437f2-fc59-467c-a077-d0f905356f21-agent-certs\") pod \"konnectivity-agent-7shq8\" (UID: \"917437f2-fc59-467c-a077-d0f905356f21\") " pod="kube-system/konnectivity-agent-7shq8" Jul 17 18:44:53.463106 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462634 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1d89553d-8d41-4909-9b1e-4bb03803e1ec-iptables-alerter-script\") pod \"iptables-alerter-zzg9j\" (UID: \"1d89553d-8d41-4909-9b1e-4bb03803e1ec\") " pod="openshift-network-operator/iptables-alerter-zzg9j" Jul 17 18:44:53.463106 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462658 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-sys\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.463106 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462679 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b17e270-da8c-4293-b8e5-952a51cb976a-tmp-dir\") pod \"node-resolver-v6ttl\" (UID: \"8b17e270-da8c-4293-b8e5-952a51cb976a\") " pod="openshift-dns/node-resolver-v6ttl" Jul 17 18:44:53.463106 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462700 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-host-run-k8s-cni-cncf-io\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.463106 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462721 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-host-run-netns\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.463106 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462741 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e17f75b8-ee10-4328-bb53-f83b188ad149-kubelet-config\") pod \"global-pull-secret-syncer-fwzx9\" (UID: \"e17f75b8-ee10-4328-bb53-f83b188ad149\") " pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:44:53.463106 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462764 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrxr6\" (UniqueName: \"kubernetes.io/projected/6875c8e0-71a7-49b7-a799-5720b2f9b244-kube-api-access-nrxr6\") pod \"network-check-target-tpstx\" (UID: \"6875c8e0-71a7-49b7-a799-5720b2f9b244\") " pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:44:53.463106 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462787 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-etc-sysconfig\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.463106 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462792 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-cnibin\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.463106 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462809 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-system-cni-dir\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.463106 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462829 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-etc-openvswitch\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.463106 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462849 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-lib-modules\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.463106 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462869 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/071af57d-fffa-4c23-8505-329bba791a74-host\") pod \"node-ca-sps5m\" (UID: \"071af57d-fffa-4c23-8505-329bba791a74\") " pod="openshift-image-registry/node-ca-sps5m" Jul 17 18:44:53.463106 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462890 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwc92\" (UniqueName: \"kubernetes.io/projected/071af57d-fffa-4c23-8505-329bba791a74-kube-api-access-nwc92\") pod \"node-ca-sps5m\" (UID: \"071af57d-fffa-4c23-8505-329bba791a74\") " pod="openshift-image-registry/node-ca-sps5m" Jul 17 18:44:53.463106 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462909 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-node-log\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.463106 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462930 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-log-socket\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.463106 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462952 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d9bb01d7-7fed-4275-9a94-df46852eeb39-env-overrides\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.463616 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462974 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf8bb\" (UniqueName: \"kubernetes.io/projected/021237e7-89fc-4f95-a71e-ba92f8d9b743-kube-api-access-bf8bb\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.463616 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.462997 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5d27024b-f44e-4530-af19-cff3ed46fe13-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p2rgv\" (UID: \"5d27024b-f44e-4530-af19-cff3ed46fe13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv" Jul 17 18:44:53.463616 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463020 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5d27024b-f44e-4530-af19-cff3ed46fe13-registration-dir\") pod \"aws-ebs-csi-driver-node-p2rgv\" (UID: \"5d27024b-f44e-4530-af19-cff3ed46fe13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv" Jul 17 18:44:53.463616 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463042 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5d27024b-f44e-4530-af19-cff3ed46fe13-etc-selinux\") pod \"aws-ebs-csi-driver-node-p2rgv\" (UID: \"5d27024b-f44e-4530-af19-cff3ed46fe13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv" Jul 17 18:44:53.463616 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463062 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-etc-kubernetes\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.463616 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463065 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-hostroot\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.463616 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463064 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 17 18:44:53.463616 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463084 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d9bb01d7-7fed-4275-9a94-df46852eeb39-ovnkube-config\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.463616 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463108 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e17f75b8-ee10-4328-bb53-f83b188ad149-original-pull-secret\") pod \"global-pull-secret-syncer-fwzx9\" (UID: \"e17f75b8-ee10-4328-bb53-f83b188ad149\") " pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:44:53.463616 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463131 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7d97951-9dd3-466c-9d91-6d2bf2930d40-cnibin\") pod \"multus-additional-cni-plugins-jgrm5\" (UID: \"d7d97951-9dd3-466c-9d91-6d2bf2930d40\") " pod="openshift-multus/multus-additional-cni-plugins-jgrm5" Jul 17 18:44:53.463616 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463154 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7d97951-9dd3-466c-9d91-6d2bf2930d40-cni-binary-copy\") pod \"multus-additional-cni-plugins-jgrm5\" (UID: \"d7d97951-9dd3-466c-9d91-6d2bf2930d40\") " pod="openshift-multus/multus-additional-cni-plugins-jgrm5" Jul 17 18:44:53.463616 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463175 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-var-lib-kubelet\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.463616 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463197 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/071af57d-fffa-4c23-8505-329bba791a74-serviceca\") pod \"node-ca-sps5m\" (UID: \"071af57d-fffa-4c23-8505-329bba791a74\") " pod="openshift-image-registry/node-ca-sps5m" Jul 17 18:44:53.463616 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463219 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/021237e7-89fc-4f95-a71e-ba92f8d9b743-cni-binary-copy\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.463616 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463253 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/021237e7-89fc-4f95-a71e-ba92f8d9b743-multus-daemon-config\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.463616 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463275 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-etc-kubernetes\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.463616 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463328 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-var-lib-openvswitch\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.464082 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463356 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5d27024b-f44e-4530-af19-cff3ed46fe13-sys-fs\") pod \"aws-ebs-csi-driver-node-p2rgv\" (UID: \"5d27024b-f44e-4530-af19-cff3ed46fe13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv" Jul 17 18:44:53.464082 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463377 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-etc-systemd\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.464082 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463414 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-multus-conf-dir\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.464082 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463442 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-host-run-ovn-kubernetes\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.464082 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463466 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.464082 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463491 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xrjh\" (UniqueName: \"kubernetes.io/projected/d9bb01d7-7fed-4275-9a94-df46852eeb39-kube-api-access-4xrjh\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.464082 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463515 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7d97951-9dd3-466c-9d91-6d2bf2930d40-system-cni-dir\") pod \"multus-additional-cni-plugins-jgrm5\" (UID: \"d7d97951-9dd3-466c-9d91-6d2bf2930d40\") " pod="openshift-multus/multus-additional-cni-plugins-jgrm5" Jul 17 18:44:53.464082 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463545 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-etc-sysctl-d\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.464082 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463568 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-run\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.464082 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463572 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d7d97951-9dd3-466c-9d91-6d2bf2930d40-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jgrm5\" (UID: \"d7d97951-9dd3-466c-9d91-6d2bf2930d40\") " pod="openshift-multus/multus-additional-cni-plugins-jgrm5" Jul 17 18:44:53.464082 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463590 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-host\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.464082 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463611 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-multus-socket-dir-parent\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.464082 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463633 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-host-var-lib-kubelet\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.464082 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463654 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-host-kubelet\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.464082 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463675 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-run-ovn\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.464082 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463699 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7d97951-9dd3-466c-9d91-6d2bf2930d40-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jgrm5\" (UID: \"d7d97951-9dd3-466c-9d91-6d2bf2930d40\") " pod="openshift-multus/multus-additional-cni-plugins-jgrm5" Jul 17 18:44:53.464082 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463724 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d7d97951-9dd3-466c-9d91-6d2bf2930d40-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jgrm5\" (UID: \"d7d97951-9dd3-466c-9d91-6d2bf2930d40\") " pod="openshift-multus/multus-additional-cni-plugins-jgrm5" Jul 17 18:44:53.464589 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463750 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmvgv\" (UniqueName: \"kubernetes.io/projected/d7d97951-9dd3-466c-9d91-6d2bf2930d40-kube-api-access-rmvgv\") pod \"multus-additional-cni-plugins-jgrm5\" (UID: \"d7d97951-9dd3-466c-9d91-6d2bf2930d40\") " pod="openshift-multus/multus-additional-cni-plugins-jgrm5" Jul 17 18:44:53.464589 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463792 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-etc-sysctl-conf\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.464589 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463814 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-systemd-units\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.464589 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463826 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-host-var-lib-cni-multus\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.464589 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463836 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-run-systemd\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.464589 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463862 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e17f75b8-ee10-4328-bb53-f83b188ad149-dbus\") pod \"global-pull-secret-syncer-fwzx9\" (UID: \"e17f75b8-ee10-4328-bb53-f83b188ad149\") " pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:44:53.464589 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463900 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxgp4\" (UniqueName: \"kubernetes.io/projected/1d89553d-8d41-4909-9b1e-4bb03803e1ec-kube-api-access-zxgp4\") pod \"iptables-alerter-zzg9j\" (UID: \"1d89553d-8d41-4909-9b1e-4bb03803e1ec\") " pod="openshift-network-operator/iptables-alerter-zzg9j" Jul 17 18:44:53.464589 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463926 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-tmp\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.464589 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.463954 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8b17e270-da8c-4293-b8e5-952a51cb976a-hosts-file\") pod \"node-resolver-v6ttl\" (UID: \"8b17e270-da8c-4293-b8e5-952a51cb976a\") " pod="openshift-dns/node-resolver-v6ttl" Jul 17 18:44:53.464589 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.464041 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b17e270-da8c-4293-b8e5-952a51cb976a-tmp-dir\") pod \"node-resolver-v6ttl\" (UID: \"8b17e270-da8c-4293-b8e5-952a51cb976a\") " pod="openshift-dns/node-resolver-v6ttl" Jul 17 18:44:53.464589 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.464051 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/021237e7-89fc-4f95-a71e-ba92f8d9b743-multus-daemon-config\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.464589 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.464104 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8b17e270-da8c-4293-b8e5-952a51cb976a-hosts-file\") pod \"node-resolver-v6ttl\" (UID: \"8b17e270-da8c-4293-b8e5-952a51cb976a\") " pod="openshift-dns/node-resolver-v6ttl" Jul 17 18:44:53.464589 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.464161 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-etc-systemd\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.464589 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.464169 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5d27024b-f44e-4530-af19-cff3ed46fe13-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p2rgv\" (UID: \"5d27024b-f44e-4530-af19-cff3ed46fe13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv" Jul 17 18:44:53.464589 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.464185 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-multus-conf-dir\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.464589 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.464206 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-etc-sysconfig\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.464589 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.464220 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7d97951-9dd3-466c-9d91-6d2bf2930d40-system-cni-dir\") pod \"multus-additional-cni-plugins-jgrm5\" (UID: \"d7d97951-9dd3-466c-9d91-6d2bf2930d40\") " pod="openshift-multus/multus-additional-cni-plugins-jgrm5" Jul 17 18:44:53.465059 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.464243 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-system-cni-dir\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.465059 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.464258 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7d97951-9dd3-466c-9d91-6d2bf2930d40-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jgrm5\" (UID: \"d7d97951-9dd3-466c-9d91-6d2bf2930d40\") " pod="openshift-multus/multus-additional-cni-plugins-jgrm5" Jul 17 18:44:53.465059 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.464291 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5d27024b-f44e-4530-af19-cff3ed46fe13-registration-dir\") pod \"aws-ebs-csi-driver-node-p2rgv\" (UID: \"5d27024b-f44e-4530-af19-cff3ed46fe13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv" Jul 17 18:44:53.465059 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.464322 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-etc-sysctl-d\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.465059 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.464365 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-run\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.465059 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.464376 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-var-lib-kubelet\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.465059 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.464383 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-lib-modules\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.465059 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.464405 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-host\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.465059 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.464410 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/071af57d-fffa-4c23-8505-329bba791a74-host\") pod \"node-ca-sps5m\" (UID: \"071af57d-fffa-4c23-8505-329bba791a74\") " pod="openshift-image-registry/node-ca-sps5m" Jul 17 18:44:53.465059 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.464419 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-etc-kubernetes\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.465059 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.464451 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-multus-socket-dir-parent\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.465059 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.464452 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7d97951-9dd3-466c-9d91-6d2bf2930d40-cnibin\") pod \"multus-additional-cni-plugins-jgrm5\" (UID: \"d7d97951-9dd3-466c-9d91-6d2bf2930d40\") " pod="openshift-multus/multus-additional-cni-plugins-jgrm5" Jul 17 18:44:53.465059 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.464460 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-etc-kubernetes\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.465059 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.464495 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-host-var-lib-kubelet\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.465059 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.464562 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5d27024b-f44e-4530-af19-cff3ed46fe13-etc-selinux\") pod \"aws-ebs-csi-driver-node-p2rgv\" (UID: \"5d27024b-f44e-4530-af19-cff3ed46fe13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv" Jul 17 18:44:53.465059 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.464689 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d7d97951-9dd3-466c-9d91-6d2bf2930d40-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jgrm5\" (UID: \"d7d97951-9dd3-466c-9d91-6d2bf2930d40\") " pod="openshift-multus/multus-additional-cni-plugins-jgrm5" Jul 17 18:44:53.465059 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.464841 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/021237e7-89fc-4f95-a71e-ba92f8d9b743-cni-binary-copy\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.465059 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.464945 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-etc-sysctl-conf\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.465851 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.464971 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7d97951-9dd3-466c-9d91-6d2bf2930d40-cni-binary-copy\") pod \"multus-additional-cni-plugins-jgrm5\" (UID: \"d7d97951-9dd3-466c-9d91-6d2bf2930d40\") " pod="openshift-multus/multus-additional-cni-plugins-jgrm5" Jul 17 18:44:53.465851 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.464985 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-sys\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.465851 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.465009 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/071af57d-fffa-4c23-8505-329bba791a74-serviceca\") pod \"node-ca-sps5m\" (UID: \"071af57d-fffa-4c23-8505-329bba791a74\") " pod="openshift-image-registry/node-ca-sps5m" Jul 17 18:44:53.465851 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.465021 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/021237e7-89fc-4f95-a71e-ba92f8d9b743-host-run-k8s-cni-cncf-io\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.465851 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.465033 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5d27024b-f44e-4530-af19-cff3ed46fe13-sys-fs\") pod \"aws-ebs-csi-driver-node-p2rgv\" (UID: \"5d27024b-f44e-4530-af19-cff3ed46fe13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv" Jul 17 18:44:53.465851 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.465767 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-etc-tuned\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.467017 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.466993 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-tmp\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.486157 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.486104 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-36.ec2.internal" event={"ID":"17cbee2f05534142fef47f5b2283ef20","Type":"ContainerStarted","Data":"3ce3c46ea4282e44bd700155209f8ba21c1414f0bfeb209e959ffed959ded85a"} Jul 17 18:44:53.487364 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.487333 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal" event={"ID":"0b5419f7cb1e64a2ab16d7fe91c43a1c","Type":"ContainerStarted","Data":"3e4e24f0352b8ce58ca47b22af3e0879cf27e1762bdb815731de8c0beabfa4cd"} Jul 17 18:44:53.490011 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.489988 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxcmx\" (UniqueName: \"kubernetes.io/projected/8b17e270-da8c-4293-b8e5-952a51cb976a-kube-api-access-pxcmx\") pod \"node-resolver-v6ttl\" (UID: \"8b17e270-da8c-4293-b8e5-952a51cb976a\") " pod="openshift-dns/node-resolver-v6ttl" Jul 17 18:44:53.490115 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.490034 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwc92\" (UniqueName: \"kubernetes.io/projected/071af57d-fffa-4c23-8505-329bba791a74-kube-api-access-nwc92\") pod \"node-ca-sps5m\" (UID: \"071af57d-fffa-4c23-8505-329bba791a74\") " pod="openshift-image-registry/node-ca-sps5m" Jul 17 18:44:53.490322 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.490283 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2frs\" (UniqueName: \"kubernetes.io/projected/5d27024b-f44e-4530-af19-cff3ed46fe13-kube-api-access-w2frs\") pod \"aws-ebs-csi-driver-node-p2rgv\" (UID: \"5d27024b-f44e-4530-af19-cff3ed46fe13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv" Jul 17 18:44:53.498362 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.498285 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf8bb\" (UniqueName: \"kubernetes.io/projected/021237e7-89fc-4f95-a71e-ba92f8d9b743-kube-api-access-bf8bb\") pod \"multus-7vqds\" (UID: \"021237e7-89fc-4f95-a71e-ba92f8d9b743\") " pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.500378 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.500359 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh87b\" (UniqueName: \"kubernetes.io/projected/206baf76-6cdb-441f-a6ae-97fd64eb5ddc-kube-api-access-rh87b\") pod \"tuned-wc2sl\" (UID: \"206baf76-6cdb-441f-a6ae-97fd64eb5ddc\") " pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.505915 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.505897 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmvgv\" (UniqueName: \"kubernetes.io/projected/d7d97951-9dd3-466c-9d91-6d2bf2930d40-kube-api-access-rmvgv\") pod \"multus-additional-cni-plugins-jgrm5\" (UID: \"d7d97951-9dd3-466c-9d91-6d2bf2930d40\") " pod="openshift-multus/multus-additional-cni-plugins-jgrm5" Jul 17 18:44:53.564818 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.564747 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-host-cni-netd\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.564818 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.564789 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbxw8\" (UniqueName: \"kubernetes.io/projected/7362711c-acf1-4dc6-ae17-c6bf043f12c7-kube-api-access-hbxw8\") pod \"network-metrics-daemon-l957z\" (UID: \"7362711c-acf1-4dc6-ae17-c6bf043f12c7\") " pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:44:53.564996 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.564839 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-host-cni-netd\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.564996 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.564896 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d89553d-8d41-4909-9b1e-4bb03803e1ec-host-slash\") pod \"iptables-alerter-zzg9j\" (UID: \"1d89553d-8d41-4909-9b1e-4bb03803e1ec\") " pod="openshift-network-operator/iptables-alerter-zzg9j" Jul 17 18:44:53.564996 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.564934 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-run-openvswitch\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.564996 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.564960 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/917437f2-fc59-467c-a077-d0f905356f21-konnectivity-ca\") pod \"konnectivity-agent-7shq8\" (UID: \"917437f2-fc59-467c-a077-d0f905356f21\") " pod="kube-system/konnectivity-agent-7shq8" Jul 17 18:44:53.564996 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.564984 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7362711c-acf1-4dc6-ae17-c6bf043f12c7-metrics-certs\") pod \"network-metrics-daemon-l957z\" (UID: \"7362711c-acf1-4dc6-ae17-c6bf043f12c7\") " pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:44:53.565216 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565007 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-run-openvswitch\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.565216 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565009 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/917437f2-fc59-467c-a077-d0f905356f21-agent-certs\") pod \"konnectivity-agent-7shq8\" (UID: \"917437f2-fc59-467c-a077-d0f905356f21\") " pod="kube-system/konnectivity-agent-7shq8" Jul 17 18:44:53.565216 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565049 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1d89553d-8d41-4909-9b1e-4bb03803e1ec-iptables-alerter-script\") pod \"iptables-alerter-zzg9j\" (UID: \"1d89553d-8d41-4909-9b1e-4bb03803e1ec\") " pod="openshift-network-operator/iptables-alerter-zzg9j" Jul 17 18:44:53.565216 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565066 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-host-run-netns\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.565216 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565106 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e17f75b8-ee10-4328-bb53-f83b188ad149-kubelet-config\") pod \"global-pull-secret-syncer-fwzx9\" (UID: \"e17f75b8-ee10-4328-bb53-f83b188ad149\") " pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:44:53.565216 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:53.565120 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:44:53.565216 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:53.565207 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7362711c-acf1-4dc6-ae17-c6bf043f12c7-metrics-certs podName:7362711c-acf1-4dc6-ae17-c6bf043f12c7 nodeName:}" failed. No retries permitted until 2026-07-17 18:44:54.065187273 +0000 UTC m=+3.096800145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7362711c-acf1-4dc6-ae17-c6bf043f12c7-metrics-certs") pod "network-metrics-daemon-l957z" (UID: "7362711c-acf1-4dc6-ae17-c6bf043f12c7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:44:53.565514 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565127 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrxr6\" (UniqueName: \"kubernetes.io/projected/6875c8e0-71a7-49b7-a799-5720b2f9b244-kube-api-access-nrxr6\") pod \"network-check-target-tpstx\" (UID: \"6875c8e0-71a7-49b7-a799-5720b2f9b244\") " pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:44:53.565514 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565044 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d89553d-8d41-4909-9b1e-4bb03803e1ec-host-slash\") pod \"iptables-alerter-zzg9j\" (UID: \"1d89553d-8d41-4909-9b1e-4bb03803e1ec\") " pod="openshift-network-operator/iptables-alerter-zzg9j" Jul 17 18:44:53.565514 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565403 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-host-run-netns\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.565514 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565433 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-etc-openvswitch\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.565514 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565463 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e17f75b8-ee10-4328-bb53-f83b188ad149-kubelet-config\") pod \"global-pull-secret-syncer-fwzx9\" (UID: \"e17f75b8-ee10-4328-bb53-f83b188ad149\") " pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:44:53.565514 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565488 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-node-log\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.565514 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565510 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-log-socket\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.565514 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565511 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-etc-openvswitch\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.565839 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565531 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d9bb01d7-7fed-4275-9a94-df46852eeb39-env-overrides\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.565839 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565543 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/917437f2-fc59-467c-a077-d0f905356f21-konnectivity-ca\") pod \"konnectivity-agent-7shq8\" (UID: \"917437f2-fc59-467c-a077-d0f905356f21\") " pod="kube-system/konnectivity-agent-7shq8" Jul 17 18:44:53.565839 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565552 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-node-log\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.565839 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565557 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d9bb01d7-7fed-4275-9a94-df46852eeb39-ovnkube-config\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.565839 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565579 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e17f75b8-ee10-4328-bb53-f83b188ad149-original-pull-secret\") pod \"global-pull-secret-syncer-fwzx9\" (UID: \"e17f75b8-ee10-4328-bb53-f83b188ad149\") " pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:44:53.565839 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565598 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-log-socket\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.565839 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565648 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-var-lib-openvswitch\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.565839 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565667 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-host-run-ovn-kubernetes\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.565839 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565711 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.565839 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565743 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-host-run-ovn-kubernetes\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.565839 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565742 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-var-lib-openvswitch\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.565839 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565785 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xrjh\" (UniqueName: \"kubernetes.io/projected/d9bb01d7-7fed-4275-9a94-df46852eeb39-kube-api-access-4xrjh\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.565839 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565788 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.565839 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565844 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-host-kubelet\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.566455 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565860 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-run-ovn\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.566455 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565884 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-systemd-units\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.566455 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565911 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-run-systemd\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.566455 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:53.565919 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 18:44:53.566455 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565928 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e17f75b8-ee10-4328-bb53-f83b188ad149-dbus\") pod \"global-pull-secret-syncer-fwzx9\" (UID: \"e17f75b8-ee10-4328-bb53-f83b188ad149\") " pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:44:53.566455 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565944 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxgp4\" (UniqueName: \"kubernetes.io/projected/1d89553d-8d41-4909-9b1e-4bb03803e1ec-kube-api-access-zxgp4\") pod \"iptables-alerter-zzg9j\" (UID: \"1d89553d-8d41-4909-9b1e-4bb03803e1ec\") " pod="openshift-network-operator/iptables-alerter-zzg9j" Jul 17 18:44:53.566455 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565969 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-host-slash\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.566455 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565970 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1d89553d-8d41-4909-9b1e-4bb03803e1ec-iptables-alerter-script\") pod \"iptables-alerter-zzg9j\" (UID: \"1d89553d-8d41-4909-9b1e-4bb03803e1ec\") " pod="openshift-network-operator/iptables-alerter-zzg9j" Jul 17 18:44:53.566455 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.565989 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-host-cni-bin\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.566455 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.566006 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d9bb01d7-7fed-4275-9a94-df46852eeb39-ovn-node-metrics-cert\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.566455 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.566047 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-run-systemd\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.566455 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.566061 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d9bb01d7-7fed-4275-9a94-df46852eeb39-env-overrides\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.566455 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.566098 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-host-kubelet\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.566455 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:53.566096 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e17f75b8-ee10-4328-bb53-f83b188ad149-original-pull-secret podName:e17f75b8-ee10-4328-bb53-f83b188ad149 nodeName:}" failed. No retries permitted until 2026-07-17 18:44:54.066070178 +0000 UTC m=+3.097683033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e17f75b8-ee10-4328-bb53-f83b188ad149-original-pull-secret") pod "global-pull-secret-syncer-fwzx9" (UID: "e17f75b8-ee10-4328-bb53-f83b188ad149") : object "kube-system"/"original-pull-secret" not registered Jul 17 18:44:53.566455 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.566129 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-run-ovn\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.566455 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.566139 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-systemd-units\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.566455 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.566161 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d9bb01d7-7fed-4275-9a94-df46852eeb39-ovnkube-script-lib\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.567180 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.566192 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-host-cni-bin\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.567180 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.566194 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9bb01d7-7fed-4275-9a94-df46852eeb39-host-slash\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.567180 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.566286 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e17f75b8-ee10-4328-bb53-f83b188ad149-dbus\") pod \"global-pull-secret-syncer-fwzx9\" (UID: \"e17f75b8-ee10-4328-bb53-f83b188ad149\") " pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:44:53.567180 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.566675 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d9bb01d7-7fed-4275-9a94-df46852eeb39-ovnkube-config\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.567180 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.566771 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d9bb01d7-7fed-4275-9a94-df46852eeb39-ovnkube-script-lib\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.567600 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.567560 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/917437f2-fc59-467c-a077-d0f905356f21-agent-certs\") pod \"konnectivity-agent-7shq8\" (UID: \"917437f2-fc59-467c-a077-d0f905356f21\") " pod="kube-system/konnectivity-agent-7shq8" Jul 17 18:44:53.569851 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.569812 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d9bb01d7-7fed-4275-9a94-df46852eeb39-ovn-node-metrics-cert\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.585863 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:53.585842 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 18:44:53.585977 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:53.585864 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 18:44:53.585977 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:53.585886 2559 projected.go:196] Error preparing data for projected volume kube-api-access-nrxr6 for pod openshift-network-diagnostics/network-check-target-tpstx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:44:53.586069 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:53.586042 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6875c8e0-71a7-49b7-a799-5720b2f9b244-kube-api-access-nrxr6 podName:6875c8e0-71a7-49b7-a799-5720b2f9b244 nodeName:}" failed. No retries permitted until 2026-07-17 18:44:54.086018809 +0000 UTC m=+3.117631673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nrxr6" (UniqueName: "kubernetes.io/projected/6875c8e0-71a7-49b7-a799-5720b2f9b244-kube-api-access-nrxr6") pod "network-check-target-tpstx" (UID: "6875c8e0-71a7-49b7-a799-5720b2f9b244") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:44:53.587866 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.587847 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xrjh\" (UniqueName: \"kubernetes.io/projected/d9bb01d7-7fed-4275-9a94-df46852eeb39-kube-api-access-4xrjh\") pod \"ovnkube-node-jpl4k\" (UID: \"d9bb01d7-7fed-4275-9a94-df46852eeb39\") " pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.588195 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.588174 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbxw8\" (UniqueName: \"kubernetes.io/projected/7362711c-acf1-4dc6-ae17-c6bf043f12c7-kube-api-access-hbxw8\") pod \"network-metrics-daemon-l957z\" (UID: \"7362711c-acf1-4dc6-ae17-c6bf043f12c7\") " pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:44:53.592997 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.592977 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxgp4\" (UniqueName: \"kubernetes.io/projected/1d89553d-8d41-4909-9b1e-4bb03803e1ec-kube-api-access-zxgp4\") pod \"iptables-alerter-zzg9j\" (UID: \"1d89553d-8d41-4909-9b1e-4bb03803e1ec\") " pod="openshift-network-operator/iptables-alerter-zzg9j" Jul 17 18:44:53.651033 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.651003 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv" Jul 17 18:44:53.659423 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.659402 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" Jul 17 18:44:53.669163 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.669146 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sps5m" Jul 17 18:44:53.674701 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.674675 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7vqds" Jul 17 18:44:53.682390 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.682365 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v6ttl" Jul 17 18:44:53.688079 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.688058 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jgrm5" Jul 17 18:44:53.690071 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.690051 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 18:44:53.699163 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.699145 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zzg9j" Jul 17 18:44:53.707724 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.707706 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:44:53.712258 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:53.712244 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7shq8" Jul 17 18:44:54.069958 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:54.069926 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7362711c-acf1-4dc6-ae17-c6bf043f12c7-metrics-certs\") pod \"network-metrics-daemon-l957z\" (UID: \"7362711c-acf1-4dc6-ae17-c6bf043f12c7\") " pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:44:54.070095 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:54.069995 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e17f75b8-ee10-4328-bb53-f83b188ad149-original-pull-secret\") pod \"global-pull-secret-syncer-fwzx9\" (UID: \"e17f75b8-ee10-4328-bb53-f83b188ad149\") " pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:44:54.070095 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:54.070081 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 18:44:54.070189 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:54.070141 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e17f75b8-ee10-4328-bb53-f83b188ad149-original-pull-secret podName:e17f75b8-ee10-4328-bb53-f83b188ad149 nodeName:}" failed. No retries permitted until 2026-07-17 18:44:55.07012691 +0000 UTC m=+4.101739759 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e17f75b8-ee10-4328-bb53-f83b188ad149-original-pull-secret") pod "global-pull-secret-syncer-fwzx9" (UID: "e17f75b8-ee10-4328-bb53-f83b188ad149") : object "kube-system"/"original-pull-secret" not registered Jul 17 18:44:54.070189 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:54.070082 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:44:54.070275 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:54.070217 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7362711c-acf1-4dc6-ae17-c6bf043f12c7-metrics-certs podName:7362711c-acf1-4dc6-ae17-c6bf043f12c7 nodeName:}" failed. No retries permitted until 2026-07-17 18:44:55.070199458 +0000 UTC m=+4.101812320 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7362711c-acf1-4dc6-ae17-c6bf043f12c7-metrics-certs") pod "network-metrics-daemon-l957z" (UID: "7362711c-acf1-4dc6-ae17-c6bf043f12c7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:44:54.170581 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:54.170548 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrxr6\" (UniqueName: \"kubernetes.io/projected/6875c8e0-71a7-49b7-a799-5720b2f9b244-kube-api-access-nrxr6\") pod \"network-check-target-tpstx\" (UID: \"6875c8e0-71a7-49b7-a799-5720b2f9b244\") " pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:44:54.170751 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:54.170685 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 18:44:54.170751 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:54.170706 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 18:44:54.170751 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:54.170715 2559 projected.go:196] Error preparing data for projected volume kube-api-access-nrxr6 for pod openshift-network-diagnostics/network-check-target-tpstx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:44:54.170901 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:54.170762 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6875c8e0-71a7-49b7-a799-5720b2f9b244-kube-api-access-nrxr6 podName:6875c8e0-71a7-49b7-a799-5720b2f9b244 nodeName:}" failed. No retries permitted until 2026-07-17 18:44:55.17074838 +0000 UTC m=+4.202361232 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nrxr6" (UniqueName: "kubernetes.io/projected/6875c8e0-71a7-49b7-a799-5720b2f9b244-kube-api-access-nrxr6") pod "network-check-target-tpstx" (UID: "6875c8e0-71a7-49b7-a799-5720b2f9b244") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:44:54.384614 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:54.384587 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d27024b_f44e_4530_af19_cff3ed46fe13.slice/crio-235cb1f1db3ed8c21912aa1deee140a999a440a0f108c76e0e9e12400708f5be WatchSource:0}: Error finding container 235cb1f1db3ed8c21912aa1deee140a999a440a0f108c76e0e9e12400708f5be: Status 404 returned error can't find the container with id 235cb1f1db3ed8c21912aa1deee140a999a440a0f108c76e0e9e12400708f5be Jul 17 18:44:54.386501 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:54.386474 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9bb01d7_7fed_4275_9a94_df46852eeb39.slice/crio-e8726b43f6b5cd7c40ac8ee7f5aa8748da986a2c4508b224c54804f74fe01fc7 WatchSource:0}: Error finding container e8726b43f6b5cd7c40ac8ee7f5aa8748da986a2c4508b224c54804f74fe01fc7: Status 404 returned error can't find the container with id e8726b43f6b5cd7c40ac8ee7f5aa8748da986a2c4508b224c54804f74fe01fc7 Jul 17 18:44:54.389560 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:54.389488 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod071af57d_fffa_4c23_8505_329bba791a74.slice/crio-c008875ca7519ff624f3ef44fdfae730c0be42f32b6b60bd62e1aa03c12942e1 WatchSource:0}: Error finding container c008875ca7519ff624f3ef44fdfae730c0be42f32b6b60bd62e1aa03c12942e1: Status 404 returned error can't find the container with id c008875ca7519ff624f3ef44fdfae730c0be42f32b6b60bd62e1aa03c12942e1 Jul 17 18:44:54.390153 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:54.390131 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod917437f2_fc59_467c_a077_d0f905356f21.slice/crio-45c771d8b462aaa9ca39ced5d728765f3b61d780383e4fe15dcef83c41fd84ee WatchSource:0}: Error finding container 45c771d8b462aaa9ca39ced5d728765f3b61d780383e4fe15dcef83c41fd84ee: Status 404 returned error can't find the container with id 45c771d8b462aaa9ca39ced5d728765f3b61d780383e4fe15dcef83c41fd84ee Jul 17 18:44:54.390999 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:54.390975 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod021237e7_89fc_4f95_a71e_ba92f8d9b743.slice/crio-e723b8f18b51ef225efef803fcb17dd3e4984bb39d57f218e9f4b4e3b048f355 WatchSource:0}: Error finding container e723b8f18b51ef225efef803fcb17dd3e4984bb39d57f218e9f4b4e3b048f355: Status 404 returned error can't find the container with id e723b8f18b51ef225efef803fcb17dd3e4984bb39d57f218e9f4b4e3b048f355 Jul 17 18:44:54.391781 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:54.391759 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7d97951_9dd3_466c_9d91_6d2bf2930d40.slice/crio-2e1722786a4010e51e99074caefe0de4d7e3689cf5b548479cf37a1e79b6d122 WatchSource:0}: Error finding container 2e1722786a4010e51e99074caefe0de4d7e3689cf5b548479cf37a1e79b6d122: Status 404 returned error can't find the container with id 2e1722786a4010e51e99074caefe0de4d7e3689cf5b548479cf37a1e79b6d122 Jul 17 18:44:54.392473 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:54.392344 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d89553d_8d41_4909_9b1e_4bb03803e1ec.slice/crio-d69bb9278b5e85dcdf5343e49bb77828c616184904068c4f5f2b719e6ea2a265 WatchSource:0}: Error finding container d69bb9278b5e85dcdf5343e49bb77828c616184904068c4f5f2b719e6ea2a265: Status 404 returned error can't find the container with id d69bb9278b5e85dcdf5343e49bb77828c616184904068c4f5f2b719e6ea2a265 Jul 17 18:44:54.393834 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:44:54.393658 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b17e270_da8c_4293_b8e5_952a51cb976a.slice/crio-7fc5231c808bbca6adc595911d0a8d8d06baa2597dc8fe31f7b90a7f703e3259 WatchSource:0}: Error finding container 7fc5231c808bbca6adc595911d0a8d8d06baa2597dc8fe31f7b90a7f703e3259: Status 404 returned error can't find the container with id 7fc5231c808bbca6adc595911d0a8d8d06baa2597dc8fe31f7b90a7f703e3259 Jul 17 18:44:54.408699 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:54.408518 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 18:39:53 +0000 UTC" deadline="2028-03-05 04:31:37.057339031 +0000 UTC" Jul 17 18:44:54.408699 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:54.408699 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14313h46m42.648643232s" Jul 17 18:44:54.482204 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:54.482182 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:44:54.482336 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:54.482274 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwzx9" podUID="e17f75b8-ee10-4328-bb53-f83b188ad149" Jul 17 18:44:54.490976 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:54.490952 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-36.ec2.internal" event={"ID":"17cbee2f05534142fef47f5b2283ef20","Type":"ContainerStarted","Data":"a75c7b9b1ba53fb38ce14e5fa6e0d7d462d29b3ec3c5e2016161d8d93148a642"} Jul 17 18:44:54.492045 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:54.492025 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" event={"ID":"206baf76-6cdb-441f-a6ae-97fd64eb5ddc","Type":"ContainerStarted","Data":"4d972882a2db3361f5e35a758119d2af5bcc22cc4be31d5afd65eaee772cfdef"} Jul 17 18:44:54.493006 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:54.492983 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v6ttl" event={"ID":"8b17e270-da8c-4293-b8e5-952a51cb976a","Type":"ContainerStarted","Data":"7fc5231c808bbca6adc595911d0a8d8d06baa2597dc8fe31f7b90a7f703e3259"} Jul 17 18:44:54.494099 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:54.494081 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jgrm5" event={"ID":"d7d97951-9dd3-466c-9d91-6d2bf2930d40","Type":"ContainerStarted","Data":"2e1722786a4010e51e99074caefe0de4d7e3689cf5b548479cf37a1e79b6d122"} Jul 17 18:44:54.495090 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:54.495070 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sps5m" event={"ID":"071af57d-fffa-4c23-8505-329bba791a74","Type":"ContainerStarted","Data":"c008875ca7519ff624f3ef44fdfae730c0be42f32b6b60bd62e1aa03c12942e1"} Jul 17 18:44:54.496109 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:54.496091 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" event={"ID":"d9bb01d7-7fed-4275-9a94-df46852eeb39","Type":"ContainerStarted","Data":"e8726b43f6b5cd7c40ac8ee7f5aa8748da986a2c4508b224c54804f74fe01fc7"} Jul 17 18:44:54.497118 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:54.497100 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv" event={"ID":"5d27024b-f44e-4530-af19-cff3ed46fe13","Type":"ContainerStarted","Data":"235cb1f1db3ed8c21912aa1deee140a999a440a0f108c76e0e9e12400708f5be"} Jul 17 18:44:54.498129 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:54.498111 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zzg9j" event={"ID":"1d89553d-8d41-4909-9b1e-4bb03803e1ec","Type":"ContainerStarted","Data":"d69bb9278b5e85dcdf5343e49bb77828c616184904068c4f5f2b719e6ea2a265"} Jul 17 18:44:54.499388 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:54.499372 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7vqds" event={"ID":"021237e7-89fc-4f95-a71e-ba92f8d9b743","Type":"ContainerStarted","Data":"e723b8f18b51ef225efef803fcb17dd3e4984bb39d57f218e9f4b4e3b048f355"} Jul 17 18:44:54.500240 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:54.500224 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7shq8" event={"ID":"917437f2-fc59-467c-a077-d0f905356f21","Type":"ContainerStarted","Data":"45c771d8b462aaa9ca39ced5d728765f3b61d780383e4fe15dcef83c41fd84ee"} Jul 17 18:44:54.512343 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:54.512262 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-36.ec2.internal" podStartSLOduration=1.512246454 podStartE2EDuration="1.512246454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:44:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:44:54.511659844 +0000 UTC m=+3.543272708" watchObservedRunningTime="2026-07-17 18:44:54.512246454 +0000 UTC m=+3.543859321" Jul 17 18:44:55.076819 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:55.076100 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e17f75b8-ee10-4328-bb53-f83b188ad149-original-pull-secret\") pod \"global-pull-secret-syncer-fwzx9\" (UID: \"e17f75b8-ee10-4328-bb53-f83b188ad149\") " pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:44:55.076819 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:55.076176 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7362711c-acf1-4dc6-ae17-c6bf043f12c7-metrics-certs\") pod \"network-metrics-daemon-l957z\" (UID: \"7362711c-acf1-4dc6-ae17-c6bf043f12c7\") " pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:44:55.076819 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:55.076293 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:44:55.076819 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:55.076365 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7362711c-acf1-4dc6-ae17-c6bf043f12c7-metrics-certs podName:7362711c-acf1-4dc6-ae17-c6bf043f12c7 nodeName:}" failed. No retries permitted until 2026-07-17 18:44:57.076348365 +0000 UTC m=+6.107961217 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7362711c-acf1-4dc6-ae17-c6bf043f12c7-metrics-certs") pod "network-metrics-daemon-l957z" (UID: "7362711c-acf1-4dc6-ae17-c6bf043f12c7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:44:55.076819 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:55.076431 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 18:44:55.076819 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:55.076464 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e17f75b8-ee10-4328-bb53-f83b188ad149-original-pull-secret podName:e17f75b8-ee10-4328-bb53-f83b188ad149 nodeName:}" failed. No retries permitted until 2026-07-17 18:44:57.076453501 +0000 UTC m=+6.108066353 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e17f75b8-ee10-4328-bb53-f83b188ad149-original-pull-secret") pod "global-pull-secret-syncer-fwzx9" (UID: "e17f75b8-ee10-4328-bb53-f83b188ad149") : object "kube-system"/"original-pull-secret" not registered Jul 17 18:44:55.176696 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:55.176660 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrxr6\" (UniqueName: \"kubernetes.io/projected/6875c8e0-71a7-49b7-a799-5720b2f9b244-kube-api-access-nrxr6\") pod \"network-check-target-tpstx\" (UID: \"6875c8e0-71a7-49b7-a799-5720b2f9b244\") " pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:44:55.176873 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:55.176837 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 18:44:55.176873 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:55.176856 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 18:44:55.176873 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:55.176866 2559 projected.go:196] Error preparing data for projected volume kube-api-access-nrxr6 for pod openshift-network-diagnostics/network-check-target-tpstx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:44:55.177020 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:55.176923 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6875c8e0-71a7-49b7-a799-5720b2f9b244-kube-api-access-nrxr6 podName:6875c8e0-71a7-49b7-a799-5720b2f9b244 nodeName:}" failed. No retries permitted until 2026-07-17 18:44:57.176905269 +0000 UTC m=+6.208518123 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nrxr6" (UniqueName: "kubernetes.io/projected/6875c8e0-71a7-49b7-a799-5720b2f9b244-kube-api-access-nrxr6") pod "network-check-target-tpstx" (UID: "6875c8e0-71a7-49b7-a799-5720b2f9b244") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:44:55.409680 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:55.409521 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 18:39:53 +0000 UTC" deadline="2028-03-31 22:16:49.630754942 +0000 UTC" Jul 17 18:44:55.409680 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:55.409577 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14955h31m54.221181626s" Jul 17 18:44:55.483590 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:55.482677 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:44:55.483590 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:55.482816 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l957z" podUID="7362711c-acf1-4dc6-ae17-c6bf043f12c7" Jul 17 18:44:55.483590 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:55.483394 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:44:55.483590 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:55.483490 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tpstx" podUID="6875c8e0-71a7-49b7-a799-5720b2f9b244" Jul 17 18:44:55.519415 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:55.519381 2559 generic.go:356] "Generic (PLEG): container finished" podID="0b5419f7cb1e64a2ab16d7fe91c43a1c" containerID="98bcf5ce2d72ddcf1146af590e9dbb37ee042a659dd99849cea8eadb3a81aeef" exitCode=0 Jul 17 18:44:55.519577 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:55.519520 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal" event={"ID":"0b5419f7cb1e64a2ab16d7fe91c43a1c","Type":"ContainerDied","Data":"98bcf5ce2d72ddcf1146af590e9dbb37ee042a659dd99849cea8eadb3a81aeef"} Jul 17 18:44:56.481983 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:56.481949 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:44:56.482527 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:56.482080 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwzx9" podUID="e17f75b8-ee10-4328-bb53-f83b188ad149" Jul 17 18:44:56.560598 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:56.560564 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal" event={"ID":"0b5419f7cb1e64a2ab16d7fe91c43a1c","Type":"ContainerStarted","Data":"44ea14fc918164cbec37d71cb5357bcc75f4b756d994dd7579d46884d606d2ef"} Jul 17 18:44:56.576998 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:56.576949 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-36.ec2.internal" podStartSLOduration=3.5769302339999998 podStartE2EDuration="3.576930234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:44:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:44:56.576542044 +0000 UTC m=+5.608154915" watchObservedRunningTime="2026-07-17 18:44:56.576930234 +0000 UTC m=+5.608543104" Jul 17 18:44:57.099559 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:57.099509 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e17f75b8-ee10-4328-bb53-f83b188ad149-original-pull-secret\") pod \"global-pull-secret-syncer-fwzx9\" (UID: \"e17f75b8-ee10-4328-bb53-f83b188ad149\") " pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:44:57.099760 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:57.099607 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7362711c-acf1-4dc6-ae17-c6bf043f12c7-metrics-certs\") pod \"network-metrics-daemon-l957z\" (UID: \"7362711c-acf1-4dc6-ae17-c6bf043f12c7\") " pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:44:57.099816 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:57.099770 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:44:57.099850 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:57.099833 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7362711c-acf1-4dc6-ae17-c6bf043f12c7-metrics-certs podName:7362711c-acf1-4dc6-ae17-c6bf043f12c7 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:01.099814894 +0000 UTC m=+10.131427757 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7362711c-acf1-4dc6-ae17-c6bf043f12c7-metrics-certs") pod "network-metrics-daemon-l957z" (UID: "7362711c-acf1-4dc6-ae17-c6bf043f12c7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:44:57.100263 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:57.100241 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 18:44:57.100391 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:57.100299 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e17f75b8-ee10-4328-bb53-f83b188ad149-original-pull-secret podName:e17f75b8-ee10-4328-bb53-f83b188ad149 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:01.100283866 +0000 UTC m=+10.131896716 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e17f75b8-ee10-4328-bb53-f83b188ad149-original-pull-secret") pod "global-pull-secret-syncer-fwzx9" (UID: "e17f75b8-ee10-4328-bb53-f83b188ad149") : object "kube-system"/"original-pull-secret" not registered Jul 17 18:44:57.200842 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:57.200208 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrxr6\" (UniqueName: \"kubernetes.io/projected/6875c8e0-71a7-49b7-a799-5720b2f9b244-kube-api-access-nrxr6\") pod \"network-check-target-tpstx\" (UID: \"6875c8e0-71a7-49b7-a799-5720b2f9b244\") " pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:44:57.200842 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:57.200412 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 18:44:57.200842 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:57.200432 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 18:44:57.200842 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:57.200445 2559 projected.go:196] Error preparing data for projected volume kube-api-access-nrxr6 for pod openshift-network-diagnostics/network-check-target-tpstx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:44:57.200842 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:57.200501 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6875c8e0-71a7-49b7-a799-5720b2f9b244-kube-api-access-nrxr6 podName:6875c8e0-71a7-49b7-a799-5720b2f9b244 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:01.200483513 +0000 UTC m=+10.232096381 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nrxr6" (UniqueName: "kubernetes.io/projected/6875c8e0-71a7-49b7-a799-5720b2f9b244-kube-api-access-nrxr6") pod "network-check-target-tpstx" (UID: "6875c8e0-71a7-49b7-a799-5720b2f9b244") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:44:57.483504 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:57.483414 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:44:57.483945 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:57.483428 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:44:57.483945 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:57.483550 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l957z" podUID="7362711c-acf1-4dc6-ae17-c6bf043f12c7" Jul 17 18:44:57.483945 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:57.483633 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tpstx" podUID="6875c8e0-71a7-49b7-a799-5720b2f9b244" Jul 17 18:44:58.481967 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:58.481938 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:44:58.482151 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:58.482082 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwzx9" podUID="e17f75b8-ee10-4328-bb53-f83b188ad149" Jul 17 18:44:59.481953 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:59.481895 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:44:59.481953 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:44:59.481940 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:44:59.482511 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:59.482137 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l957z" podUID="7362711c-acf1-4dc6-ae17-c6bf043f12c7" Jul 17 18:44:59.482511 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:44:59.482269 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tpstx" podUID="6875c8e0-71a7-49b7-a799-5720b2f9b244" Jul 17 18:45:00.482385 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:00.482344 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:45:00.482789 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:00.482485 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwzx9" podUID="e17f75b8-ee10-4328-bb53-f83b188ad149" Jul 17 18:45:01.132754 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:01.132716 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7362711c-acf1-4dc6-ae17-c6bf043f12c7-metrics-certs\") pod \"network-metrics-daemon-l957z\" (UID: \"7362711c-acf1-4dc6-ae17-c6bf043f12c7\") " pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:45:01.132947 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:01.132793 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e17f75b8-ee10-4328-bb53-f83b188ad149-original-pull-secret\") pod \"global-pull-secret-syncer-fwzx9\" (UID: \"e17f75b8-ee10-4328-bb53-f83b188ad149\") " pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:45:01.132947 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:01.132871 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:45:01.132947 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:01.132927 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 18:45:01.133104 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:01.132929 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7362711c-acf1-4dc6-ae17-c6bf043f12c7-metrics-certs podName:7362711c-acf1-4dc6-ae17-c6bf043f12c7 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:09.132914527 +0000 UTC m=+18.164527378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7362711c-acf1-4dc6-ae17-c6bf043f12c7-metrics-certs") pod "network-metrics-daemon-l957z" (UID: "7362711c-acf1-4dc6-ae17-c6bf043f12c7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:45:01.133104 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:01.132980 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e17f75b8-ee10-4328-bb53-f83b188ad149-original-pull-secret podName:e17f75b8-ee10-4328-bb53-f83b188ad149 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:09.132965362 +0000 UTC m=+18.164578213 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e17f75b8-ee10-4328-bb53-f83b188ad149-original-pull-secret") pod "global-pull-secret-syncer-fwzx9" (UID: "e17f75b8-ee10-4328-bb53-f83b188ad149") : object "kube-system"/"original-pull-secret" not registered Jul 17 18:45:01.234082 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:01.234034 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrxr6\" (UniqueName: \"kubernetes.io/projected/6875c8e0-71a7-49b7-a799-5720b2f9b244-kube-api-access-nrxr6\") pod \"network-check-target-tpstx\" (UID: \"6875c8e0-71a7-49b7-a799-5720b2f9b244\") " pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:45:01.234265 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:01.234241 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 18:45:01.234265 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:01.234261 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 18:45:01.234390 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:01.234274 2559 projected.go:196] Error preparing data for projected volume kube-api-access-nrxr6 for pod openshift-network-diagnostics/network-check-target-tpstx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:45:01.234390 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:01.234345 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6875c8e0-71a7-49b7-a799-5720b2f9b244-kube-api-access-nrxr6 podName:6875c8e0-71a7-49b7-a799-5720b2f9b244 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:09.234328454 +0000 UTC m=+18.265941307 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nrxr6" (UniqueName: "kubernetes.io/projected/6875c8e0-71a7-49b7-a799-5720b2f9b244-kube-api-access-nrxr6") pod "network-check-target-tpstx" (UID: "6875c8e0-71a7-49b7-a799-5720b2f9b244") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:45:01.482485 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:01.482406 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:45:01.482884 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:01.482578 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l957z" podUID="7362711c-acf1-4dc6-ae17-c6bf043f12c7" Jul 17 18:45:01.482884 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:01.482636 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:45:01.482884 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:01.482749 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tpstx" podUID="6875c8e0-71a7-49b7-a799-5720b2f9b244" Jul 17 18:45:02.481450 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:02.481412 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:45:02.481642 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:02.481544 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwzx9" podUID="e17f75b8-ee10-4328-bb53-f83b188ad149" Jul 17 18:45:03.485099 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:03.485065 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:45:03.485522 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:03.485159 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:45:03.485522 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:03.485185 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tpstx" podUID="6875c8e0-71a7-49b7-a799-5720b2f9b244" Jul 17 18:45:03.485522 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:03.485278 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l957z" podUID="7362711c-acf1-4dc6-ae17-c6bf043f12c7" Jul 17 18:45:04.481985 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:04.481506 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:45:04.481985 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:04.481634 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwzx9" podUID="e17f75b8-ee10-4328-bb53-f83b188ad149" Jul 17 18:45:05.484945 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:05.484916 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:45:05.485362 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:05.484924 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:45:05.485362 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:05.485019 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tpstx" podUID="6875c8e0-71a7-49b7-a799-5720b2f9b244" Jul 17 18:45:05.485362 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:05.485110 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l957z" podUID="7362711c-acf1-4dc6-ae17-c6bf043f12c7" Jul 17 18:45:06.482025 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:06.481988 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:45:06.482205 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:06.482118 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwzx9" podUID="e17f75b8-ee10-4328-bb53-f83b188ad149" Jul 17 18:45:07.485234 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:07.485207 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:45:07.485701 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:07.485210 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:45:07.485701 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:07.485348 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tpstx" podUID="6875c8e0-71a7-49b7-a799-5720b2f9b244" Jul 17 18:45:07.485701 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:07.485446 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l957z" podUID="7362711c-acf1-4dc6-ae17-c6bf043f12c7" Jul 17 18:45:08.481624 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:08.481592 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:45:08.481814 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:08.481697 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwzx9" podUID="e17f75b8-ee10-4328-bb53-f83b188ad149" Jul 17 18:45:09.191429 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:09.191338 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7362711c-acf1-4dc6-ae17-c6bf043f12c7-metrics-certs\") pod \"network-metrics-daemon-l957z\" (UID: \"7362711c-acf1-4dc6-ae17-c6bf043f12c7\") " pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:45:09.191429 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:09.191415 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e17f75b8-ee10-4328-bb53-f83b188ad149-original-pull-secret\") pod \"global-pull-secret-syncer-fwzx9\" (UID: \"e17f75b8-ee10-4328-bb53-f83b188ad149\") " pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:45:09.191928 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:09.191510 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:45:09.191928 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:09.191528 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 18:45:09.191928 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:09.191599 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7362711c-acf1-4dc6-ae17-c6bf043f12c7-metrics-certs podName:7362711c-acf1-4dc6-ae17-c6bf043f12c7 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:25.191570954 +0000 UTC m=+34.223183817 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7362711c-acf1-4dc6-ae17-c6bf043f12c7-metrics-certs") pod "network-metrics-daemon-l957z" (UID: "7362711c-acf1-4dc6-ae17-c6bf043f12c7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:45:09.191928 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:09.191622 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e17f75b8-ee10-4328-bb53-f83b188ad149-original-pull-secret podName:e17f75b8-ee10-4328-bb53-f83b188ad149 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:25.191612688 +0000 UTC m=+34.223225545 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e17f75b8-ee10-4328-bb53-f83b188ad149-original-pull-secret") pod "global-pull-secret-syncer-fwzx9" (UID: "e17f75b8-ee10-4328-bb53-f83b188ad149") : object "kube-system"/"original-pull-secret" not registered Jul 17 18:45:09.292270 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:09.292227 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrxr6\" (UniqueName: \"kubernetes.io/projected/6875c8e0-71a7-49b7-a799-5720b2f9b244-kube-api-access-nrxr6\") pod \"network-check-target-tpstx\" (UID: \"6875c8e0-71a7-49b7-a799-5720b2f9b244\") " pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:45:09.292445 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:09.292416 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 18:45:09.292445 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:09.292439 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 18:45:09.292520 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:09.292448 2559 projected.go:196] Error preparing data for projected volume kube-api-access-nrxr6 for pod openshift-network-diagnostics/network-check-target-tpstx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:45:09.292520 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:09.292499 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6875c8e0-71a7-49b7-a799-5720b2f9b244-kube-api-access-nrxr6 podName:6875c8e0-71a7-49b7-a799-5720b2f9b244 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:25.292486792 +0000 UTC m=+34.324099643 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nrxr6" (UniqueName: "kubernetes.io/projected/6875c8e0-71a7-49b7-a799-5720b2f9b244-kube-api-access-nrxr6") pod "network-check-target-tpstx" (UID: "6875c8e0-71a7-49b7-a799-5720b2f9b244") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:45:09.484649 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:09.484566 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:45:09.484649 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:09.484631 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:45:09.484861 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:09.484724 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l957z" podUID="7362711c-acf1-4dc6-ae17-c6bf043f12c7" Jul 17 18:45:09.484861 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:09.484795 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tpstx" podUID="6875c8e0-71a7-49b7-a799-5720b2f9b244" Jul 17 18:45:10.481746 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:10.481711 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:45:10.482221 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:10.481826 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwzx9" podUID="e17f75b8-ee10-4328-bb53-f83b188ad149" Jul 17 18:45:11.484753 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:11.484723 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:45:11.485171 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:11.484836 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tpstx" podUID="6875c8e0-71a7-49b7-a799-5720b2f9b244" Jul 17 18:45:11.485171 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:11.484894 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:45:11.485171 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:11.484997 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l957z" podUID="7362711c-acf1-4dc6-ae17-c6bf043f12c7" Jul 17 18:45:12.482777 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:12.482266 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:45:12.482777 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:12.482417 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwzx9" podUID="e17f75b8-ee10-4328-bb53-f83b188ad149" Jul 17 18:45:13.482013 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:13.481980 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:45:13.482013 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:13.482014 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:45:13.482545 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:13.482134 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l957z" podUID="7362711c-acf1-4dc6-ae17-c6bf043f12c7" Jul 17 18:45:13.482653 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:13.482600 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tpstx" podUID="6875c8e0-71a7-49b7-a799-5720b2f9b244" Jul 17 18:45:14.481980 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:14.481625 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:45:14.482123 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:14.482016 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwzx9" podUID="e17f75b8-ee10-4328-bb53-f83b188ad149" Jul 17 18:45:14.596468 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:14.596420 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7vqds" event={"ID":"021237e7-89fc-4f95-a71e-ba92f8d9b743","Type":"ContainerStarted","Data":"d7d97fab853762f224d2e2b2b89d94518e7c1dc36a6034bdf61ad00978318693"} Jul 17 18:45:14.598005 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:14.597976 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7shq8" event={"ID":"917437f2-fc59-467c-a077-d0f905356f21","Type":"ContainerStarted","Data":"d9b1eff0ef8c48a86a8c6d7a82621bc5c28f956c9042d5be904c61ccacecb5fd"} Jul 17 18:45:14.599525 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:14.599498 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" event={"ID":"206baf76-6cdb-441f-a6ae-97fd64eb5ddc","Type":"ContainerStarted","Data":"e01f79f21a62892dd81ee59ebc034dca4358d8016af102ce0c1720808127cd5a"} Jul 17 18:45:14.601103 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:14.601068 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v6ttl" event={"ID":"8b17e270-da8c-4293-b8e5-952a51cb976a","Type":"ContainerStarted","Data":"6b07415b3f6a2a038d53b3f1bf1106e6a36ca35aad2b25bb4d79eb6e564d06c0"} Jul 17 18:45:14.602780 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:14.602750 2559 generic.go:356] "Generic (PLEG): container finished" podID="d7d97951-9dd3-466c-9d91-6d2bf2930d40" containerID="35d2b2cbb9baa89f878ec563d77cff0479952bada77b3da470b2de2984c95801" exitCode=0 Jul 17 18:45:14.602896 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:14.602826 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jgrm5" event={"ID":"d7d97951-9dd3-466c-9d91-6d2bf2930d40","Type":"ContainerDied","Data":"35d2b2cbb9baa89f878ec563d77cff0479952bada77b3da470b2de2984c95801"} Jul 17 18:45:14.604390 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:14.604339 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sps5m" event={"ID":"071af57d-fffa-4c23-8505-329bba791a74","Type":"ContainerStarted","Data":"be6a51740176671cadd70ae0167a8d1e94b3a5acdf055f64f64b1747d5f12cf5"} Jul 17 18:45:14.607327 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:14.607291 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jpl4k_d9bb01d7-7fed-4275-9a94-df46852eeb39/ovn-acl-logging/0.log" Jul 17 18:45:14.607669 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:14.607649 2559 generic.go:356] "Generic (PLEG): container finished" podID="d9bb01d7-7fed-4275-9a94-df46852eeb39" containerID="234e964103c95bb1cccd7c0ec35d65475e6d92dbfd98bd2bcd960c7fe58da4bd" exitCode=1 Jul 17 18:45:14.607750 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:14.607710 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" event={"ID":"d9bb01d7-7fed-4275-9a94-df46852eeb39","Type":"ContainerStarted","Data":"e42b7d3e618310ea9d48dcbe2d5e0743eeba1420c32f6611237b3e19b1b9bb8e"} Jul 17 18:45:14.607792 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:14.607766 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" event={"ID":"d9bb01d7-7fed-4275-9a94-df46852eeb39","Type":"ContainerStarted","Data":"0624b9afadc486c4fef39deee9f540fa11e2f158a7176b84381d3353f9ea76db"} Jul 17 18:45:14.607834 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:14.607815 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" event={"ID":"d9bb01d7-7fed-4275-9a94-df46852eeb39","Type":"ContainerStarted","Data":"e2483650dc04d344da03ca2322894ed2d0428e496c99e375982f887bc0a729b9"} Jul 17 18:45:14.607877 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:14.607861 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" event={"ID":"d9bb01d7-7fed-4275-9a94-df46852eeb39","Type":"ContainerStarted","Data":"bca8b39fc8799fb5d85046d4c12e081663e6c57556782d8c691897e55066c739"} Jul 17 18:45:14.607922 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:14.607907 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" event={"ID":"d9bb01d7-7fed-4275-9a94-df46852eeb39","Type":"ContainerDied","Data":"234e964103c95bb1cccd7c0ec35d65475e6d92dbfd98bd2bcd960c7fe58da4bd"} Jul 17 18:45:14.607975 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:14.607957 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" event={"ID":"d9bb01d7-7fed-4275-9a94-df46852eeb39","Type":"ContainerStarted","Data":"a765e5aeec1b08d14b3e40ea4b463e3c99778f375a856eec269cd7b52b6a5baa"} Jul 17 18:45:14.609089 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:14.609072 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv" event={"ID":"5d27024b-f44e-4530-af19-cff3ed46fe13","Type":"ContainerStarted","Data":"30ceeaa1f1df5112c63073b24fd34d9d2254d008e8eff27e5d48f6a540b09600"} Jul 17 18:45:14.617960 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:14.617918 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7vqds" podStartSLOduration=4.054235219 podStartE2EDuration="23.617902364s" totalImagesPullingTime="19.563667145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:44:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:45:14.617041503 +0000 UTC m=+23.648654376" watchObservedRunningTime="2026-07-17 18:45:14.617902364 +0000 UTC m=+23.649515242" Jul 17 18:45:14.634534 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:14.634479 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sps5m" podStartSLOduration=4.578138932 podStartE2EDuration="23.634461652s" totalImagesPullingTime="19.05632272s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:44:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:45:14.633509986 +0000 UTC m=+23.665122857" watchObservedRunningTime="2026-07-17 18:45:14.634461652 +0000 UTC m=+23.666074525" Jul 17 18:45:14.657897 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:14.657848 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v6ttl" podStartSLOduration=4.570005203 podStartE2EDuration="23.657830106s" totalImagesPullingTime="19.087824903s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:44:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:45:14.657008715 +0000 UTC m=+23.688621589" watchObservedRunningTime="2026-07-17 18:45:14.657830106 +0000 UTC m=+23.689442980" Jul 17 18:45:14.710689 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:14.710646 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wc2sl" podStartSLOduration=4.624593745 podStartE2EDuration="23.710630574s" totalImagesPullingTime="19.086036829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:44:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:45:14.710222566 +0000 UTC m=+23.741835439" watchObservedRunningTime="2026-07-17 18:45:14.710630574 +0000 UTC m=+23.742243447" Jul 17 18:45:14.731851 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:14.731800 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7shq8" podStartSLOduration=4.676652919 podStartE2EDuration="23.731783888s" totalImagesPullingTime="19.055130969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:44:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:45:14.731251075 +0000 UTC m=+23.762863960" watchObservedRunningTime="2026-07-17 18:45:14.731783888 +0000 UTC m=+23.763396758" Jul 17 18:45:14.773449 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:14.773370 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:14.857196 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:14.857161 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:15.111259 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:15.111235 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 17 18:45:15.220288 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:15.220257 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:15.325685 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:15.325609 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:15.431268 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:15.431177 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T18:45:15.11125513Z","UUID":"2a82883f-9101-4298-acdf-436a5e2f6027","Handler":null,"Name":"","Endpoint":""} Jul 17 18:45:15.432530 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:15.432508 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 17 18:45:15.432633 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:15.432538 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 17 18:45:15.481924 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:15.481889 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:45:15.481924 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:15.481889 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:45:15.482134 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:15.482012 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tpstx" podUID="6875c8e0-71a7-49b7-a799-5720b2f9b244" Jul 17 18:45:15.482438 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:15.482159 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l957z" podUID="7362711c-acf1-4dc6-ae17-c6bf043f12c7" Jul 17 18:45:15.613952 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:15.613836 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zzg9j" event={"ID":"1d89553d-8d41-4909-9b1e-4bb03803e1ec","Type":"ContainerStarted","Data":"cd68e687c83ddc3089c3ca236c489db4c9d8d6c59d3a2548532fb6321b4853cb"} Jul 17 18:45:15.615836 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:15.615807 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv" event={"ID":"5d27024b-f44e-4530-af19-cff3ed46fe13","Type":"ContainerStarted","Data":"e2575167a7a7f39e9d89347bf27cc69a47061797dc9cd0f555ef128916dc4b5c"} Jul 17 18:45:15.632194 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:15.632158 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zzg9j" podStartSLOduration=5.579047061 podStartE2EDuration="24.632146551s" totalImagesPullingTime="19.05309949s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:44:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:45:15.631937204 +0000 UTC m=+24.663550077" watchObservedRunningTime="2026-07-17 18:45:15.632146551 +0000 UTC m=+24.663759444" Jul 17 18:45:15.797549 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:15.797514 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:15.910887 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:15.910807 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:16.076133 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:16.076104 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:16.176287 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:16.176220 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:16.482673 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:16.482428 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:45:16.483044 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:16.482782 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwzx9" podUID="e17f75b8-ee10-4328-bb53-f83b188ad149" Jul 17 18:45:16.620546 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:16.620518 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jpl4k_d9bb01d7-7fed-4275-9a94-df46852eeb39/ovn-acl-logging/0.log" Jul 17 18:45:16.620916 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:16.620894 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" event={"ID":"d9bb01d7-7fed-4275-9a94-df46852eeb39","Type":"ContainerStarted","Data":"6d744ff6e1c9f2e7037e0a50ef301b96eee510368e3b78da1ed0d018c69ac296"} Jul 17 18:45:16.622899 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:16.622868 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv" event={"ID":"5d27024b-f44e-4530-af19-cff3ed46fe13","Type":"ContainerStarted","Data":"cc79b783984c7b6adcdbf87dd5ea66e4e9236e46250df9981017a8797d8b44b7"} Jul 17 18:45:17.157767 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:17.157734 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:17.270109 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:17.270072 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:17.481715 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:17.481633 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:45:17.481872 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:17.481636 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:45:17.481872 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:17.481765 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tpstx" podUID="6875c8e0-71a7-49b7-a799-5720b2f9b244" Jul 17 18:45:17.481872 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:17.481861 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l957z" podUID="7362711c-acf1-4dc6-ae17-c6bf043f12c7" Jul 17 18:45:18.482185 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:18.482155 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:45:18.482803 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:18.482290 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwzx9" podUID="e17f75b8-ee10-4328-bb53-f83b188ad149" Jul 17 18:45:19.420508 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:19.420474 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7shq8" Jul 17 18:45:19.421547 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:19.421528 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7shq8" Jul 17 18:45:19.439386 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:19.439332 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2rgv" podStartSLOduration=6.879872035 podStartE2EDuration="28.439298978s" totalImagesPullingTime="21.559426943s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:44:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:45:16.652446169 +0000 UTC m=+25.684059041" watchObservedRunningTime="2026-07-17 18:45:19.439298978 +0000 UTC m=+28.470911851" Jul 17 18:45:19.481775 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:19.481697 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:45:19.481908 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:19.481845 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l957z" podUID="7362711c-acf1-4dc6-ae17-c6bf043f12c7" Jul 17 18:45:19.481908 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:19.481896 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:45:19.482007 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:19.481989 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tpstx" podUID="6875c8e0-71a7-49b7-a799-5720b2f9b244" Jul 17 18:45:19.630197 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:19.630169 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7shq8" Jul 17 18:45:19.630792 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:19.630664 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7shq8" Jul 17 18:45:19.691838 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:19.691809 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:19.958233 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:19.958183 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:20.057712 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:20.057394 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:20.481441 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:20.481414 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:45:20.481566 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:20.481545 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwzx9" podUID="e17f75b8-ee10-4328-bb53-f83b188ad149" Jul 17 18:45:20.633438 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:20.633365 2559 generic.go:356] "Generic (PLEG): container finished" podID="d7d97951-9dd3-466c-9d91-6d2bf2930d40" containerID="0c7f7920d236e3e6f22b3b4f695632b2b2580253d4455e4896ae89535ea3b752" exitCode=0 Jul 17 18:45:20.633438 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:20.633407 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jgrm5" event={"ID":"d7d97951-9dd3-466c-9d91-6d2bf2930d40","Type":"ContainerDied","Data":"0c7f7920d236e3e6f22b3b4f695632b2b2580253d4455e4896ae89535ea3b752"} Jul 17 18:45:20.636915 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:20.636898 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jpl4k_d9bb01d7-7fed-4275-9a94-df46852eeb39/ovn-acl-logging/0.log" Jul 17 18:45:20.637298 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:20.637276 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" event={"ID":"d9bb01d7-7fed-4275-9a94-df46852eeb39","Type":"ContainerStarted","Data":"434f3137b74ebe95e0f9be9356a5b404ccdde52687f00fd9e1b119d647a0ae77"} Jul 17 18:45:20.637690 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:20.637672 2559 scope.go:117] "RemoveContainer" containerID="234e964103c95bb1cccd7c0ec35d65475e6d92dbfd98bd2bcd960c7fe58da4bd" Jul 17 18:45:21.482657 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:21.482625 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:45:21.482881 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:21.482728 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l957z" podUID="7362711c-acf1-4dc6-ae17-c6bf043f12c7" Jul 17 18:45:21.482881 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:21.482758 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:45:21.482881 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:21.482817 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tpstx" podUID="6875c8e0-71a7-49b7-a799-5720b2f9b244" Jul 17 18:45:21.643391 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:21.643364 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jpl4k_d9bb01d7-7fed-4275-9a94-df46852eeb39/ovn-acl-logging/0.log" Jul 17 18:45:21.643841 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:21.643705 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" event={"ID":"d9bb01d7-7fed-4275-9a94-df46852eeb39","Type":"ContainerStarted","Data":"868ede583993ac9d9bbd15533f3c53b25e657d241339e7a197af31ab471bd922"} Jul 17 18:45:21.644161 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:21.644133 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:45:21.644252 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:21.644219 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:45:21.644289 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:21.644271 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:45:21.660021 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:21.659990 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:45:21.660170 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:21.660105 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:45:21.676619 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:21.676573 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" podStartSLOduration=11.537675948 podStartE2EDuration="30.676560031s" totalImagesPullingTime="19.138884083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:44:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:45:21.675954069 +0000 UTC m=+30.707566942" watchObservedRunningTime="2026-07-17 18:45:21.676560031 +0000 UTC m=+30.708172913" Jul 17 18:45:21.956879 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:21.956650 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:22.048179 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:22.048129 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:22.151168 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:22.151087 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:22.478756 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:22.478682 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:22.481672 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:22.481652 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:45:22.481791 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:22.481745 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwzx9" podUID="e17f75b8-ee10-4328-bb53-f83b188ad149" Jul 17 18:45:22.492590 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:22.492569 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tpstx"] Jul 17 18:45:22.492699 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:22.492662 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:45:22.492755 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:22.492738 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tpstx" podUID="6875c8e0-71a7-49b7-a799-5720b2f9b244" Jul 17 18:45:22.496154 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:22.496126 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fwzx9"] Jul 17 18:45:22.496694 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:22.496671 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l957z"] Jul 17 18:45:22.496814 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:22.496776 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:45:22.496882 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:22.496862 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l957z" podUID="7362711c-acf1-4dc6-ae17-c6bf043f12c7" Jul 17 18:45:22.612587 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:22.612556 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:22.648331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:22.648285 2559 generic.go:356] "Generic (PLEG): container finished" podID="d7d97951-9dd3-466c-9d91-6d2bf2930d40" containerID="559a979f4d1a9cbc83efc17ce744b85d622015e588e24211a3b558162a99144f" exitCode=0 Jul 17 18:45:22.648811 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:22.648351 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jgrm5" event={"ID":"d7d97951-9dd3-466c-9d91-6d2bf2930d40","Type":"ContainerDied","Data":"559a979f4d1a9cbc83efc17ce744b85d622015e588e24211a3b558162a99144f"} Jul 17 18:45:22.648811 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:22.648507 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:45:22.648811 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:22.648611 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwzx9" podUID="e17f75b8-ee10-4328-bb53-f83b188ad149" Jul 17 18:45:22.967865 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:22.967835 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:23.037257 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:23.037222 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:23.245854 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:23.245783 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:23.364915 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:23.364886 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:23.511723 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:23.511645 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:23.614260 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:23.614221 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:23.806179 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:23.806110 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:23.880231 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:23.880179 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:24.482276 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:24.482182 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:45:24.482475 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:24.482286 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:45:24.482475 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:24.482290 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:45:24.482592 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:24.482287 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tpstx" podUID="6875c8e0-71a7-49b7-a799-5720b2f9b244" Jul 17 18:45:24.482592 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:24.482416 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l957z" podUID="7362711c-acf1-4dc6-ae17-c6bf043f12c7" Jul 17 18:45:24.482592 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:24.482499 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwzx9" podUID="e17f75b8-ee10-4328-bb53-f83b188ad149" Jul 17 18:45:24.654863 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:24.654832 2559 generic.go:356] "Generic (PLEG): container finished" podID="d7d97951-9dd3-466c-9d91-6d2bf2930d40" containerID="77dadde80c2cb7bab02c1b023e511b63b6af710e52f4280647b92e2b6d3df0e9" exitCode=0 Jul 17 18:45:24.654994 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:24.654905 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jgrm5" event={"ID":"d7d97951-9dd3-466c-9d91-6d2bf2930d40","Type":"ContainerDied","Data":"77dadde80c2cb7bab02c1b023e511b63b6af710e52f4280647b92e2b6d3df0e9"} Jul 17 18:45:25.020795 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:25.020768 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v6ttl_8b17e270-da8c-4293-b8e5-952a51cb976a/dns-node-resolver/0.log" Jul 17 18:45:25.206722 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:25.206688 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e17f75b8-ee10-4328-bb53-f83b188ad149-original-pull-secret\") pod \"global-pull-secret-syncer-fwzx9\" (UID: \"e17f75b8-ee10-4328-bb53-f83b188ad149\") " pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:45:25.206882 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:25.206745 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7362711c-acf1-4dc6-ae17-c6bf043f12c7-metrics-certs\") pod \"network-metrics-daemon-l957z\" (UID: \"7362711c-acf1-4dc6-ae17-c6bf043f12c7\") " pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:45:25.206882 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:25.206828 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:45:25.206882 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:25.206832 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 18:45:25.206981 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:25.206885 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7362711c-acf1-4dc6-ae17-c6bf043f12c7-metrics-certs podName:7362711c-acf1-4dc6-ae17-c6bf043f12c7 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:57.206865827 +0000 UTC m=+66.238478681 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7362711c-acf1-4dc6-ae17-c6bf043f12c7-metrics-certs") pod "network-metrics-daemon-l957z" (UID: "7362711c-acf1-4dc6-ae17-c6bf043f12c7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:45:25.206981 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:25.206898 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e17f75b8-ee10-4328-bb53-f83b188ad149-original-pull-secret podName:e17f75b8-ee10-4328-bb53-f83b188ad149 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:57.20689208 +0000 UTC m=+66.238504931 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e17f75b8-ee10-4328-bb53-f83b188ad149-original-pull-secret") pod "global-pull-secret-syncer-fwzx9" (UID: "e17f75b8-ee10-4328-bb53-f83b188ad149") : object "kube-system"/"original-pull-secret" not registered Jul 17 18:45:25.308029 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:25.307947 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrxr6\" (UniqueName: \"kubernetes.io/projected/6875c8e0-71a7-49b7-a799-5720b2f9b244-kube-api-access-nrxr6\") pod \"network-check-target-tpstx\" (UID: \"6875c8e0-71a7-49b7-a799-5720b2f9b244\") " pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:45:25.308172 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:25.308103 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 18:45:25.308172 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:25.308120 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 18:45:25.308172 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:25.308129 2559 projected.go:196] Error preparing data for projected volume kube-api-access-nrxr6 for pod openshift-network-diagnostics/network-check-target-tpstx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:45:25.308268 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:25.308176 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6875c8e0-71a7-49b7-a799-5720b2f9b244-kube-api-access-nrxr6 podName:6875c8e0-71a7-49b7-a799-5720b2f9b244 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:57.308162732 +0000 UTC m=+66.339775583 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nrxr6" (UniqueName: "kubernetes.io/projected/6875c8e0-71a7-49b7-a799-5720b2f9b244-kube-api-access-nrxr6") pod "network-check-target-tpstx" (UID: "6875c8e0-71a7-49b7-a799-5720b2f9b244") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:45:25.359562 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:25.359528 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:25.464900 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:25.464869 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:26.228271 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:26.228242 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sps5m_071af57d-fffa-4c23-8505-329bba791a74/node-ca/0.log" Jul 17 18:45:26.481613 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:26.481530 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:45:26.481613 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:26.481569 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:45:26.481812 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:26.481537 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:45:26.481812 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:26.481655 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwzx9" podUID="e17f75b8-ee10-4328-bb53-f83b188ad149" Jul 17 18:45:26.481812 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:26.481749 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tpstx" podUID="6875c8e0-71a7-49b7-a799-5720b2f9b244" Jul 17 18:45:26.481961 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:26.481817 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l957z" podUID="7362711c-acf1-4dc6-ae17-c6bf043f12c7" Jul 17 18:45:26.538976 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:26.538944 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:26.686498 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:26.686462 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:26.799351 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:26.799255 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-36.ec2.internal" event="NodeReady" Jul 17 18:45:26.799487 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:26.799403 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 17 18:45:28.482328 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:28.482288 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:45:28.482792 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:28.482303 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:45:28.482792 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:28.482435 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:45:28.487284 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:28.487003 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jqp7v\"" Jul 17 18:45:28.487284 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:28.487022 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 18:45:28.487284 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:28.487066 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 17 18:45:28.487284 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:28.487109 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 17 18:45:28.487284 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:28.487066 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ktbms\"" Jul 17 18:45:28.487284 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:28.487069 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 18:45:30.670695 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:30.670507 2559 generic.go:356] "Generic (PLEG): container finished" podID="d7d97951-9dd3-466c-9d91-6d2bf2930d40" containerID="704aa624f07a7dafa788e4908e2705bcdcdf1e82147e8f2481efdcd0deaba448" exitCode=0 Jul 17 18:45:30.670695 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:30.670578 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jgrm5" event={"ID":"d7d97951-9dd3-466c-9d91-6d2bf2930d40","Type":"ContainerDied","Data":"704aa624f07a7dafa788e4908e2705bcdcdf1e82147e8f2481efdcd0deaba448"} Jul 17 18:45:30.761833 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:30.761809 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:30.841965 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:30.841940 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:30.943122 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:30.943052 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:31.011196 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:31.011162 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:31.096077 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:31.096048 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:31.195624 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:31.195550 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:31.375170 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:31.375132 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:31.675417 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:31.675387 2559 generic.go:356] "Generic (PLEG): container finished" podID="d7d97951-9dd3-466c-9d91-6d2bf2930d40" containerID="293f60a6a3a17c627c8487043e64b1351651756402b6ba56619638e0d6d8ce06" exitCode=0 Jul 17 18:45:31.675816 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:31.675455 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jgrm5" event={"ID":"d7d97951-9dd3-466c-9d91-6d2bf2930d40","Type":"ContainerDied","Data":"293f60a6a3a17c627c8487043e64b1351651756402b6ba56619638e0d6d8ce06"} Jul 17 18:45:31.709439 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:31.709410 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:32.681071 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:32.681032 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jgrm5" event={"ID":"d7d97951-9dd3-466c-9d91-6d2bf2930d40","Type":"ContainerStarted","Data":"57d7e30a69596e28ae7593bd1f2a40cacf68c11650e6f443cf156f312129c261"} Jul 17 18:45:32.715838 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:32.715786 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jgrm5" podStartSLOduration=9.340185399 podStartE2EDuration="41.715768044s" totalImagesPullingTime="32.375582645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:44:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:45:32.714571796 +0000 UTC m=+41.746184669" watchObservedRunningTime="2026-07-17 18:45:32.715768044 +0000 UTC m=+41.747380918" Jul 17 18:45:32.729475 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:32.729445 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:32.916527 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:32.916490 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:33.304301 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:33.304273 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:33.529146 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:33.529113 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:33.891607 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:33.891577 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:34.300886 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:34.300806 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:34.415361 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:34.415331 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:34.516481 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:34.516422 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:35.096100 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:35.096069 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:35.292125 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:35.292097 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:35.393474 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:35.393400 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:35.697638 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:35.697565 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:35.896767 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:35.896736 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:36.103815 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:36.103789 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:37.023703 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:37.023674 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:37.126398 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:37.126368 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:37.498353 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:37.498303 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:37.700476 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:37.700441 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:37.892860 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:37.892831 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:38.084171 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:38.084140 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:38.185537 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:38.185458 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:38.285125 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:38.285097 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:38.350702 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:38.350669 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:39.090260 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:39.090224 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:39.487788 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:39.487689 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:39.694537 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:39.694506 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:39.893249 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:39.893202 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:40.219666 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:40.219587 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:40.889657 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:40.889628 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:41.101456 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:41.101423 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:41.297649 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:41.297560 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:46.133798 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.133766 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:46.248190 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.248160 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dtxvx"] Jul 17 18:45:46.250306 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.250290 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dtxvx" Jul 17 18:45:46.253625 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.253606 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 17 18:45:46.253738 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.253709 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 17 18:45:46.253781 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.253735 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 17 18:45:46.254421 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.254407 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 17 18:45:46.254489 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.254438 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-htzm6\"" Jul 17 18:45:46.265164 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.265140 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dtxvx"] Jul 17 18:45:46.280059 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.280039 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rf6rr"] Jul 17 18:45:46.282007 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.281988 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rf6rr" Jul 17 18:45:46.284410 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.284393 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 17 18:45:46.284410 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.284403 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 17 18:45:46.285242 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.285229 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2pjb8\"" Jul 17 18:45:46.285301 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.285231 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 17 18:45:46.286665 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.286645 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:46.305064 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.305041 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rf6rr"] Jul 17 18:45:46.354486 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.354451 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/76365ae7-632a-4639-84a0-f1bc2976a941-data-volume\") pod \"insights-runtime-extractor-dtxvx\" (UID: \"76365ae7-632a-4639-84a0-f1bc2976a941\") " pod="openshift-insights/insights-runtime-extractor-dtxvx" Jul 17 18:45:46.354486 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.354489 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/76365ae7-632a-4639-84a0-f1bc2976a941-crio-socket\") pod \"insights-runtime-extractor-dtxvx\" (UID: \"76365ae7-632a-4639-84a0-f1bc2976a941\") " pod="openshift-insights/insights-runtime-extractor-dtxvx" Jul 17 18:45:46.354698 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.354508 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76365ae7-632a-4639-84a0-f1bc2976a941-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dtxvx\" (UID: \"76365ae7-632a-4639-84a0-f1bc2976a941\") " pod="openshift-insights/insights-runtime-extractor-dtxvx" Jul 17 18:45:46.354698 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.354583 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76365ae7-632a-4639-84a0-f1bc2976a941-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dtxvx\" (UID: \"76365ae7-632a-4639-84a0-f1bc2976a941\") " pod="openshift-insights/insights-runtime-extractor-dtxvx" Jul 17 18:45:46.354698 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.354629 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r95jn\" (UniqueName: \"kubernetes.io/projected/76365ae7-632a-4639-84a0-f1bc2976a941-kube-api-access-r95jn\") pod \"insights-runtime-extractor-dtxvx\" (UID: \"76365ae7-632a-4639-84a0-f1bc2976a941\") " pod="openshift-insights/insights-runtime-extractor-dtxvx" Jul 17 18:45:46.366158 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.366120 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-79ppn"] Jul 17 18:45:46.368215 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.368193 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-79ppn" Jul 17 18:45:46.374093 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.374070 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zt9vq\"" Jul 17 18:45:46.374218 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.374176 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 17 18:45:46.374436 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.374422 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 17 18:45:46.388712 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.388667 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-79ppn"] Jul 17 18:45:46.439856 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.439828 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:46.455758 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.455736 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw5ds\" (UniqueName: \"kubernetes.io/projected/978f25c5-9384-430d-ae8a-17e45f13ad08-kube-api-access-gw5ds\") pod \"dns-default-79ppn\" (UID: \"978f25c5-9384-430d-ae8a-17e45f13ad08\") " pod="openshift-dns/dns-default-79ppn" Jul 17 18:45:46.455874 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.455767 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/76365ae7-632a-4639-84a0-f1bc2976a941-crio-socket\") pod \"insights-runtime-extractor-dtxvx\" (UID: \"76365ae7-632a-4639-84a0-f1bc2976a941\") " pod="openshift-insights/insights-runtime-extractor-dtxvx" Jul 17 18:45:46.455874 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.455786 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76365ae7-632a-4639-84a0-f1bc2976a941-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dtxvx\" (UID: \"76365ae7-632a-4639-84a0-f1bc2976a941\") " pod="openshift-insights/insights-runtime-extractor-dtxvx" Jul 17 18:45:46.455874 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.455825 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4bkp\" (UniqueName: \"kubernetes.io/projected/008e1c9d-8984-4a98-a046-e7876c88b88e-kube-api-access-h4bkp\") pod \"ingress-canary-rf6rr\" (UID: \"008e1c9d-8984-4a98-a046-e7876c88b88e\") " pod="openshift-ingress-canary/ingress-canary-rf6rr" Jul 17 18:45:46.455874 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.455858 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/978f25c5-9384-430d-ae8a-17e45f13ad08-config-volume\") pod \"dns-default-79ppn\" (UID: \"978f25c5-9384-430d-ae8a-17e45f13ad08\") " pod="openshift-dns/dns-default-79ppn" Jul 17 18:45:46.456075 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.455893 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76365ae7-632a-4639-84a0-f1bc2976a941-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dtxvx\" (UID: \"76365ae7-632a-4639-84a0-f1bc2976a941\") " pod="openshift-insights/insights-runtime-extractor-dtxvx" Jul 17 18:45:46.456075 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.455952 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/76365ae7-632a-4639-84a0-f1bc2976a941-crio-socket\") pod \"insights-runtime-extractor-dtxvx\" (UID: \"76365ae7-632a-4639-84a0-f1bc2976a941\") " pod="openshift-insights/insights-runtime-extractor-dtxvx" Jul 17 18:45:46.456075 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.455951 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r95jn\" (UniqueName: \"kubernetes.io/projected/76365ae7-632a-4639-84a0-f1bc2976a941-kube-api-access-r95jn\") pod \"insights-runtime-extractor-dtxvx\" (UID: \"76365ae7-632a-4639-84a0-f1bc2976a941\") " pod="openshift-insights/insights-runtime-extractor-dtxvx" Jul 17 18:45:46.456075 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.456010 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/978f25c5-9384-430d-ae8a-17e45f13ad08-metrics-tls\") pod \"dns-default-79ppn\" (UID: \"978f25c5-9384-430d-ae8a-17e45f13ad08\") " pod="openshift-dns/dns-default-79ppn" Jul 17 18:45:46.456075 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.456030 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/008e1c9d-8984-4a98-a046-e7876c88b88e-cert\") pod \"ingress-canary-rf6rr\" (UID: \"008e1c9d-8984-4a98-a046-e7876c88b88e\") " pod="openshift-ingress-canary/ingress-canary-rf6rr" Jul 17 18:45:46.456075 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.456061 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/978f25c5-9384-430d-ae8a-17e45f13ad08-tmp-dir\") pod \"dns-default-79ppn\" (UID: \"978f25c5-9384-430d-ae8a-17e45f13ad08\") " pod="openshift-dns/dns-default-79ppn" Jul 17 18:45:46.456301 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.456125 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/76365ae7-632a-4639-84a0-f1bc2976a941-data-volume\") pod \"insights-runtime-extractor-dtxvx\" (UID: \"76365ae7-632a-4639-84a0-f1bc2976a941\") " pod="openshift-insights/insights-runtime-extractor-dtxvx" Jul 17 18:45:46.456369 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.456352 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/76365ae7-632a-4639-84a0-f1bc2976a941-data-volume\") pod \"insights-runtime-extractor-dtxvx\" (UID: \"76365ae7-632a-4639-84a0-f1bc2976a941\") " pod="openshift-insights/insights-runtime-extractor-dtxvx" Jul 17 18:45:46.456418 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.456400 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76365ae7-632a-4639-84a0-f1bc2976a941-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dtxvx\" (UID: \"76365ae7-632a-4639-84a0-f1bc2976a941\") " pod="openshift-insights/insights-runtime-extractor-dtxvx" Jul 17 18:45:46.459934 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.459918 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76365ae7-632a-4639-84a0-f1bc2976a941-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dtxvx\" (UID: \"76365ae7-632a-4639-84a0-f1bc2976a941\") " pod="openshift-insights/insights-runtime-extractor-dtxvx" Jul 17 18:45:46.473374 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.473352 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r95jn\" (UniqueName: \"kubernetes.io/projected/76365ae7-632a-4639-84a0-f1bc2976a941-kube-api-access-r95jn\") pod \"insights-runtime-extractor-dtxvx\" (UID: \"76365ae7-632a-4639-84a0-f1bc2976a941\") " pod="openshift-insights/insights-runtime-extractor-dtxvx" Jul 17 18:45:46.539525 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.539498 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:46.557828 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.557805 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/978f25c5-9384-430d-ae8a-17e45f13ad08-tmp-dir\") pod \"dns-default-79ppn\" (UID: \"978f25c5-9384-430d-ae8a-17e45f13ad08\") " pod="openshift-dns/dns-default-79ppn" Jul 17 18:45:46.557965 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.557847 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw5ds\" (UniqueName: \"kubernetes.io/projected/978f25c5-9384-430d-ae8a-17e45f13ad08-kube-api-access-gw5ds\") pod \"dns-default-79ppn\" (UID: \"978f25c5-9384-430d-ae8a-17e45f13ad08\") " pod="openshift-dns/dns-default-79ppn" Jul 17 18:45:46.557965 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.557867 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4bkp\" (UniqueName: \"kubernetes.io/projected/008e1c9d-8984-4a98-a046-e7876c88b88e-kube-api-access-h4bkp\") pod \"ingress-canary-rf6rr\" (UID: \"008e1c9d-8984-4a98-a046-e7876c88b88e\") " pod="openshift-ingress-canary/ingress-canary-rf6rr" Jul 17 18:45:46.557965 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.557884 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/978f25c5-9384-430d-ae8a-17e45f13ad08-config-volume\") pod \"dns-default-79ppn\" (UID: \"978f25c5-9384-430d-ae8a-17e45f13ad08\") " pod="openshift-dns/dns-default-79ppn" Jul 17 18:45:46.558112 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.557997 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/978f25c5-9384-430d-ae8a-17e45f13ad08-metrics-tls\") pod \"dns-default-79ppn\" (UID: \"978f25c5-9384-430d-ae8a-17e45f13ad08\") " pod="openshift-dns/dns-default-79ppn" Jul 17 18:45:46.558112 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.558025 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/008e1c9d-8984-4a98-a046-e7876c88b88e-cert\") pod \"ingress-canary-rf6rr\" (UID: \"008e1c9d-8984-4a98-a046-e7876c88b88e\") " pod="openshift-ingress-canary/ingress-canary-rf6rr" Jul 17 18:45:46.558216 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.558164 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/978f25c5-9384-430d-ae8a-17e45f13ad08-tmp-dir\") pod \"dns-default-79ppn\" (UID: \"978f25c5-9384-430d-ae8a-17e45f13ad08\") " pod="openshift-dns/dns-default-79ppn" Jul 17 18:45:46.558341 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.558301 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dtxvx" Jul 17 18:45:46.558574 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.558553 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/978f25c5-9384-430d-ae8a-17e45f13ad08-config-volume\") pod \"dns-default-79ppn\" (UID: \"978f25c5-9384-430d-ae8a-17e45f13ad08\") " pod="openshift-dns/dns-default-79ppn" Jul 17 18:45:46.560469 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.560423 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/978f25c5-9384-430d-ae8a-17e45f13ad08-metrics-tls\") pod \"dns-default-79ppn\" (UID: \"978f25c5-9384-430d-ae8a-17e45f13ad08\") " pod="openshift-dns/dns-default-79ppn" Jul 17 18:45:46.560591 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.560574 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/008e1c9d-8984-4a98-a046-e7876c88b88e-cert\") pod \"ingress-canary-rf6rr\" (UID: \"008e1c9d-8984-4a98-a046-e7876c88b88e\") " pod="openshift-ingress-canary/ingress-canary-rf6rr" Jul 17 18:45:46.570651 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.570630 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4bkp\" (UniqueName: \"kubernetes.io/projected/008e1c9d-8984-4a98-a046-e7876c88b88e-kube-api-access-h4bkp\") pod \"ingress-canary-rf6rr\" (UID: \"008e1c9d-8984-4a98-a046-e7876c88b88e\") " pod="openshift-ingress-canary/ingress-canary-rf6rr" Jul 17 18:45:46.571359 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.571343 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw5ds\" (UniqueName: \"kubernetes.io/projected/978f25c5-9384-430d-ae8a-17e45f13ad08-kube-api-access-gw5ds\") pod \"dns-default-79ppn\" (UID: \"978f25c5-9384-430d-ae8a-17e45f13ad08\") " pod="openshift-dns/dns-default-79ppn" Jul 17 18:45:46.591407 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.591368 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rf6rr" Jul 17 18:45:46.638496 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.638404 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:46.677336 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.677061 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-79ppn" Jul 17 18:45:46.710183 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.710159 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dtxvx"] Jul 17 18:45:46.712811 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:45:46.712784 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76365ae7_632a_4639_84a0_f1bc2976a941.slice/crio-089efea569a6b79e001a36c7442ba29dd765446b6cb82b6aa2f1c9a3d61d5906 WatchSource:0}: Error finding container 089efea569a6b79e001a36c7442ba29dd765446b6cb82b6aa2f1c9a3d61d5906: Status 404 returned error can't find the container with id 089efea569a6b79e001a36c7442ba29dd765446b6cb82b6aa2f1c9a3d61d5906 Jul 17 18:45:46.729470 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.729440 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rf6rr"] Jul 17 18:45:46.735249 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:45:46.735217 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod008e1c9d_8984_4a98_a046_e7876c88b88e.slice/crio-394c43bca5609cc915abe915d19873310696d369b892a20cb29a0557dd8d3518 WatchSource:0}: Error finding container 394c43bca5609cc915abe915d19873310696d369b892a20cb29a0557dd8d3518: Status 404 returned error can't find the container with id 394c43bca5609cc915abe915d19873310696d369b892a20cb29a0557dd8d3518 Jul 17 18:45:46.805608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:46.805581 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-79ppn"] Jul 17 18:45:46.808781 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:45:46.808758 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod978f25c5_9384_430d_ae8a_17e45f13ad08.slice/crio-1fc175dc52993cd2c722ca760ce83570caf70c576092a19e9a5cf0f6b053deab WatchSource:0}: Error finding container 1fc175dc52993cd2c722ca760ce83570caf70c576092a19e9a5cf0f6b053deab: Status 404 returned error can't find the container with id 1fc175dc52993cd2c722ca760ce83570caf70c576092a19e9a5cf0f6b053deab Jul 17 18:45:47.393561 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:47.393471 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:47.486780 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:47.486668 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:47.719909 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:47.719765 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-79ppn" event={"ID":"978f25c5-9384-430d-ae8a-17e45f13ad08","Type":"ContainerStarted","Data":"1fc175dc52993cd2c722ca760ce83570caf70c576092a19e9a5cf0f6b053deab"} Jul 17 18:45:47.721723 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:47.721634 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rf6rr" event={"ID":"008e1c9d-8984-4a98-a046-e7876c88b88e","Type":"ContainerStarted","Data":"394c43bca5609cc915abe915d19873310696d369b892a20cb29a0557dd8d3518"} Jul 17 18:45:47.723240 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:47.723174 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dtxvx" event={"ID":"76365ae7-632a-4639-84a0-f1bc2976a941","Type":"ContainerStarted","Data":"089efea569a6b79e001a36c7442ba29dd765446b6cb82b6aa2f1c9a3d61d5906"} Jul 17 18:45:48.186823 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:48.186780 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-bw457"] Jul 17 18:45:48.189327 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:48.189285 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-bw457" Jul 17 18:45:48.192138 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:48.192110 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 17 18:45:48.192679 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:48.192657 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-822ff\"" Jul 17 18:45:48.192869 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:48.192849 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 17 18:45:48.217683 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:48.202367 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-bw457"] Jul 17 18:45:48.244735 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:48.244699 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:48.324450 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:48.324381 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:48.375354 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:48.375323 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxq2b\" (UniqueName: \"kubernetes.io/projected/a7b96998-9941-4228-a3e9-249b6bb30165-kube-api-access-zxq2b\") pod \"downloads-5bc67dcd46-bw457\" (UID: \"a7b96998-9941-4228-a3e9-249b6bb30165\") " pod="openshift-console/downloads-5bc67dcd46-bw457" Jul 17 18:45:48.476005 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:48.475914 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxq2b\" (UniqueName: \"kubernetes.io/projected/a7b96998-9941-4228-a3e9-249b6bb30165-kube-api-access-zxq2b\") pod \"downloads-5bc67dcd46-bw457\" (UID: \"a7b96998-9941-4228-a3e9-249b6bb30165\") " pod="openshift-console/downloads-5bc67dcd46-bw457" Jul 17 18:45:48.484079 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:48.484054 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:48.488389 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:48.488365 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxq2b\" (UniqueName: \"kubernetes.io/projected/a7b96998-9941-4228-a3e9-249b6bb30165-kube-api-access-zxq2b\") pod \"downloads-5bc67dcd46-bw457\" (UID: \"a7b96998-9941-4228-a3e9-249b6bb30165\") " pod="openshift-console/downloads-5bc67dcd46-bw457" Jul 17 18:45:48.526007 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:48.525952 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-bw457" Jul 17 18:45:48.665039 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:48.664931 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:48.682598 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:48.682573 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-bw457"] Jul 17 18:45:48.687616 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:45:48.687586 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7b96998_9941_4228_a3e9_249b6bb30165.slice/crio-d5ca798f3a239f8ddc75932e86e25fe67053741580940312388edc9dde93c224 WatchSource:0}: Error finding container d5ca798f3a239f8ddc75932e86e25fe67053741580940312388edc9dde93c224: Status 404 returned error can't find the container with id d5ca798f3a239f8ddc75932e86e25fe67053741580940312388edc9dde93c224 Jul 17 18:45:48.727365 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:48.727277 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-bw457" event={"ID":"a7b96998-9941-4228-a3e9-249b6bb30165","Type":"ContainerStarted","Data":"d5ca798f3a239f8ddc75932e86e25fe67053741580940312388edc9dde93c224"} Jul 17 18:45:48.765546 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:48.765502 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:49.058923 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:49.058847 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:49.279023 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:49.278988 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:49.601155 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:49.601120 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:49.696120 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:49.696081 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:49.866843 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:49.866763 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:50.359408 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:50.359369 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:51.886855 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:51.886811 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:51.977896 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:51.977844 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:53.242353 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:53.242304 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:53.342130 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:53.342093 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:53.670473 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:53.670175 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jpl4k" Jul 17 18:45:53.742869 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:53.742794 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dtxvx" event={"ID":"76365ae7-632a-4639-84a0-f1bc2976a941","Type":"ContainerStarted","Data":"53df1afb593b931e4081701d99c0325be9d074e45013bcb367a53359dcb40652"} Jul 17 18:45:53.746978 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:53.745924 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-79ppn" event={"ID":"978f25c5-9384-430d-ae8a-17e45f13ad08","Type":"ContainerStarted","Data":"78336c797834541cb0b51ac4c3c5acbd37147b2bb84363156bd250fbc5c18231"} Jul 17 18:45:53.746978 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:53.746006 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-79ppn" event={"ID":"978f25c5-9384-430d-ae8a-17e45f13ad08","Type":"ContainerStarted","Data":"1c5ac8810eab78c1472f615183e79958857ea06279301a75ea015e65d4980c29"} Jul 17 18:45:53.746978 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:53.746035 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-79ppn" Jul 17 18:45:53.747765 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:53.747743 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rf6rr" event={"ID":"008e1c9d-8984-4a98-a046-e7876c88b88e","Type":"ContainerStarted","Data":"b1b0c666dd2953d0ae6a14ab97076e3c6cc661565d88d0b052e0d442f8b9062b"} Jul 17 18:45:53.771667 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:53.770951 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-79ppn" podStartSLOduration=1.083817811 podStartE2EDuration="7.770937932s" totalImagesPullingTime="6.687120121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:45:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:45:53.770529784 +0000 UTC m=+62.802142658" watchObservedRunningTime="2026-07-17 18:45:53.770937932 +0000 UTC m=+62.802550784" Jul 17 18:45:53.789361 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:53.789290 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rf6rr" podStartSLOduration=1.029197638 podStartE2EDuration="7.789270717s" totalImagesPullingTime="6.760073079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:45:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:45:53.788444257 +0000 UTC m=+62.820057132" watchObservedRunningTime="2026-07-17 18:45:53.789270717 +0000 UTC m=+62.820883591" Jul 17 18:45:53.833501 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:53.833428 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:53.949727 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:53.949693 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:54.047924 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:54.047846 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:54.189330 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:54.189287 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:54.198039 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:54.198014 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-rkt6w"] Jul 17 18:45:54.200496 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:54.200472 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-rkt6w" Jul 17 18:45:54.203892 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:54.203869 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 17 18:45:54.204016 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:54.203985 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-zt2jm\"" Jul 17 18:45:54.214838 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:54.214720 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-rkt6w"] Jul 17 18:45:54.222379 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:54.222217 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e3934200-271e-4e1f-ad8d-0227f2cf4217-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-rkt6w\" (UID: \"e3934200-271e-4e1f-ad8d-0227f2cf4217\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-rkt6w" Jul 17 18:45:54.323788 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:54.323700 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e3934200-271e-4e1f-ad8d-0227f2cf4217-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-rkt6w\" (UID: \"e3934200-271e-4e1f-ad8d-0227f2cf4217\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-rkt6w" Jul 17 18:45:54.324363 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:54.323869 2559 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 17 18:45:54.324363 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:54.323944 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3934200-271e-4e1f-ad8d-0227f2cf4217-tls-certificates podName:e3934200-271e-4e1f-ad8d-0227f2cf4217 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:54.823925252 +0000 UTC m=+63.855538105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/e3934200-271e-4e1f-ad8d-0227f2cf4217-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-rkt6w" (UID: "e3934200-271e-4e1f-ad8d-0227f2cf4217") : secret "prometheus-operator-admission-webhook-tls" not found Jul 17 18:45:54.381084 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:54.381046 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:54.442370 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:54.442335 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:54.828394 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:54.827837 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e3934200-271e-4e1f-ad8d-0227f2cf4217-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-rkt6w\" (UID: \"e3934200-271e-4e1f-ad8d-0227f2cf4217\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-rkt6w" Jul 17 18:45:54.831024 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:54.830993 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e3934200-271e-4e1f-ad8d-0227f2cf4217-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-rkt6w\" (UID: \"e3934200-271e-4e1f-ad8d-0227f2cf4217\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-rkt6w" Jul 17 18:45:54.973147 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:54.973102 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:55.113148 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:55.113121 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-rkt6w" Jul 17 18:45:55.282622 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:55.282552 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-rkt6w"] Jul 17 18:45:55.755550 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:55.755521 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-rkt6w" event={"ID":"e3934200-271e-4e1f-ad8d-0227f2cf4217","Type":"ContainerStarted","Data":"e7d8606b781e1c5b6cc43becc591f42223974c9c43ad3a9fbae8de92f6a5ba19"} Jul 17 18:45:57.093652 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.093345 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d88fc77f7-lpxhd"] Jul 17 18:45:57.098527 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.098505 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d88fc77f7-lpxhd" Jul 17 18:45:57.102197 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.102173 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 17 18:45:57.102406 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.102243 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 17 18:45:57.103167 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.103149 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zskh4\"" Jul 17 18:45:57.103413 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.103386 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 17 18:45:57.103645 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.103630 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 17 18:45:57.103866 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.103851 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 17 18:45:57.111946 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.111911 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d88fc77f7-lpxhd"] Jul 17 18:45:57.147615 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.147582 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzmmx\" (UniqueName: \"kubernetes.io/projected/77202810-4e88-4933-b015-9442c761cc6d-kube-api-access-fzmmx\") pod \"console-6d88fc77f7-lpxhd\" (UID: \"77202810-4e88-4933-b015-9442c761cc6d\") " pod="openshift-console/console-6d88fc77f7-lpxhd" Jul 17 18:45:57.147778 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.147651 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77202810-4e88-4933-b015-9442c761cc6d-service-ca\") pod \"console-6d88fc77f7-lpxhd\" (UID: \"77202810-4e88-4933-b015-9442c761cc6d\") " pod="openshift-console/console-6d88fc77f7-lpxhd" Jul 17 18:45:57.147778 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.147686 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77202810-4e88-4933-b015-9442c761cc6d-oauth-serving-cert\") pod \"console-6d88fc77f7-lpxhd\" (UID: \"77202810-4e88-4933-b015-9442c761cc6d\") " pod="openshift-console/console-6d88fc77f7-lpxhd" Jul 17 18:45:57.147955 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.147792 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77202810-4e88-4933-b015-9442c761cc6d-console-oauth-config\") pod \"console-6d88fc77f7-lpxhd\" (UID: \"77202810-4e88-4933-b015-9442c761cc6d\") " pod="openshift-console/console-6d88fc77f7-lpxhd" Jul 17 18:45:57.147955 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.147828 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77202810-4e88-4933-b015-9442c761cc6d-console-config\") pod \"console-6d88fc77f7-lpxhd\" (UID: \"77202810-4e88-4933-b015-9442c761cc6d\") " pod="openshift-console/console-6d88fc77f7-lpxhd" Jul 17 18:45:57.147955 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.147859 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77202810-4e88-4933-b015-9442c761cc6d-console-serving-cert\") pod \"console-6d88fc77f7-lpxhd\" (UID: \"77202810-4e88-4933-b015-9442c761cc6d\") " pod="openshift-console/console-6d88fc77f7-lpxhd" Jul 17 18:45:57.249613 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.249022 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77202810-4e88-4933-b015-9442c761cc6d-console-oauth-config\") pod \"console-6d88fc77f7-lpxhd\" (UID: \"77202810-4e88-4933-b015-9442c761cc6d\") " pod="openshift-console/console-6d88fc77f7-lpxhd" Jul 17 18:45:57.249613 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.249070 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77202810-4e88-4933-b015-9442c761cc6d-console-config\") pod \"console-6d88fc77f7-lpxhd\" (UID: \"77202810-4e88-4933-b015-9442c761cc6d\") " pod="openshift-console/console-6d88fc77f7-lpxhd" Jul 17 18:45:57.249613 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.249100 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77202810-4e88-4933-b015-9442c761cc6d-console-serving-cert\") pod \"console-6d88fc77f7-lpxhd\" (UID: \"77202810-4e88-4933-b015-9442c761cc6d\") " pod="openshift-console/console-6d88fc77f7-lpxhd" Jul 17 18:45:57.249613 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.249149 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7362711c-acf1-4dc6-ae17-c6bf043f12c7-metrics-certs\") pod \"network-metrics-daemon-l957z\" (UID: \"7362711c-acf1-4dc6-ae17-c6bf043f12c7\") " pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:45:57.249613 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.249176 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzmmx\" (UniqueName: \"kubernetes.io/projected/77202810-4e88-4933-b015-9442c761cc6d-kube-api-access-fzmmx\") pod \"console-6d88fc77f7-lpxhd\" (UID: \"77202810-4e88-4933-b015-9442c761cc6d\") " pod="openshift-console/console-6d88fc77f7-lpxhd" Jul 17 18:45:57.249613 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.249221 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77202810-4e88-4933-b015-9442c761cc6d-service-ca\") pod \"console-6d88fc77f7-lpxhd\" (UID: \"77202810-4e88-4933-b015-9442c761cc6d\") " pod="openshift-console/console-6d88fc77f7-lpxhd" Jul 17 18:45:57.249613 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.249245 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77202810-4e88-4933-b015-9442c761cc6d-oauth-serving-cert\") pod \"console-6d88fc77f7-lpxhd\" (UID: \"77202810-4e88-4933-b015-9442c761cc6d\") " pod="openshift-console/console-6d88fc77f7-lpxhd" Jul 17 18:45:57.249613 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.249280 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e17f75b8-ee10-4328-bb53-f83b188ad149-original-pull-secret\") pod \"global-pull-secret-syncer-fwzx9\" (UID: \"e17f75b8-ee10-4328-bb53-f83b188ad149\") " pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:45:57.250152 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.249908 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77202810-4e88-4933-b015-9442c761cc6d-console-config\") pod \"console-6d88fc77f7-lpxhd\" (UID: \"77202810-4e88-4933-b015-9442c761cc6d\") " pod="openshift-console/console-6d88fc77f7-lpxhd" Jul 17 18:45:57.250152 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.249974 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77202810-4e88-4933-b015-9442c761cc6d-service-ca\") pod \"console-6d88fc77f7-lpxhd\" (UID: \"77202810-4e88-4933-b015-9442c761cc6d\") " pod="openshift-console/console-6d88fc77f7-lpxhd" Jul 17 18:45:57.250152 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.250060 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77202810-4e88-4933-b015-9442c761cc6d-oauth-serving-cert\") pod \"console-6d88fc77f7-lpxhd\" (UID: \"77202810-4e88-4933-b015-9442c761cc6d\") " pod="openshift-console/console-6d88fc77f7-lpxhd" Jul 17 18:45:57.251955 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.251927 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 18:45:57.252114 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.252006 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 18:45:57.252288 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.252253 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77202810-4e88-4933-b015-9442c761cc6d-console-oauth-config\") pod \"console-6d88fc77f7-lpxhd\" (UID: \"77202810-4e88-4933-b015-9442c761cc6d\") " pod="openshift-console/console-6d88fc77f7-lpxhd" Jul 17 18:45:57.252450 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.252409 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77202810-4e88-4933-b015-9442c761cc6d-console-serving-cert\") pod \"console-6d88fc77f7-lpxhd\" (UID: \"77202810-4e88-4933-b015-9442c761cc6d\") " pod="openshift-console/console-6d88fc77f7-lpxhd" Jul 17 18:45:57.262928 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.262881 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzmmx\" (UniqueName: \"kubernetes.io/projected/77202810-4e88-4933-b015-9442c761cc6d-kube-api-access-fzmmx\") pod \"console-6d88fc77f7-lpxhd\" (UID: \"77202810-4e88-4933-b015-9442c761cc6d\") " pod="openshift-console/console-6d88fc77f7-lpxhd" Jul 17 18:45:57.263269 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.263248 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e17f75b8-ee10-4328-bb53-f83b188ad149-original-pull-secret\") pod \"global-pull-secret-syncer-fwzx9\" (UID: \"e17f75b8-ee10-4328-bb53-f83b188ad149\") " pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:45:57.264373 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.264327 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7362711c-acf1-4dc6-ae17-c6bf043f12c7-metrics-certs\") pod \"network-metrics-daemon-l957z\" (UID: \"7362711c-acf1-4dc6-ae17-c6bf043f12c7\") " pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:45:57.296796 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.296765 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jqp7v\"" Jul 17 18:45:57.305199 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.305170 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l957z" Jul 17 18:45:57.307422 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.307402 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwzx9" Jul 17 18:45:57.350422 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.350359 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrxr6\" (UniqueName: \"kubernetes.io/projected/6875c8e0-71a7-49b7-a799-5720b2f9b244-kube-api-access-nrxr6\") pod \"network-check-target-tpstx\" (UID: \"6875c8e0-71a7-49b7-a799-5720b2f9b244\") " pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:45:57.353040 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.353015 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 17 18:45:57.363474 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.363451 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 17 18:45:57.374414 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.374386 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrxr6\" (UniqueName: \"kubernetes.io/projected/6875c8e0-71a7-49b7-a799-5720b2f9b244-kube-api-access-nrxr6\") pod \"network-check-target-tpstx\" (UID: \"6875c8e0-71a7-49b7-a799-5720b2f9b244\") " pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:45:57.416197 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.416168 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d88fc77f7-lpxhd" Jul 17 18:45:57.609883 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.604940 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ktbms\"" Jul 17 18:45:57.613323 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.613160 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:45:57.695263 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.695207 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d88fc77f7-lpxhd"] Jul 17 18:45:57.909549 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:45:57.909447 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77202810_4e88_4933_b015_9442c761cc6d.slice/crio-4c3e6b86792fa86ea267de5e63a66c100ef741ed0e4d6a25ad1a417c0a9ce95c WatchSource:0}: Error finding container 4c3e6b86792fa86ea267de5e63a66c100ef741ed0e4d6a25ad1a417c0a9ce95c: Status 404 returned error can't find the container with id 4c3e6b86792fa86ea267de5e63a66c100ef741ed0e4d6a25ad1a417c0a9ce95c Jul 17 18:45:57.923178 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.923153 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fwzx9"] Jul 17 18:45:57.926633 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:57.926612 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l957z"] Jul 17 18:45:57.934098 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:45:57.934066 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode17f75b8_ee10_4328_bb53_f83b188ad149.slice/crio-5ec49b7f4801dbd0b2b43d17d27300a1f89d674a079d73ae0c90cc07c51a7e1c WatchSource:0}: Error finding container 5ec49b7f4801dbd0b2b43d17d27300a1f89d674a079d73ae0c90cc07c51a7e1c: Status 404 returned error can't find the container with id 5ec49b7f4801dbd0b2b43d17d27300a1f89d674a079d73ae0c90cc07c51a7e1c Jul 17 18:45:57.934921 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:45:57.934883 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7362711c_acf1_4dc6_ae17_c6bf043f12c7.slice/crio-8447258b207537492e9b6a0ada49bfb31755fd966d8c2e5b2efbf120eda5d44d WatchSource:0}: Error finding container 8447258b207537492e9b6a0ada49bfb31755fd966d8c2e5b2efbf120eda5d44d: Status 404 returned error can't find the container with id 8447258b207537492e9b6a0ada49bfb31755fd966d8c2e5b2efbf120eda5d44d Jul 17 18:45:58.065244 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:58.065217 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tpstx"] Jul 17 18:45:58.068728 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:45:58.068698 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6875c8e0_71a7_49b7_a799_5720b2f9b244.slice/crio-bbaab46b636a15a346b976a969e875f592aabe0522e93e1f6c89df874047aefb WatchSource:0}: Error finding container bbaab46b636a15a346b976a969e875f592aabe0522e93e1f6c89df874047aefb: Status 404 returned error can't find the container with id bbaab46b636a15a346b976a969e875f592aabe0522e93e1f6c89df874047aefb Jul 17 18:45:58.768066 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:58.768027 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-rkt6w" event={"ID":"e3934200-271e-4e1f-ad8d-0227f2cf4217","Type":"ContainerStarted","Data":"4a75bd6d2c2146f34089a5d7caa5322f2806a92c7f33588ce18775585adf97bc"} Jul 17 18:45:58.770114 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:58.770058 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-rkt6w" Jul 17 18:45:58.771593 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:58.771562 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d88fc77f7-lpxhd" event={"ID":"77202810-4e88-4933-b015-9442c761cc6d","Type":"ContainerStarted","Data":"4c3e6b86792fa86ea267de5e63a66c100ef741ed0e4d6a25ad1a417c0a9ce95c"} Jul 17 18:45:58.775292 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:58.774900 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tpstx" event={"ID":"6875c8e0-71a7-49b7-a799-5720b2f9b244","Type":"ContainerStarted","Data":"bbaab46b636a15a346b976a969e875f592aabe0522e93e1f6c89df874047aefb"} Jul 17 18:45:58.775292 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:58.775138 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-rkt6w" Jul 17 18:45:58.778393 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:58.778256 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fwzx9" event={"ID":"e17f75b8-ee10-4328-bb53-f83b188ad149","Type":"ContainerStarted","Data":"5ec49b7f4801dbd0b2b43d17d27300a1f89d674a079d73ae0c90cc07c51a7e1c"} Jul 17 18:45:58.780342 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:58.780265 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l957z" event={"ID":"7362711c-acf1-4dc6-ae17-c6bf043f12c7","Type":"ContainerStarted","Data":"8447258b207537492e9b6a0ada49bfb31755fd966d8c2e5b2efbf120eda5d44d"} Jul 17 18:45:58.783553 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:58.783467 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dtxvx" event={"ID":"76365ae7-632a-4639-84a0-f1bc2976a941","Type":"ContainerStarted","Data":"2f2aacbe92f6dbafedd30b3202421f85df6da8038be3a093cfd587a72735e4a1"} Jul 17 18:45:58.789973 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:58.789042 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-rkt6w" podStartSLOduration=2.139059185 podStartE2EDuration="4.789026113s" totalImagesPullingTime="2.649966928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:45:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:45:58.788344081 +0000 UTC m=+67.819956956" watchObservedRunningTime="2026-07-17 18:45:58.789026113 +0000 UTC m=+67.820638989" Jul 17 18:45:59.227832 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:59.227748 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:59.263453 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:59.262922 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-lth9w"] Jul 17 18:45:59.268466 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:59.268440 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-lth9w" Jul 17 18:45:59.283133 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:59.279718 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 17 18:45:59.283133 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:59.279979 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 17 18:45:59.283133 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:59.280186 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-bkkjf\"" Jul 17 18:45:59.283133 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:59.280528 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 17 18:45:59.283133 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:59.280728 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 17 18:45:59.283133 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:59.280939 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 17 18:45:59.283133 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:59.282584 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-lth9w"] Jul 17 18:45:59.303532 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:59.303401 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:59.366974 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:59.366933 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/813e2e0b-8052-47b9-afc8-c976391596e8-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-lth9w\" (UID: \"813e2e0b-8052-47b9-afc8-c976391596e8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-lth9w" Jul 17 18:45:59.367146 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:59.367001 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/813e2e0b-8052-47b9-afc8-c976391596e8-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-lth9w\" (UID: \"813e2e0b-8052-47b9-afc8-c976391596e8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-lth9w" Jul 17 18:45:59.367146 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:59.367049 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/813e2e0b-8052-47b9-afc8-c976391596e8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-lth9w\" (UID: \"813e2e0b-8052-47b9-afc8-c976391596e8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-lth9w" Jul 17 18:45:59.367146 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:59.367077 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrcxn\" (UniqueName: \"kubernetes.io/projected/813e2e0b-8052-47b9-afc8-c976391596e8-kube-api-access-rrcxn\") pod \"prometheus-operator-5945b5cfd-lth9w\" (UID: \"813e2e0b-8052-47b9-afc8-c976391596e8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-lth9w" Jul 17 18:45:59.469226 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:59.467741 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/813e2e0b-8052-47b9-afc8-c976391596e8-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-lth9w\" (UID: \"813e2e0b-8052-47b9-afc8-c976391596e8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-lth9w" Jul 17 18:45:59.469226 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:59.467804 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/813e2e0b-8052-47b9-afc8-c976391596e8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-lth9w\" (UID: \"813e2e0b-8052-47b9-afc8-c976391596e8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-lth9w" Jul 17 18:45:59.469226 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:59.467831 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrcxn\" (UniqueName: \"kubernetes.io/projected/813e2e0b-8052-47b9-afc8-c976391596e8-kube-api-access-rrcxn\") pod \"prometheus-operator-5945b5cfd-lth9w\" (UID: \"813e2e0b-8052-47b9-afc8-c976391596e8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-lth9w" Jul 17 18:45:59.469226 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:59.467877 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/813e2e0b-8052-47b9-afc8-c976391596e8-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-lth9w\" (UID: \"813e2e0b-8052-47b9-afc8-c976391596e8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-lth9w" Jul 17 18:45:59.469226 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:59.468593 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/813e2e0b-8052-47b9-afc8-c976391596e8-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-lth9w\" (UID: \"813e2e0b-8052-47b9-afc8-c976391596e8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-lth9w" Jul 17 18:45:59.469226 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:59.468992 2559 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 17 18:45:59.469226 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:45:59.469047 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/813e2e0b-8052-47b9-afc8-c976391596e8-prometheus-operator-tls podName:813e2e0b-8052-47b9-afc8-c976391596e8 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:59.969029533 +0000 UTC m=+69.000642390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/813e2e0b-8052-47b9-afc8-c976391596e8-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-lth9w" (UID: "813e2e0b-8052-47b9-afc8-c976391596e8") : secret "prometheus-operator-tls" not found Jul 17 18:45:59.472885 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:59.472840 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/813e2e0b-8052-47b9-afc8-c976391596e8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-lth9w\" (UID: \"813e2e0b-8052-47b9-afc8-c976391596e8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-lth9w" Jul 17 18:45:59.485438 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:59.485359 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrcxn\" (UniqueName: \"kubernetes.io/projected/813e2e0b-8052-47b9-afc8-c976391596e8-kube-api-access-rrcxn\") pod \"prometheus-operator-5945b5cfd-lth9w\" (UID: \"813e2e0b-8052-47b9-afc8-c976391596e8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-lth9w" Jul 17 18:45:59.750791 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:59.750646 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:59.794131 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:59.794046 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l957z" event={"ID":"7362711c-acf1-4dc6-ae17-c6bf043f12c7","Type":"ContainerStarted","Data":"04e7a70a23b88735397d95205f0b6e7e552aef1cd4d74f92d604a9b0fab365fe"} Jul 17 18:45:59.973078 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:59.973037 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/813e2e0b-8052-47b9-afc8-c976391596e8-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-lth9w\" (UID: \"813e2e0b-8052-47b9-afc8-c976391596e8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-lth9w" Jul 17 18:45:59.984117 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:45:59.984086 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/813e2e0b-8052-47b9-afc8-c976391596e8-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-lth9w\" (UID: \"813e2e0b-8052-47b9-afc8-c976391596e8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-lth9w" Jul 17 18:46:00.185114 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:00.185084 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-lth9w" Jul 17 18:46:00.360395 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:00.360290 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-lth9w"] Jul 17 18:46:00.366860 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:46:00.366827 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod813e2e0b_8052_47b9_afc8_c976391596e8.slice/crio-df0a2bd537e551fca9e6568de3d18d3df4ed846a43d0068a9c9c08428a26966a WatchSource:0}: Error finding container df0a2bd537e551fca9e6568de3d18d3df4ed846a43d0068a9c9c08428a26966a: Status 404 returned error can't find the container with id df0a2bd537e551fca9e6568de3d18d3df4ed846a43d0068a9c9c08428a26966a Jul 17 18:46:00.807091 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:00.807050 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l957z" event={"ID":"7362711c-acf1-4dc6-ae17-c6bf043f12c7","Type":"ContainerStarted","Data":"49e88f1980b8778f05b305ddc6800503ee2c30665fb167e357b156d082a14a4c"} Jul 17 18:46:00.809459 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:00.809431 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-lth9w" event={"ID":"813e2e0b-8052-47b9-afc8-c976391596e8","Type":"ContainerStarted","Data":"df0a2bd537e551fca9e6568de3d18d3df4ed846a43d0068a9c9c08428a26966a"} Jul 17 18:46:00.825284 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:00.825232 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l957z" podStartSLOduration=68.270421103 podStartE2EDuration="1m9.825213975s" totalImagesPullingTime="1.554792872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:44:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:46:00.824722431 +0000 UTC m=+69.856335309" watchObservedRunningTime="2026-07-17 18:46:00.825213975 +0000 UTC m=+69.856826852" Jul 17 18:46:00.958879 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:00.958826 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:01.080224 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:01.080148 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:01.149758 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:01.149700 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:01.407418 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:01.407382 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:01.507437 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:01.507380 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:03.754324 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:03.754277 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-79ppn" Jul 17 18:46:03.960656 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:03.960625 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:04.062287 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:04.062167 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:04.164764 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:04.164732 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:04.233754 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:04.233694 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:05.687646 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:05.687602 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-599b45ccbf-8v7g9"] Jul 17 18:46:05.690811 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:05.690785 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:05.699253 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:05.699039 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 17 18:46:05.723332 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:05.723287 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c240f071-8183-4461-a7bc-f2104d3ae2c8-console-config\") pod \"console-599b45ccbf-8v7g9\" (UID: \"c240f071-8183-4461-a7bc-f2104d3ae2c8\") " pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:05.723475 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:05.723345 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c240f071-8183-4461-a7bc-f2104d3ae2c8-console-oauth-config\") pod \"console-599b45ccbf-8v7g9\" (UID: \"c240f071-8183-4461-a7bc-f2104d3ae2c8\") " pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:05.723475 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:05.723376 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvjdm\" (UniqueName: \"kubernetes.io/projected/c240f071-8183-4461-a7bc-f2104d3ae2c8-kube-api-access-dvjdm\") pod \"console-599b45ccbf-8v7g9\" (UID: \"c240f071-8183-4461-a7bc-f2104d3ae2c8\") " pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:05.723475 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:05.723399 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c240f071-8183-4461-a7bc-f2104d3ae2c8-oauth-serving-cert\") pod \"console-599b45ccbf-8v7g9\" (UID: \"c240f071-8183-4461-a7bc-f2104d3ae2c8\") " pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:05.723475 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:05.723427 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c240f071-8183-4461-a7bc-f2104d3ae2c8-service-ca\") pod \"console-599b45ccbf-8v7g9\" (UID: \"c240f071-8183-4461-a7bc-f2104d3ae2c8\") " pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:05.723695 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:05.723520 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c240f071-8183-4461-a7bc-f2104d3ae2c8-trusted-ca-bundle\") pod \"console-599b45ccbf-8v7g9\" (UID: \"c240f071-8183-4461-a7bc-f2104d3ae2c8\") " pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:05.723695 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:05.723555 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c240f071-8183-4461-a7bc-f2104d3ae2c8-console-serving-cert\") pod \"console-599b45ccbf-8v7g9\" (UID: \"c240f071-8183-4461-a7bc-f2104d3ae2c8\") " pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:05.745123 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:05.745092 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-599b45ccbf-8v7g9"] Jul 17 18:46:05.824574 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:05.824540 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c240f071-8183-4461-a7bc-f2104d3ae2c8-service-ca\") pod \"console-599b45ccbf-8v7g9\" (UID: \"c240f071-8183-4461-a7bc-f2104d3ae2c8\") " pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:05.824758 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:05.824589 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c240f071-8183-4461-a7bc-f2104d3ae2c8-trusted-ca-bundle\") pod \"console-599b45ccbf-8v7g9\" (UID: \"c240f071-8183-4461-a7bc-f2104d3ae2c8\") " pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:05.824758 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:05.824613 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c240f071-8183-4461-a7bc-f2104d3ae2c8-console-serving-cert\") pod \"console-599b45ccbf-8v7g9\" (UID: \"c240f071-8183-4461-a7bc-f2104d3ae2c8\") " pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:05.824758 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:05.824660 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c240f071-8183-4461-a7bc-f2104d3ae2c8-console-config\") pod \"console-599b45ccbf-8v7g9\" (UID: \"c240f071-8183-4461-a7bc-f2104d3ae2c8\") " pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:05.824758 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:05.824688 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c240f071-8183-4461-a7bc-f2104d3ae2c8-console-oauth-config\") pod \"console-599b45ccbf-8v7g9\" (UID: \"c240f071-8183-4461-a7bc-f2104d3ae2c8\") " pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:05.824758 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:05.824733 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvjdm\" (UniqueName: \"kubernetes.io/projected/c240f071-8183-4461-a7bc-f2104d3ae2c8-kube-api-access-dvjdm\") pod \"console-599b45ccbf-8v7g9\" (UID: \"c240f071-8183-4461-a7bc-f2104d3ae2c8\") " pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:05.825001 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:05.824773 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c240f071-8183-4461-a7bc-f2104d3ae2c8-oauth-serving-cert\") pod \"console-599b45ccbf-8v7g9\" (UID: \"c240f071-8183-4461-a7bc-f2104d3ae2c8\") " pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:05.825544 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:05.825502 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c240f071-8183-4461-a7bc-f2104d3ae2c8-oauth-serving-cert\") pod \"console-599b45ccbf-8v7g9\" (UID: \"c240f071-8183-4461-a7bc-f2104d3ae2c8\") " pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:05.825544 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:05.825533 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c240f071-8183-4461-a7bc-f2104d3ae2c8-trusted-ca-bundle\") pod \"console-599b45ccbf-8v7g9\" (UID: \"c240f071-8183-4461-a7bc-f2104d3ae2c8\") " pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:05.825544 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:05.825505 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c240f071-8183-4461-a7bc-f2104d3ae2c8-console-config\") pod \"console-599b45ccbf-8v7g9\" (UID: \"c240f071-8183-4461-a7bc-f2104d3ae2c8\") " pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:05.825769 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:05.825542 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c240f071-8183-4461-a7bc-f2104d3ae2c8-service-ca\") pod \"console-599b45ccbf-8v7g9\" (UID: \"c240f071-8183-4461-a7bc-f2104d3ae2c8\") " pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:05.827569 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:05.827541 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c240f071-8183-4461-a7bc-f2104d3ae2c8-console-serving-cert\") pod \"console-599b45ccbf-8v7g9\" (UID: \"c240f071-8183-4461-a7bc-f2104d3ae2c8\") " pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:05.827722 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:05.827704 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c240f071-8183-4461-a7bc-f2104d3ae2c8-console-oauth-config\") pod \"console-599b45ccbf-8v7g9\" (UID: \"c240f071-8183-4461-a7bc-f2104d3ae2c8\") " pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:05.834093 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:05.834067 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvjdm\" (UniqueName: \"kubernetes.io/projected/c240f071-8183-4461-a7bc-f2104d3ae2c8-kube-api-access-dvjdm\") pod \"console-599b45ccbf-8v7g9\" (UID: \"c240f071-8183-4461-a7bc-f2104d3ae2c8\") " pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:06.002385 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:06.002281 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:07.917646 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:07.917604 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:07.999927 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:07.999889 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:08.267079 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:08.266980 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:08.376354 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:08.376304 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:09.373288 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:09.373248 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:09.445714 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:09.445662 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:12.915330 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:12.915128 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:12.986944 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:12.986916 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:13.946084 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:13.946042 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:14.068872 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:14.068831 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:15.423129 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:15.423104 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-599b45ccbf-8v7g9"] Jul 17 18:46:15.426284 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:46:15.426262 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc240f071_8183_4461_a7bc_f2104d3ae2c8.slice/crio-b5c929601205451190511135cecbaf8261095d637bef23158fb263b6193f02fb WatchSource:0}: Error finding container b5c929601205451190511135cecbaf8261095d637bef23158fb263b6193f02fb: Status 404 returned error can't find the container with id b5c929601205451190511135cecbaf8261095d637bef23158fb263b6193f02fb Jul 17 18:46:15.671917 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:15.671890 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:15.870887 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:15.870847 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-bw457" event={"ID":"a7b96998-9941-4228-a3e9-249b6bb30165","Type":"ContainerStarted","Data":"4f20f876a4b1286c6a4107d478c985df2ae769240ecc951553fb608078afa0ef"} Jul 17 18:46:15.871113 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:15.871042 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-bw457" Jul 17 18:46:15.872767 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:15.872693 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d88fc77f7-lpxhd" event={"ID":"77202810-4e88-4933-b015-9442c761cc6d","Type":"ContainerStarted","Data":"cf35111da8f0957769fd1e99c9cda1d2dc9d60e00a4a5bb712e10954026ee1a6"} Jul 17 18:46:15.875005 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:15.874975 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-lth9w" event={"ID":"813e2e0b-8052-47b9-afc8-c976391596e8","Type":"ContainerStarted","Data":"d52682db992989d3df7d9ff8ee46240642b26337aa35fc8119a762cb9316d0ee"} Jul 17 18:46:15.875110 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:15.875027 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-lth9w" event={"ID":"813e2e0b-8052-47b9-afc8-c976391596e8","Type":"ContainerStarted","Data":"534755f726cada3ac76d9ae99b415c8caae0799afc2979a93a04e2581aa23388"} Jul 17 18:46:15.876914 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:15.876883 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-599b45ccbf-8v7g9" event={"ID":"c240f071-8183-4461-a7bc-f2104d3ae2c8","Type":"ContainerStarted","Data":"979fe8f0018f78f6d552f3e2a45f298a753c4b23fb577140ea9d9ce6557b252b"} Jul 17 18:46:15.877020 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:15.876928 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-599b45ccbf-8v7g9" event={"ID":"c240f071-8183-4461-a7bc-f2104d3ae2c8","Type":"ContainerStarted","Data":"b5c929601205451190511135cecbaf8261095d637bef23158fb263b6193f02fb"} Jul 17 18:46:15.879045 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:15.879022 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tpstx" event={"ID":"6875c8e0-71a7-49b7-a799-5720b2f9b244","Type":"ContainerStarted","Data":"e947cfecba2078a64c864c57f5b0154e6a169c0d9fb2c55006eb8954cf270430"} Jul 17 18:46:15.879432 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:15.879412 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:46:15.880885 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:15.880864 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fwzx9" event={"ID":"e17f75b8-ee10-4328-bb53-f83b188ad149","Type":"ContainerStarted","Data":"703cbc5bae8f5f6aaf2becadb374f423043057558f63cca2ed02acabd83077c8"} Jul 17 18:46:15.883305 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:15.883281 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dtxvx" event={"ID":"76365ae7-632a-4639-84a0-f1bc2976a941","Type":"ContainerStarted","Data":"ec947cb9f5486b24a182312bc263cc7481c1e93ea2f139f159be9d2becf84005"} Jul 17 18:46:15.886648 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:15.886625 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-bw457" Jul 17 18:46:15.906453 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:15.906407 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-bw457" podStartSLOduration=1.286450849 podStartE2EDuration="27.906388488s" totalImagesPullingTime="26.619937639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:45:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:46:15.905291608 +0000 UTC m=+84.936904473" watchObservedRunningTime="2026-07-17 18:46:15.906388488 +0000 UTC m=+84.938001381" Jul 17 18:46:15.941868 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:15.941762 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tpstx" podStartSLOduration=67.744525126 podStartE2EDuration="1m24.941741666s" totalImagesPullingTime="17.19721654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:44:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:46:15.939942996 +0000 UTC m=+84.971555870" watchObservedRunningTime="2026-07-17 18:46:15.941741666 +0000 UTC m=+84.973354538" Jul 17 18:46:15.981737 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:15.981674 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d88fc77f7-lpxhd" podStartSLOduration=1.6211871960000002 podStartE2EDuration="18.981655277s" totalImagesPullingTime="17.360468081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:45:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:46:15.981200316 +0000 UTC m=+85.012813191" watchObservedRunningTime="2026-07-17 18:46:15.981655277 +0000 UTC m=+85.013268151" Jul 17 18:46:16.003286 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:16.003254 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:16.003475 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:16.003331 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:16.009352 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:16.009303 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:16.049230 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:16.049163 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fwzx9" podStartSLOduration=67.717825371 podStartE2EDuration="1m25.049140285s" totalImagesPullingTime="17.331314914s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:44:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:46:16.014517606 +0000 UTC m=+85.046130481" watchObservedRunningTime="2026-07-17 18:46:16.049140285 +0000 UTC m=+85.080753137" Jul 17 18:46:16.049782 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:16.049748 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dtxvx" podStartSLOduration=1.6589093620000002 podStartE2EDuration="30.049730557s" totalImagesPullingTime="28.390821195s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:45:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:46:16.048229911 +0000 UTC m=+85.079842786" watchObservedRunningTime="2026-07-17 18:46:16.049730557 +0000 UTC m=+85.081343431" Jul 17 18:46:16.072211 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:16.072125 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-599b45ccbf-8v7g9" podStartSLOduration=11.072102641 podStartE2EDuration="11.072102641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:46:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:46:16.071626236 +0000 UTC m=+85.103239270" watchObservedRunningTime="2026-07-17 18:46:16.072102641 +0000 UTC m=+85.103715515" Jul 17 18:46:16.111116 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:16.111043 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-lth9w" podStartSLOduration=2.211981887 podStartE2EDuration="17.111023114s" totalImagesPullingTime="14.899041227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:45:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:46:16.110289291 +0000 UTC m=+85.141902167" watchObservedRunningTime="2026-07-17 18:46:16.111023114 +0000 UTC m=+85.142635989" Jul 17 18:46:16.897350 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:16.897296 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:16.946412 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:16.946374 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d88fc77f7-lpxhd"] Jul 17 18:46:17.073114 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.073065 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:17.154620 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.154529 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:17.416884 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.416808 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d88fc77f7-lpxhd" Jul 17 18:46:17.417046 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.416972 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d88fc77f7-lpxhd" Jul 17 18:46:17.420421 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.420390 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:17.422741 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.422716 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d88fc77f7-lpxhd" Jul 17 18:46:17.537104 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.537070 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:17.642069 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.642036 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:17.706382 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.706281 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-bs5cb"] Jul 17 18:46:17.765862 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.765829 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:17.801503 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.801466 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-f6rlq"] Jul 17 18:46:17.801685 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.801594 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bs5cb" Jul 17 18:46:17.804746 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.804719 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8sbpz\"" Jul 17 18:46:17.804746 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.804739 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 17 18:46:17.804965 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.804719 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 17 18:46:17.825089 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.825061 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-k4lcr"] Jul 17 18:46:17.825355 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.825191 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:17.827859 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.827837 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 17 18:46:17.828402 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.828377 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p9fbf\"" Jul 17 18:46:17.828658 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.828640 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 17 18:46:17.831575 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.831558 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 17 18:46:17.845279 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.845257 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-bs5cb"] Jul 17 18:46:17.845410 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.845326 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-k4lcr"] Jul 17 18:46:17.845462 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.845426 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-k4lcr" Jul 17 18:46:17.848706 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.848687 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 17 18:46:17.849022 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.849004 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-kjzgc\"" Jul 17 18:46:17.849383 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.849365 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 17 18:46:17.849484 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.849466 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 17 18:46:17.898891 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.898861 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d88fc77f7-lpxhd" Jul 17 18:46:17.909284 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.909251 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:17.920751 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.920722 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84b8416d-b2ea-4511-aed6-79f917dcf41b-sys\") pod \"node-exporter-f6rlq\" (UID: \"84b8416d-b2ea-4511-aed6-79f917dcf41b\") " pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:17.920751 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.920757 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84b8416d-b2ea-4511-aed6-79f917dcf41b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f6rlq\" (UID: \"84b8416d-b2ea-4511-aed6-79f917dcf41b\") " pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:17.920934 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.920777 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/061c236d-715c-42b4-b445-2e8a81315677-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-k4lcr\" (UID: \"061c236d-715c-42b4-b445-2e8a81315677\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k4lcr" Jul 17 18:46:17.920934 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.920801 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmdh6\" (UniqueName: \"kubernetes.io/projected/061c236d-715c-42b4-b445-2e8a81315677-kube-api-access-hmdh6\") pod \"kube-state-metrics-56c5594674-k4lcr\" (UID: \"061c236d-715c-42b4-b445-2e8a81315677\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k4lcr" Jul 17 18:46:17.920934 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.920850 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/564ab632-9517-4a85-be6d-2b4720ba30f2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-bs5cb\" (UID: \"564ab632-9517-4a85-be6d-2b4720ba30f2\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bs5cb" Jul 17 18:46:17.920934 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.920873 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/84b8416d-b2ea-4511-aed6-79f917dcf41b-node-exporter-wtmp\") pod \"node-exporter-f6rlq\" (UID: \"84b8416d-b2ea-4511-aed6-79f917dcf41b\") " pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:17.921095 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.920946 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6cp5\" (UniqueName: \"kubernetes.io/projected/564ab632-9517-4a85-be6d-2b4720ba30f2-kube-api-access-k6cp5\") pod \"openshift-state-metrics-79f6958cdf-bs5cb\" (UID: \"564ab632-9517-4a85-be6d-2b4720ba30f2\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bs5cb" Jul 17 18:46:17.921095 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.920985 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/84b8416d-b2ea-4511-aed6-79f917dcf41b-node-exporter-tls\") pod \"node-exporter-f6rlq\" (UID: \"84b8416d-b2ea-4511-aed6-79f917dcf41b\") " pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:17.921095 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.921013 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7jj2\" (UniqueName: \"kubernetes.io/projected/84b8416d-b2ea-4511-aed6-79f917dcf41b-kube-api-access-n7jj2\") pod \"node-exporter-f6rlq\" (UID: \"84b8416d-b2ea-4511-aed6-79f917dcf41b\") " pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:17.921095 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.921044 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/061c236d-715c-42b4-b445-2e8a81315677-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-k4lcr\" (UID: \"061c236d-715c-42b4-b445-2e8a81315677\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k4lcr" Jul 17 18:46:17.921095 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.921086 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/061c236d-715c-42b4-b445-2e8a81315677-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-k4lcr\" (UID: \"061c236d-715c-42b4-b445-2e8a81315677\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k4lcr" Jul 17 18:46:17.921301 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.921103 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/061c236d-715c-42b4-b445-2e8a81315677-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-k4lcr\" (UID: \"061c236d-715c-42b4-b445-2e8a81315677\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k4lcr" Jul 17 18:46:17.921301 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.921128 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/564ab632-9517-4a85-be6d-2b4720ba30f2-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-bs5cb\" (UID: \"564ab632-9517-4a85-be6d-2b4720ba30f2\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bs5cb" Jul 17 18:46:17.921301 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.921168 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/564ab632-9517-4a85-be6d-2b4720ba30f2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-bs5cb\" (UID: \"564ab632-9517-4a85-be6d-2b4720ba30f2\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bs5cb" Jul 17 18:46:17.921301 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.921198 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/84b8416d-b2ea-4511-aed6-79f917dcf41b-root\") pod \"node-exporter-f6rlq\" (UID: \"84b8416d-b2ea-4511-aed6-79f917dcf41b\") " pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:17.921301 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.921251 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/84b8416d-b2ea-4511-aed6-79f917dcf41b-node-exporter-textfile\") pod \"node-exporter-f6rlq\" (UID: \"84b8416d-b2ea-4511-aed6-79f917dcf41b\") " pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:17.921301 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.921284 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84b8416d-b2ea-4511-aed6-79f917dcf41b-metrics-client-ca\") pod \"node-exporter-f6rlq\" (UID: \"84b8416d-b2ea-4511-aed6-79f917dcf41b\") " pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:17.921521 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.921322 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/84b8416d-b2ea-4511-aed6-79f917dcf41b-node-exporter-accelerators-collector-config\") pod \"node-exporter-f6rlq\" (UID: \"84b8416d-b2ea-4511-aed6-79f917dcf41b\") " pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:17.921521 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:17.921353 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/061c236d-715c-42b4-b445-2e8a81315677-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-k4lcr\" (UID: \"061c236d-715c-42b4-b445-2e8a81315677\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k4lcr" Jul 17 18:46:18.005034 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.004946 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:18.022011 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.021983 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/061c236d-715c-42b4-b445-2e8a81315677-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-k4lcr\" (UID: \"061c236d-715c-42b4-b445-2e8a81315677\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k4lcr" Jul 17 18:46:18.022171 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.022139 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84b8416d-b2ea-4511-aed6-79f917dcf41b-sys\") pod \"node-exporter-f6rlq\" (UID: \"84b8416d-b2ea-4511-aed6-79f917dcf41b\") " pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:18.022235 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.022177 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84b8416d-b2ea-4511-aed6-79f917dcf41b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f6rlq\" (UID: \"84b8416d-b2ea-4511-aed6-79f917dcf41b\") " pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:18.022235 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.022213 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/061c236d-715c-42b4-b445-2e8a81315677-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-k4lcr\" (UID: \"061c236d-715c-42b4-b445-2e8a81315677\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k4lcr" Jul 17 18:46:18.022377 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.022241 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmdh6\" (UniqueName: \"kubernetes.io/projected/061c236d-715c-42b4-b445-2e8a81315677-kube-api-access-hmdh6\") pod \"kube-state-metrics-56c5594674-k4lcr\" (UID: \"061c236d-715c-42b4-b445-2e8a81315677\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k4lcr" Jul 17 18:46:18.022377 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.022291 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/564ab632-9517-4a85-be6d-2b4720ba30f2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-bs5cb\" (UID: \"564ab632-9517-4a85-be6d-2b4720ba30f2\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bs5cb" Jul 17 18:46:18.022377 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.022346 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/84b8416d-b2ea-4511-aed6-79f917dcf41b-node-exporter-wtmp\") pod \"node-exporter-f6rlq\" (UID: \"84b8416d-b2ea-4511-aed6-79f917dcf41b\") " pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:18.022538 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.022414 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6cp5\" (UniqueName: \"kubernetes.io/projected/564ab632-9517-4a85-be6d-2b4720ba30f2-kube-api-access-k6cp5\") pod \"openshift-state-metrics-79f6958cdf-bs5cb\" (UID: \"564ab632-9517-4a85-be6d-2b4720ba30f2\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bs5cb" Jul 17 18:46:18.022538 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.022438 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/84b8416d-b2ea-4511-aed6-79f917dcf41b-node-exporter-tls\") pod \"node-exporter-f6rlq\" (UID: \"84b8416d-b2ea-4511-aed6-79f917dcf41b\") " pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:18.022538 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.022464 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7jj2\" (UniqueName: \"kubernetes.io/projected/84b8416d-b2ea-4511-aed6-79f917dcf41b-kube-api-access-n7jj2\") pod \"node-exporter-f6rlq\" (UID: \"84b8416d-b2ea-4511-aed6-79f917dcf41b\") " pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:18.022538 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.022512 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/061c236d-715c-42b4-b445-2e8a81315677-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-k4lcr\" (UID: \"061c236d-715c-42b4-b445-2e8a81315677\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k4lcr" Jul 17 18:46:18.022735 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.022542 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84b8416d-b2ea-4511-aed6-79f917dcf41b-sys\") pod \"node-exporter-f6rlq\" (UID: \"84b8416d-b2ea-4511-aed6-79f917dcf41b\") " pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:18.022735 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.022553 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/061c236d-715c-42b4-b445-2e8a81315677-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-k4lcr\" (UID: \"061c236d-715c-42b4-b445-2e8a81315677\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k4lcr" Jul 17 18:46:18.022735 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.022579 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/061c236d-715c-42b4-b445-2e8a81315677-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-k4lcr\" (UID: \"061c236d-715c-42b4-b445-2e8a81315677\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k4lcr" Jul 17 18:46:18.022735 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.022613 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/564ab632-9517-4a85-be6d-2b4720ba30f2-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-bs5cb\" (UID: \"564ab632-9517-4a85-be6d-2b4720ba30f2\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bs5cb" Jul 17 18:46:18.022735 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.022676 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/564ab632-9517-4a85-be6d-2b4720ba30f2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-bs5cb\" (UID: \"564ab632-9517-4a85-be6d-2b4720ba30f2\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bs5cb" Jul 17 18:46:18.022735 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.022702 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/84b8416d-b2ea-4511-aed6-79f917dcf41b-root\") pod \"node-exporter-f6rlq\" (UID: \"84b8416d-b2ea-4511-aed6-79f917dcf41b\") " pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:18.022735 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.022725 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/84b8416d-b2ea-4511-aed6-79f917dcf41b-node-exporter-textfile\") pod \"node-exporter-f6rlq\" (UID: \"84b8416d-b2ea-4511-aed6-79f917dcf41b\") " pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:18.023275 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.022769 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84b8416d-b2ea-4511-aed6-79f917dcf41b-metrics-client-ca\") pod \"node-exporter-f6rlq\" (UID: \"84b8416d-b2ea-4511-aed6-79f917dcf41b\") " pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:18.023275 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.022808 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/84b8416d-b2ea-4511-aed6-79f917dcf41b-node-exporter-accelerators-collector-config\") pod \"node-exporter-f6rlq\" (UID: \"84b8416d-b2ea-4511-aed6-79f917dcf41b\") " pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:18.023275 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.023195 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/84b8416d-b2ea-4511-aed6-79f917dcf41b-node-exporter-wtmp\") pod \"node-exporter-f6rlq\" (UID: \"84b8416d-b2ea-4511-aed6-79f917dcf41b\") " pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:18.023275 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.023249 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/84b8416d-b2ea-4511-aed6-79f917dcf41b-root\") pod \"node-exporter-f6rlq\" (UID: \"84b8416d-b2ea-4511-aed6-79f917dcf41b\") " pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:18.023503 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.023453 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/84b8416d-b2ea-4511-aed6-79f917dcf41b-node-exporter-accelerators-collector-config\") pod \"node-exporter-f6rlq\" (UID: \"84b8416d-b2ea-4511-aed6-79f917dcf41b\") " pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:18.023579 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.023552 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/564ab632-9517-4a85-be6d-2b4720ba30f2-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-bs5cb\" (UID: \"564ab632-9517-4a85-be6d-2b4720ba30f2\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bs5cb" Jul 17 18:46:18.023965 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.023774 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/84b8416d-b2ea-4511-aed6-79f917dcf41b-node-exporter-textfile\") pod \"node-exporter-f6rlq\" (UID: \"84b8416d-b2ea-4511-aed6-79f917dcf41b\") " pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:18.024437 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:46:18.024117 2559 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 17 18:46:18.024437 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:46:18.024178 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/564ab632-9517-4a85-be6d-2b4720ba30f2-openshift-state-metrics-tls podName:564ab632-9517-4a85-be6d-2b4720ba30f2 nodeName:}" failed. No retries permitted until 2026-07-17 18:46:18.52415953 +0000 UTC m=+87.555772394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/564ab632-9517-4a85-be6d-2b4720ba30f2-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-bs5cb" (UID: "564ab632-9517-4a85-be6d-2b4720ba30f2") : secret "openshift-state-metrics-tls" not found Jul 17 18:46:18.024584 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.024435 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84b8416d-b2ea-4511-aed6-79f917dcf41b-metrics-client-ca\") pod \"node-exporter-f6rlq\" (UID: \"84b8416d-b2ea-4511-aed6-79f917dcf41b\") " pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:18.024584 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.024520 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/061c236d-715c-42b4-b445-2e8a81315677-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-k4lcr\" (UID: \"061c236d-715c-42b4-b445-2e8a81315677\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k4lcr" Jul 17 18:46:18.025211 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.025079 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/061c236d-715c-42b4-b445-2e8a81315677-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-k4lcr\" (UID: \"061c236d-715c-42b4-b445-2e8a81315677\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k4lcr" Jul 17 18:46:18.025578 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.025506 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/061c236d-715c-42b4-b445-2e8a81315677-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-k4lcr\" (UID: \"061c236d-715c-42b4-b445-2e8a81315677\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k4lcr" Jul 17 18:46:18.025991 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.025957 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/061c236d-715c-42b4-b445-2e8a81315677-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-k4lcr\" (UID: \"061c236d-715c-42b4-b445-2e8a81315677\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k4lcr" Jul 17 18:46:18.026577 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.026536 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84b8416d-b2ea-4511-aed6-79f917dcf41b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f6rlq\" (UID: \"84b8416d-b2ea-4511-aed6-79f917dcf41b\") " pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:18.027105 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.027082 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/061c236d-715c-42b4-b445-2e8a81315677-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-k4lcr\" (UID: \"061c236d-715c-42b4-b445-2e8a81315677\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k4lcr" Jul 17 18:46:18.028303 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.028236 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/84b8416d-b2ea-4511-aed6-79f917dcf41b-node-exporter-tls\") pod \"node-exporter-f6rlq\" (UID: \"84b8416d-b2ea-4511-aed6-79f917dcf41b\") " pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:18.029765 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.029743 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/564ab632-9517-4a85-be6d-2b4720ba30f2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-bs5cb\" (UID: \"564ab632-9517-4a85-be6d-2b4720ba30f2\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bs5cb" Jul 17 18:46:18.038600 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.038560 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6cp5\" (UniqueName: \"kubernetes.io/projected/564ab632-9517-4a85-be6d-2b4720ba30f2-kube-api-access-k6cp5\") pod \"openshift-state-metrics-79f6958cdf-bs5cb\" (UID: \"564ab632-9517-4a85-be6d-2b4720ba30f2\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bs5cb" Jul 17 18:46:18.039075 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.039055 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7jj2\" (UniqueName: \"kubernetes.io/projected/84b8416d-b2ea-4511-aed6-79f917dcf41b-kube-api-access-n7jj2\") pod \"node-exporter-f6rlq\" (UID: \"84b8416d-b2ea-4511-aed6-79f917dcf41b\") " pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:18.039165 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.039151 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmdh6\" (UniqueName: \"kubernetes.io/projected/061c236d-715c-42b4-b445-2e8a81315677-kube-api-access-hmdh6\") pod \"kube-state-metrics-56c5594674-k4lcr\" (UID: \"061c236d-715c-42b4-b445-2e8a81315677\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-k4lcr" Jul 17 18:46:18.105333 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.105275 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:18.136169 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.136134 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f6rlq" Jul 17 18:46:18.156327 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.156277 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-k4lcr" Jul 17 18:46:18.173506 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:46:18.173478 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84b8416d_b2ea_4511_aed6_79f917dcf41b.slice/crio-d2de1c4c7842c8bb85456316ff47490beddc773818d038e4ccf9daa3b050cf55 WatchSource:0}: Error finding container d2de1c4c7842c8bb85456316ff47490beddc773818d038e4ccf9daa3b050cf55: Status 404 returned error can't find the container with id d2de1c4c7842c8bb85456316ff47490beddc773818d038e4ccf9daa3b050cf55 Jul 17 18:46:18.202283 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.202254 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:18.273370 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.269055 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:18.388305 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.388268 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-k4lcr"] Jul 17 18:46:18.391986 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:46:18.391944 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod061c236d_715c_42b4_b445_2e8a81315677.slice/crio-7b1435348044fb13cd6177112532be5a1b0c542882487042ddce5fe630bb50e7 WatchSource:0}: Error finding container 7b1435348044fb13cd6177112532be5a1b0c542882487042ddce5fe630bb50e7: Status 404 returned error can't find the container with id 7b1435348044fb13cd6177112532be5a1b0c542882487042ddce5fe630bb50e7 Jul 17 18:46:18.530123 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.530049 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/564ab632-9517-4a85-be6d-2b4720ba30f2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-bs5cb\" (UID: \"564ab632-9517-4a85-be6d-2b4720ba30f2\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bs5cb" Jul 17 18:46:18.532780 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.532755 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/564ab632-9517-4a85-be6d-2b4720ba30f2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-bs5cb\" (UID: \"564ab632-9517-4a85-be6d-2b4720ba30f2\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bs5cb" Jul 17 18:46:18.666639 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.666599 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:18.712830 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.712798 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bs5cb" Jul 17 18:46:18.752045 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.752012 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:18.756009 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.755979 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 18:46:18.775561 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.775531 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.777424 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.777387 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 18:46:18.778919 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.778740 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 17 18:46:18.779035 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.778956 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 17 18:46:18.779406 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.779157 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 17 18:46:18.784052 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.783996 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 17 18:46:18.784221 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.784203 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 17 18:46:18.784456 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.784440 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 17 18:46:18.784657 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.784642 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 17 18:46:18.784935 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.784918 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4s45f\"" Jul 17 18:46:18.785674 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.785490 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 17 18:46:18.785674 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.785673 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 17 18:46:18.832559 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.832523 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e914793-46ea-4037-91df-cd04bc9d9764-config-out\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.832726 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.832584 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.832726 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.832619 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-config-volume\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.832726 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.832636 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-857t6\" (UniqueName: \"kubernetes.io/projected/3e914793-46ea-4037-91df-cd04bc9d9764-kube-api-access-857t6\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.832726 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.832660 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.832726 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.832685 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3e914793-46ea-4037-91df-cd04bc9d9764-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.832726 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.832714 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e914793-46ea-4037-91df-cd04bc9d9764-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.833107 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.832756 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-web-config\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.833107 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.832782 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.833107 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.832862 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e914793-46ea-4037-91df-cd04bc9d9764-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.833107 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.832935 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e914793-46ea-4037-91df-cd04bc9d9764-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.833107 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.832967 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.833107 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.833065 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.888041 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.888007 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:18.901377 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.900619 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-k4lcr" event={"ID":"061c236d-715c-42b4-b445-2e8a81315677","Type":"ContainerStarted","Data":"7b1435348044fb13cd6177112532be5a1b0c542882487042ddce5fe630bb50e7"} Jul 17 18:46:18.902778 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.902750 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f6rlq" event={"ID":"84b8416d-b2ea-4511-aed6-79f917dcf41b","Type":"ContainerStarted","Data":"d2de1c4c7842c8bb85456316ff47490beddc773818d038e4ccf9daa3b050cf55"} Jul 17 18:46:18.919032 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.919006 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-bs5cb"] Jul 17 18:46:18.920896 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:46:18.920871 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod564ab632_9517_4a85_be6d_2b4720ba30f2.slice/crio-a040e754c5f84fe114c96565e597a14a4693fb67b54ca2cf179916285f3dad58 WatchSource:0}: Error finding container a040e754c5f84fe114c96565e597a14a4693fb67b54ca2cf179916285f3dad58: Status 404 returned error can't find the container with id a040e754c5f84fe114c96565e597a14a4693fb67b54ca2cf179916285f3dad58 Jul 17 18:46:18.934560 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.933860 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-web-config\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.934560 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.933901 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.934560 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.933929 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e914793-46ea-4037-91df-cd04bc9d9764-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.934560 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.933962 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e914793-46ea-4037-91df-cd04bc9d9764-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.934560 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.933985 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.934560 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.934015 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.934560 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.934058 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e914793-46ea-4037-91df-cd04bc9d9764-config-out\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.934560 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.934084 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.934560 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.934108 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-config-volume\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.934560 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.934129 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-857t6\" (UniqueName: \"kubernetes.io/projected/3e914793-46ea-4037-91df-cd04bc9d9764-kube-api-access-857t6\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.934560 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.934158 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.934560 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.934185 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3e914793-46ea-4037-91df-cd04bc9d9764-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.934560 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.934209 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e914793-46ea-4037-91df-cd04bc9d9764-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.935639 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.935615 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e914793-46ea-4037-91df-cd04bc9d9764-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.937238 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:46:18.936104 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3e914793-46ea-4037-91df-cd04bc9d9764-alertmanager-trusted-ca-bundle podName:3e914793-46ea-4037-91df-cd04bc9d9764 nodeName:}" failed. No retries permitted until 2026-07-17 18:46:19.436085504 +0000 UTC m=+88.467698371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/3e914793-46ea-4037-91df-cd04bc9d9764-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "3e914793-46ea-4037-91df-cd04bc9d9764") : configmap references non-existent config key: ca-bundle.crt Jul 17 18:46:18.939268 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.938930 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3e914793-46ea-4037-91df-cd04bc9d9764-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.942511 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.942460 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-config-volume\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.942606 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.942517 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.943217 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.943109 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e914793-46ea-4037-91df-cd04bc9d9764-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.943217 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.943109 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.943217 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.943176 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.943473 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.943452 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-web-config\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.943589 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.943567 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.945732 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.945561 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.945732 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.945705 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e914793-46ea-4037-91df-cd04bc9d9764-config-out\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:18.946287 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:18.946247 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-857t6\" (UniqueName: \"kubernetes.io/projected/3e914793-46ea-4037-91df-cd04bc9d9764-kube-api-access-857t6\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:19.121197 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:19.121136 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:19.222667 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:19.222610 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:19.440943 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:19.439823 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e914793-46ea-4037-91df-cd04bc9d9764-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:19.440943 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:19.440882 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e914793-46ea-4037-91df-cd04bc9d9764-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:19.696375 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:19.696280 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:46:19.910183 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:19.910144 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bs5cb" event={"ID":"564ab632-9517-4a85-be6d-2b4720ba30f2","Type":"ContainerStarted","Data":"53aed17d6e40b86b1d52242e1f374405d9aff7d799791633a0ed6635b4e791af"} Jul 17 18:46:19.910734 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:19.910217 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bs5cb" event={"ID":"564ab632-9517-4a85-be6d-2b4720ba30f2","Type":"ContainerStarted","Data":"ecb28c3a59b106c0fe775bb6eb91b2217791439816291948fffa85bdf9c8e61a"} Jul 17 18:46:19.910734 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:19.910250 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bs5cb" event={"ID":"564ab632-9517-4a85-be6d-2b4720ba30f2","Type":"ContainerStarted","Data":"a040e754c5f84fe114c96565e597a14a4693fb67b54ca2cf179916285f3dad58"} Jul 17 18:46:20.684921 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:20.684891 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:20.874496 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:20.874452 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:20.938824 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:20.937445 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7b896b5749-qzwwf"] Jul 17 18:46:20.969866 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:20.969841 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" Jul 17 18:46:20.973842 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:20.973808 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b896b5749-qzwwf"] Jul 17 18:46:20.975906 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:20.975177 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 17 18:46:20.975906 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:20.975227 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-47ommvhd9abd2\"" Jul 17 18:46:20.975906 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:20.975177 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 17 18:46:20.975906 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:20.975506 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-v87mj\"" Jul 17 18:46:20.975906 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:20.975662 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 17 18:46:20.975906 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:20.975737 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 17 18:46:20.977237 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:20.977217 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 17 18:46:21.059041 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.059011 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/939fbff4-14a7-4143-a217-92ff90d33707-secret-grpc-tls\") pod \"thanos-querier-7b896b5749-qzwwf\" (UID: \"939fbff4-14a7-4143-a217-92ff90d33707\") " pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" Jul 17 18:46:21.059168 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.059061 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcfdr\" (UniqueName: \"kubernetes.io/projected/939fbff4-14a7-4143-a217-92ff90d33707-kube-api-access-mcfdr\") pod \"thanos-querier-7b896b5749-qzwwf\" (UID: \"939fbff4-14a7-4143-a217-92ff90d33707\") " pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" Jul 17 18:46:21.059168 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.059122 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/939fbff4-14a7-4143-a217-92ff90d33707-metrics-client-ca\") pod \"thanos-querier-7b896b5749-qzwwf\" (UID: \"939fbff4-14a7-4143-a217-92ff90d33707\") " pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" Jul 17 18:46:21.059293 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.059165 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/939fbff4-14a7-4143-a217-92ff90d33707-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b896b5749-qzwwf\" (UID: \"939fbff4-14a7-4143-a217-92ff90d33707\") " pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" Jul 17 18:46:21.059293 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.059199 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/939fbff4-14a7-4143-a217-92ff90d33707-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b896b5749-qzwwf\" (UID: \"939fbff4-14a7-4143-a217-92ff90d33707\") " pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" Jul 17 18:46:21.059293 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.059259 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/939fbff4-14a7-4143-a217-92ff90d33707-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b896b5749-qzwwf\" (UID: \"939fbff4-14a7-4143-a217-92ff90d33707\") " pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" Jul 17 18:46:21.059514 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.059291 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/939fbff4-14a7-4143-a217-92ff90d33707-secret-thanos-querier-tls\") pod \"thanos-querier-7b896b5749-qzwwf\" (UID: \"939fbff4-14a7-4143-a217-92ff90d33707\") " pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" Jul 17 18:46:21.059514 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.059397 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/939fbff4-14a7-4143-a217-92ff90d33707-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b896b5749-qzwwf\" (UID: \"939fbff4-14a7-4143-a217-92ff90d33707\") " pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" Jul 17 18:46:21.143084 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.143000 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:21.144212 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.143662 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 18:46:21.160924 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.160585 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/939fbff4-14a7-4143-a217-92ff90d33707-secret-grpc-tls\") pod \"thanos-querier-7b896b5749-qzwwf\" (UID: \"939fbff4-14a7-4143-a217-92ff90d33707\") " pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" Jul 17 18:46:21.160924 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.160635 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcfdr\" (UniqueName: \"kubernetes.io/projected/939fbff4-14a7-4143-a217-92ff90d33707-kube-api-access-mcfdr\") pod \"thanos-querier-7b896b5749-qzwwf\" (UID: \"939fbff4-14a7-4143-a217-92ff90d33707\") " pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" Jul 17 18:46:21.160924 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.160670 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/939fbff4-14a7-4143-a217-92ff90d33707-metrics-client-ca\") pod \"thanos-querier-7b896b5749-qzwwf\" (UID: \"939fbff4-14a7-4143-a217-92ff90d33707\") " pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" Jul 17 18:46:21.160924 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.160708 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/939fbff4-14a7-4143-a217-92ff90d33707-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b896b5749-qzwwf\" (UID: \"939fbff4-14a7-4143-a217-92ff90d33707\") " pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" Jul 17 18:46:21.160924 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.160737 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/939fbff4-14a7-4143-a217-92ff90d33707-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b896b5749-qzwwf\" (UID: \"939fbff4-14a7-4143-a217-92ff90d33707\") " pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" Jul 17 18:46:21.160924 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.160800 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/939fbff4-14a7-4143-a217-92ff90d33707-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b896b5749-qzwwf\" (UID: \"939fbff4-14a7-4143-a217-92ff90d33707\") " pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" Jul 17 18:46:21.160924 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.160829 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/939fbff4-14a7-4143-a217-92ff90d33707-secret-thanos-querier-tls\") pod \"thanos-querier-7b896b5749-qzwwf\" (UID: \"939fbff4-14a7-4143-a217-92ff90d33707\") " pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" Jul 17 18:46:21.160924 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.160872 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/939fbff4-14a7-4143-a217-92ff90d33707-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b896b5749-qzwwf\" (UID: \"939fbff4-14a7-4143-a217-92ff90d33707\") " pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" Jul 17 18:46:21.166436 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.164286 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/939fbff4-14a7-4143-a217-92ff90d33707-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b896b5749-qzwwf\" (UID: \"939fbff4-14a7-4143-a217-92ff90d33707\") " pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" Jul 17 18:46:21.166436 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.165145 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/939fbff4-14a7-4143-a217-92ff90d33707-metrics-client-ca\") pod \"thanos-querier-7b896b5749-qzwwf\" (UID: \"939fbff4-14a7-4143-a217-92ff90d33707\") " pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" Jul 17 18:46:21.167655 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.167626 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/939fbff4-14a7-4143-a217-92ff90d33707-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b896b5749-qzwwf\" (UID: \"939fbff4-14a7-4143-a217-92ff90d33707\") " pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" Jul 17 18:46:21.169548 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.168300 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/939fbff4-14a7-4143-a217-92ff90d33707-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b896b5749-qzwwf\" (UID: \"939fbff4-14a7-4143-a217-92ff90d33707\") " pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" Jul 17 18:46:21.169548 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.168642 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/939fbff4-14a7-4143-a217-92ff90d33707-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b896b5749-qzwwf\" (UID: \"939fbff4-14a7-4143-a217-92ff90d33707\") " pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" Jul 17 18:46:21.169702 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.169656 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/939fbff4-14a7-4143-a217-92ff90d33707-secret-grpc-tls\") pod \"thanos-querier-7b896b5749-qzwwf\" (UID: \"939fbff4-14a7-4143-a217-92ff90d33707\") " pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" Jul 17 18:46:21.172697 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.172526 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/939fbff4-14a7-4143-a217-92ff90d33707-secret-thanos-querier-tls\") pod \"thanos-querier-7b896b5749-qzwwf\" (UID: \"939fbff4-14a7-4143-a217-92ff90d33707\") " pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" Jul 17 18:46:21.198975 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.198913 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcfdr\" (UniqueName: \"kubernetes.io/projected/939fbff4-14a7-4143-a217-92ff90d33707-kube-api-access-mcfdr\") pod \"thanos-querier-7b896b5749-qzwwf\" (UID: \"939fbff4-14a7-4143-a217-92ff90d33707\") " pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" Jul 17 18:46:21.303777 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.303618 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" Jul 17 18:46:21.528118 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.528083 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b896b5749-qzwwf"] Jul 17 18:46:21.532137 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:46:21.532106 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod939fbff4_14a7_4143_a217_92ff90d33707.slice/crio-e8a6381dfaf332eedc6bb73e2beaf3abbc49f9ad1a2da7fdb4b32264797dd0af WatchSource:0}: Error finding container e8a6381dfaf332eedc6bb73e2beaf3abbc49f9ad1a2da7fdb4b32264797dd0af: Status 404 returned error can't find the container with id e8a6381dfaf332eedc6bb73e2beaf3abbc49f9ad1a2da7fdb4b32264797dd0af Jul 17 18:46:21.922846 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.922808 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-k4lcr" event={"ID":"061c236d-715c-42b4-b445-2e8a81315677","Type":"ContainerStarted","Data":"ebaff8f1b33f7d2f4910796354344ce6c6131059da5b6955d37ea95d9b1a6815"} Jul 17 18:46:21.923062 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.922877 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-k4lcr" event={"ID":"061c236d-715c-42b4-b445-2e8a81315677","Type":"ContainerStarted","Data":"f1d1373f9a15e5c6bd9f5b12cc4d5ea153727520885d4cb32823c59bb445dd82"} Jul 17 18:46:21.923062 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.922904 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-k4lcr" event={"ID":"061c236d-715c-42b4-b445-2e8a81315677","Type":"ContainerStarted","Data":"c22d3735987cb1aedc9f591e3d653363ceef6ac5f422f98cc60dbcfa24eec6cf"} Jul 17 18:46:21.925040 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.925008 2559 generic.go:356] "Generic (PLEG): container finished" podID="84b8416d-b2ea-4511-aed6-79f917dcf41b" containerID="8fb9429b8cc581fe0ef8027b2a5748d9d28c9f9caa9cc40d1a5c212ffc80e2bc" exitCode=0 Jul 17 18:46:21.925167 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.925092 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f6rlq" event={"ID":"84b8416d-b2ea-4511-aed6-79f917dcf41b","Type":"ContainerDied","Data":"8fb9429b8cc581fe0ef8027b2a5748d9d28c9f9caa9cc40d1a5c212ffc80e2bc"} Jul 17 18:46:21.926872 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.926790 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e914793-46ea-4037-91df-cd04bc9d9764","Type":"ContainerStarted","Data":"0b0cb383fb716cf2453806a27327e482abea487d950dddc30e03349e3da5a63f"} Jul 17 18:46:21.928491 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.928257 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" event={"ID":"939fbff4-14a7-4143-a217-92ff90d33707","Type":"ContainerStarted","Data":"e8a6381dfaf332eedc6bb73e2beaf3abbc49f9ad1a2da7fdb4b32264797dd0af"} Jul 17 18:46:21.930827 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.930799 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bs5cb" event={"ID":"564ab632-9517-4a85-be6d-2b4720ba30f2","Type":"ContainerStarted","Data":"1f222f044a5d1fe5bb7b0ed9e4e37413489f5a56d0235ac45da3603b47a0e364"} Jul 17 18:46:21.970452 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:21.969457 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-k4lcr" podStartSLOduration=2.4388894 podStartE2EDuration="4.969435005s" totalImagesPullingTime="2.530545605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:46:21.968111812 +0000 UTC m=+90.999724686" watchObservedRunningTime="2026-07-17 18:46:21.969435005 +0000 UTC m=+91.001047880" Jul 17 18:46:22.027403 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.027373 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:22.076374 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.076302 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-bs5cb" podStartSLOduration=2.98185142 podStartE2EDuration="5.076286992s" totalImagesPullingTime="2.094435572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:46:22.075649554 +0000 UTC m=+91.107262428" watchObservedRunningTime="2026-07-17 18:46:22.076286992 +0000 UTC m=+91.107899865" Jul 17 18:46:22.234140 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.234035 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:22.295797 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.294266 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-594b5cf56d-x5gsm"] Jul 17 18:46:22.311950 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.310736 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" Jul 17 18:46:22.321738 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.320392 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-896og9ldhf1k9\"" Jul 17 18:46:22.321738 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.320739 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 17 18:46:22.321738 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.320945 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jgpjm\"" Jul 17 18:46:22.321738 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.321130 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 17 18:46:22.321738 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.321329 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 17 18:46:22.321738 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.321594 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 17 18:46:22.342243 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.342117 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-594b5cf56d-x5gsm"] Jul 17 18:46:22.374014 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.373851 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eb2605f4-45b5-4e77-ad61-9b6224166897-secret-metrics-server-tls\") pod \"metrics-server-594b5cf56d-x5gsm\" (UID: \"eb2605f4-45b5-4e77-ad61-9b6224166897\") " pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" Jul 17 18:46:22.374014 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.373921 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eb2605f4-45b5-4e77-ad61-9b6224166897-metrics-server-audit-profiles\") pod \"metrics-server-594b5cf56d-x5gsm\" (UID: \"eb2605f4-45b5-4e77-ad61-9b6224166897\") " pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" Jul 17 18:46:22.374014 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.373953 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb2605f4-45b5-4e77-ad61-9b6224166897-client-ca-bundle\") pod \"metrics-server-594b5cf56d-x5gsm\" (UID: \"eb2605f4-45b5-4e77-ad61-9b6224166897\") " pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" Jul 17 18:46:22.374304 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.374045 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eb2605f4-45b5-4e77-ad61-9b6224166897-secret-metrics-server-client-certs\") pod \"metrics-server-594b5cf56d-x5gsm\" (UID: \"eb2605f4-45b5-4e77-ad61-9b6224166897\") " pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" Jul 17 18:46:22.374304 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.374083 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eb2605f4-45b5-4e77-ad61-9b6224166897-audit-log\") pod \"metrics-server-594b5cf56d-x5gsm\" (UID: \"eb2605f4-45b5-4e77-ad61-9b6224166897\") " pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" Jul 17 18:46:22.374304 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.374120 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdnz4\" (UniqueName: \"kubernetes.io/projected/eb2605f4-45b5-4e77-ad61-9b6224166897-kube-api-access-pdnz4\") pod \"metrics-server-594b5cf56d-x5gsm\" (UID: \"eb2605f4-45b5-4e77-ad61-9b6224166897\") " pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" Jul 17 18:46:22.374304 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.374149 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb2605f4-45b5-4e77-ad61-9b6224166897-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-594b5cf56d-x5gsm\" (UID: \"eb2605f4-45b5-4e77-ad61-9b6224166897\") " pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" Jul 17 18:46:22.475387 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.475343 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eb2605f4-45b5-4e77-ad61-9b6224166897-metrics-server-audit-profiles\") pod \"metrics-server-594b5cf56d-x5gsm\" (UID: \"eb2605f4-45b5-4e77-ad61-9b6224166897\") " pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" Jul 17 18:46:22.475587 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.475402 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb2605f4-45b5-4e77-ad61-9b6224166897-client-ca-bundle\") pod \"metrics-server-594b5cf56d-x5gsm\" (UID: \"eb2605f4-45b5-4e77-ad61-9b6224166897\") " pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" Jul 17 18:46:22.475587 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.475467 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eb2605f4-45b5-4e77-ad61-9b6224166897-secret-metrics-server-client-certs\") pod \"metrics-server-594b5cf56d-x5gsm\" (UID: \"eb2605f4-45b5-4e77-ad61-9b6224166897\") " pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" Jul 17 18:46:22.475587 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.475493 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eb2605f4-45b5-4e77-ad61-9b6224166897-audit-log\") pod \"metrics-server-594b5cf56d-x5gsm\" (UID: \"eb2605f4-45b5-4e77-ad61-9b6224166897\") " pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" Jul 17 18:46:22.475587 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.475519 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdnz4\" (UniqueName: \"kubernetes.io/projected/eb2605f4-45b5-4e77-ad61-9b6224166897-kube-api-access-pdnz4\") pod \"metrics-server-594b5cf56d-x5gsm\" (UID: \"eb2605f4-45b5-4e77-ad61-9b6224166897\") " pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" Jul 17 18:46:22.475587 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.475547 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb2605f4-45b5-4e77-ad61-9b6224166897-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-594b5cf56d-x5gsm\" (UID: \"eb2605f4-45b5-4e77-ad61-9b6224166897\") " pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" Jul 17 18:46:22.475862 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.475606 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eb2605f4-45b5-4e77-ad61-9b6224166897-secret-metrics-server-tls\") pod \"metrics-server-594b5cf56d-x5gsm\" (UID: \"eb2605f4-45b5-4e77-ad61-9b6224166897\") " pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" Jul 17 18:46:22.477748 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.477718 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eb2605f4-45b5-4e77-ad61-9b6224166897-audit-log\") pod \"metrics-server-594b5cf56d-x5gsm\" (UID: \"eb2605f4-45b5-4e77-ad61-9b6224166897\") " pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" Jul 17 18:46:22.478100 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.478051 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb2605f4-45b5-4e77-ad61-9b6224166897-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-594b5cf56d-x5gsm\" (UID: \"eb2605f4-45b5-4e77-ad61-9b6224166897\") " pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" Jul 17 18:46:22.479961 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.479904 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eb2605f4-45b5-4e77-ad61-9b6224166897-secret-metrics-server-client-certs\") pod \"metrics-server-594b5cf56d-x5gsm\" (UID: \"eb2605f4-45b5-4e77-ad61-9b6224166897\") " pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" Jul 17 18:46:22.480330 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.480272 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eb2605f4-45b5-4e77-ad61-9b6224166897-metrics-server-audit-profiles\") pod \"metrics-server-594b5cf56d-x5gsm\" (UID: \"eb2605f4-45b5-4e77-ad61-9b6224166897\") " pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" Jul 17 18:46:22.480949 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.480904 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eb2605f4-45b5-4e77-ad61-9b6224166897-secret-metrics-server-tls\") pod \"metrics-server-594b5cf56d-x5gsm\" (UID: \"eb2605f4-45b5-4e77-ad61-9b6224166897\") " pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" Jul 17 18:46:22.486571 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.486478 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb2605f4-45b5-4e77-ad61-9b6224166897-client-ca-bundle\") pod \"metrics-server-594b5cf56d-x5gsm\" (UID: \"eb2605f4-45b5-4e77-ad61-9b6224166897\") " pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" Jul 17 18:46:22.507427 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.507369 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdnz4\" (UniqueName: \"kubernetes.io/projected/eb2605f4-45b5-4e77-ad61-9b6224166897-kube-api-access-pdnz4\") pod \"metrics-server-594b5cf56d-x5gsm\" (UID: \"eb2605f4-45b5-4e77-ad61-9b6224166897\") " pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" Jul 17 18:46:22.609225 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.609150 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:22.621027 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.620993 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-4c6b9"] Jul 17 18:46:22.626627 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.626599 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" Jul 17 18:46:22.648420 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.648376 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bfc878459-8fttq"] Jul 17 18:46:22.648420 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.648414 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-4c6b9" Jul 17 18:46:22.656722 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.656529 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-xhrbb\"" Jul 17 18:46:22.656722 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.656624 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 17 18:46:22.675346 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.672446 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-4c6b9"] Jul 17 18:46:22.675346 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.672567 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:46:22.689740 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.689663 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bfc878459-8fttq"] Jul 17 18:46:22.760342 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.760223 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:22.779774 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.779740 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/531efd22-2331-4027-bb5a-121b025ca91d-service-ca\") pod \"console-6bfc878459-8fttq\" (UID: \"531efd22-2331-4027-bb5a-121b025ca91d\") " pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:46:22.779913 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.779781 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/531efd22-2331-4027-bb5a-121b025ca91d-oauth-serving-cert\") pod \"console-6bfc878459-8fttq\" (UID: \"531efd22-2331-4027-bb5a-121b025ca91d\") " pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:46:22.779913 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.779849 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjmpg\" (UniqueName: \"kubernetes.io/projected/531efd22-2331-4027-bb5a-121b025ca91d-kube-api-access-kjmpg\") pod \"console-6bfc878459-8fttq\" (UID: \"531efd22-2331-4027-bb5a-121b025ca91d\") " pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:46:22.779913 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.779880 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/531efd22-2331-4027-bb5a-121b025ca91d-console-oauth-config\") pod \"console-6bfc878459-8fttq\" (UID: \"531efd22-2331-4027-bb5a-121b025ca91d\") " pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:46:22.780083 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.779979 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/531efd22-2331-4027-bb5a-121b025ca91d-console-config\") pod \"console-6bfc878459-8fttq\" (UID: \"531efd22-2331-4027-bb5a-121b025ca91d\") " pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:46:22.780083 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.780014 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7d92\" (UniqueName: \"kubernetes.io/projected/032dd9c6-69f1-4c46-badd-1a7394e5fd05-kube-api-access-d7d92\") pod \"monitoring-plugin-7b7b7bc8bf-4c6b9\" (UID: \"032dd9c6-69f1-4c46-badd-1a7394e5fd05\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-4c6b9" Jul 17 18:46:22.780083 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.780042 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/531efd22-2331-4027-bb5a-121b025ca91d-trusted-ca-bundle\") pod \"console-6bfc878459-8fttq\" (UID: \"531efd22-2331-4027-bb5a-121b025ca91d\") " pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:46:22.780279 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.780110 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/531efd22-2331-4027-bb5a-121b025ca91d-console-serving-cert\") pod \"console-6bfc878459-8fttq\" (UID: \"531efd22-2331-4027-bb5a-121b025ca91d\") " pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:46:22.780279 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.780151 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/032dd9c6-69f1-4c46-badd-1a7394e5fd05-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-4c6b9\" (UID: \"032dd9c6-69f1-4c46-badd-1a7394e5fd05\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-4c6b9" Jul 17 18:46:22.847612 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.846302 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-594b5cf56d-x5gsm"] Jul 17 18:46:22.850622 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.850576 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:22.851872 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:46:22.851813 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb2605f4_45b5_4e77_ad61_9b6224166897.slice/crio-f43b2f2d7fec5c7ebae61e9862263469cc48c30f31b8068b593d91d26082d0f0 WatchSource:0}: Error finding container f43b2f2d7fec5c7ebae61e9862263469cc48c30f31b8068b593d91d26082d0f0: Status 404 returned error can't find the container with id f43b2f2d7fec5c7ebae61e9862263469cc48c30f31b8068b593d91d26082d0f0 Jul 17 18:46:22.880764 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.880734 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/531efd22-2331-4027-bb5a-121b025ca91d-service-ca\") pod \"console-6bfc878459-8fttq\" (UID: \"531efd22-2331-4027-bb5a-121b025ca91d\") " pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:46:22.880908 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.880775 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/531efd22-2331-4027-bb5a-121b025ca91d-oauth-serving-cert\") pod \"console-6bfc878459-8fttq\" (UID: \"531efd22-2331-4027-bb5a-121b025ca91d\") " pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:46:22.880908 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.880840 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjmpg\" (UniqueName: \"kubernetes.io/projected/531efd22-2331-4027-bb5a-121b025ca91d-kube-api-access-kjmpg\") pod \"console-6bfc878459-8fttq\" (UID: \"531efd22-2331-4027-bb5a-121b025ca91d\") " pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:46:22.880908 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.880870 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/531efd22-2331-4027-bb5a-121b025ca91d-console-oauth-config\") pod \"console-6bfc878459-8fttq\" (UID: \"531efd22-2331-4027-bb5a-121b025ca91d\") " pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:46:22.880908 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.880899 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/531efd22-2331-4027-bb5a-121b025ca91d-console-config\") pod \"console-6bfc878459-8fttq\" (UID: \"531efd22-2331-4027-bb5a-121b025ca91d\") " pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:46:22.881092 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.880932 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7d92\" (UniqueName: \"kubernetes.io/projected/032dd9c6-69f1-4c46-badd-1a7394e5fd05-kube-api-access-d7d92\") pod \"monitoring-plugin-7b7b7bc8bf-4c6b9\" (UID: \"032dd9c6-69f1-4c46-badd-1a7394e5fd05\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-4c6b9" Jul 17 18:46:22.881092 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.880958 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/531efd22-2331-4027-bb5a-121b025ca91d-trusted-ca-bundle\") pod \"console-6bfc878459-8fttq\" (UID: \"531efd22-2331-4027-bb5a-121b025ca91d\") " pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:46:22.881092 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.881024 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/531efd22-2331-4027-bb5a-121b025ca91d-console-serving-cert\") pod \"console-6bfc878459-8fttq\" (UID: \"531efd22-2331-4027-bb5a-121b025ca91d\") " pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:46:22.881092 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.881055 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/032dd9c6-69f1-4c46-badd-1a7394e5fd05-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-4c6b9\" (UID: \"032dd9c6-69f1-4c46-badd-1a7394e5fd05\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-4c6b9" Jul 17 18:46:22.882575 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.882552 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/531efd22-2331-4027-bb5a-121b025ca91d-service-ca\") pod \"console-6bfc878459-8fttq\" (UID: \"531efd22-2331-4027-bb5a-121b025ca91d\") " pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:46:22.883211 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.883184 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/531efd22-2331-4027-bb5a-121b025ca91d-oauth-serving-cert\") pod \"console-6bfc878459-8fttq\" (UID: \"531efd22-2331-4027-bb5a-121b025ca91d\") " pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:46:22.883930 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.883370 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/531efd22-2331-4027-bb5a-121b025ca91d-trusted-ca-bundle\") pod \"console-6bfc878459-8fttq\" (UID: \"531efd22-2331-4027-bb5a-121b025ca91d\") " pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:46:22.883930 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.883588 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/531efd22-2331-4027-bb5a-121b025ca91d-console-config\") pod \"console-6bfc878459-8fttq\" (UID: \"531efd22-2331-4027-bb5a-121b025ca91d\") " pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:46:22.885263 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.885146 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/032dd9c6-69f1-4c46-badd-1a7394e5fd05-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-4c6b9\" (UID: \"032dd9c6-69f1-4c46-badd-1a7394e5fd05\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-4c6b9" Jul 17 18:46:22.886933 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.886899 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/531efd22-2331-4027-bb5a-121b025ca91d-console-serving-cert\") pod \"console-6bfc878459-8fttq\" (UID: \"531efd22-2331-4027-bb5a-121b025ca91d\") " pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:46:22.886933 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.886904 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/531efd22-2331-4027-bb5a-121b025ca91d-console-oauth-config\") pod \"console-6bfc878459-8fttq\" (UID: \"531efd22-2331-4027-bb5a-121b025ca91d\") " pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:46:22.893882 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.893839 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjmpg\" (UniqueName: \"kubernetes.io/projected/531efd22-2331-4027-bb5a-121b025ca91d-kube-api-access-kjmpg\") pod \"console-6bfc878459-8fttq\" (UID: \"531efd22-2331-4027-bb5a-121b025ca91d\") " pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:46:22.893983 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.893959 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7d92\" (UniqueName: \"kubernetes.io/projected/032dd9c6-69f1-4c46-badd-1a7394e5fd05-kube-api-access-d7d92\") pod \"monitoring-plugin-7b7b7bc8bf-4c6b9\" (UID: \"032dd9c6-69f1-4c46-badd-1a7394e5fd05\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-4c6b9" Jul 17 18:46:22.938374 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.938301 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" event={"ID":"eb2605f4-45b5-4e77-ad61-9b6224166897","Type":"ContainerStarted","Data":"f43b2f2d7fec5c7ebae61e9862263469cc48c30f31b8068b593d91d26082d0f0"} Jul 17 18:46:22.941212 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.941117 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f6rlq" event={"ID":"84b8416d-b2ea-4511-aed6-79f917dcf41b","Type":"ContainerStarted","Data":"8c35ad9fee173f42cc0d39957f7088b241061186f866afa36645a692d1cc316a"} Jul 17 18:46:22.941212 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.941185 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f6rlq" event={"ID":"84b8416d-b2ea-4511-aed6-79f917dcf41b","Type":"ContainerStarted","Data":"396a14851626e97a694ddda69d392a206564d8259a03e0006ac9e090021de674"} Jul 17 18:46:22.973370 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.973342 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-4c6b9" Jul 17 18:46:22.991995 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:22.991971 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:46:23.260694 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:23.260622 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:23.278992 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:23.278947 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f6rlq" podStartSLOduration=3.386762987 podStartE2EDuration="6.278930517s" totalImagesPullingTime="2.749026224s" totalInitContainerRuntime="143.141306ms" isStatefulPod=true podCreationTimestamp="2026-07-17 18:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:46:22.971327443 +0000 UTC m=+92.002940307" watchObservedRunningTime="2026-07-17 18:46:23.278930517 +0000 UTC m=+92.310543399" Jul 17 18:46:23.279239 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:23.279188 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bfc878459-8fttq"] Jul 17 18:46:23.282758 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:46:23.282732 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod531efd22_2331_4027_bb5a_121b025ca91d.slice/crio-ab347e77c70ed936cd5ec3dde47d3322d2c6f7ca7cea0cf14673dcc8122ba92d WatchSource:0}: Error finding container ab347e77c70ed936cd5ec3dde47d3322d2c6f7ca7cea0cf14673dcc8122ba92d: Status 404 returned error can't find the container with id ab347e77c70ed936cd5ec3dde47d3322d2c6f7ca7cea0cf14673dcc8122ba92d Jul 17 18:46:23.308931 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:23.308906 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-4c6b9"] Jul 17 18:46:23.313333 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:46:23.313283 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod032dd9c6_69f1_4c46_badd_1a7394e5fd05.slice/crio-15726347fa5f0b32b07032b3551bc294db1d378181903c87e843f69cd1dd9a3c WatchSource:0}: Error finding container 15726347fa5f0b32b07032b3551bc294db1d378181903c87e843f69cd1dd9a3c: Status 404 returned error can't find the container with id 15726347fa5f0b32b07032b3551bc294db1d378181903c87e843f69cd1dd9a3c Jul 17 18:46:23.387449 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:23.387417 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:23.954302 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:23.954263 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-4c6b9" event={"ID":"032dd9c6-69f1-4c46-badd-1a7394e5fd05","Type":"ContainerStarted","Data":"15726347fa5f0b32b07032b3551bc294db1d378181903c87e843f69cd1dd9a3c"} Jul 17 18:46:23.956429 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:23.956390 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bfc878459-8fttq" event={"ID":"531efd22-2331-4027-bb5a-121b025ca91d","Type":"ContainerStarted","Data":"3ec6231c21ae1d883f9e1329e0b3064bdeca62adf2b2353c107d95a7c27ea3b3"} Jul 17 18:46:23.956578 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:23.956451 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bfc878459-8fttq" event={"ID":"531efd22-2331-4027-bb5a-121b025ca91d","Type":"ContainerStarted","Data":"ab347e77c70ed936cd5ec3dde47d3322d2c6f7ca7cea0cf14673dcc8122ba92d"} Jul 17 18:46:23.959760 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:23.959728 2559 generic.go:356] "Generic (PLEG): container finished" podID="3e914793-46ea-4037-91df-cd04bc9d9764" containerID="742e6a174522b12a58e3ecbb000c02223957548e0dda6d31681771f3a1529751" exitCode=0 Jul 17 18:46:23.960583 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:23.960559 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e914793-46ea-4037-91df-cd04bc9d9764","Type":"ContainerDied","Data":"742e6a174522b12a58e3ecbb000c02223957548e0dda6d31681771f3a1529751"} Jul 17 18:46:23.995536 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:23.995484 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bfc878459-8fttq" podStartSLOduration=1.9954680470000001 podStartE2EDuration="1.995468047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:46:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:46:23.993731898 +0000 UTC m=+93.025344774" watchObservedRunningTime="2026-07-17 18:46:23.995468047 +0000 UTC m=+93.027080914" Jul 17 18:46:24.113942 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:24.113849 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:24.969852 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:24.969406 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" event={"ID":"939fbff4-14a7-4143-a217-92ff90d33707","Type":"ContainerStarted","Data":"ad2517e6501d1e0cf83a3477d32e846b9f79a1a9fdef999075c7a1f7102bf68d"} Jul 17 18:46:24.969852 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:24.969494 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" event={"ID":"939fbff4-14a7-4143-a217-92ff90d33707","Type":"ContainerStarted","Data":"cdcf1f2ab6316b36a0a42056be61544bdc9566a3c0d1636b909d3567a77ececa"} Jul 17 18:46:25.975945 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:25.975897 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" event={"ID":"939fbff4-14a7-4143-a217-92ff90d33707","Type":"ContainerStarted","Data":"cdab9b900291ee71bb6a215f869d8d99c6972b51537c559b34c343962b5baa37"} Jul 17 18:46:26.407980 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:26.407946 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:26.523648 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:26.523613 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:27.987037 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:27.986991 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" event={"ID":"939fbff4-14a7-4143-a217-92ff90d33707","Type":"ContainerStarted","Data":"63c3c49735e91ee7eb858affd0ef2a275a78628214bedc37fcc9abda66dd0436"} Jul 17 18:46:27.988672 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:27.988644 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-4c6b9" event={"ID":"032dd9c6-69f1-4c46-badd-1a7394e5fd05","Type":"ContainerStarted","Data":"31ae8648e254b7c5337dcf6ce29c4e10cfc83fd1f0c98f695a273d84201dd5e7"} Jul 17 18:46:27.988844 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:27.988800 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-4c6b9" Jul 17 18:46:27.993451 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:27.993433 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e914793-46ea-4037-91df-cd04bc9d9764","Type":"ContainerStarted","Data":"50e137d1b9d148ca59b515b68a2a7badbda2948167f88eca20be7d5b41be0d2f"} Jul 17 18:46:27.993613 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:27.993594 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e914793-46ea-4037-91df-cd04bc9d9764","Type":"ContainerStarted","Data":"d57d7fc2eca540ac3ea61787cca1b2ffc4da5bd6f596af73497fc6574654430a"} Jul 17 18:46:27.993702 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:27.993646 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e914793-46ea-4037-91df-cd04bc9d9764","Type":"ContainerStarted","Data":"7ac199f3f8e671a0389548c3e8f00236d6e0bb34cbdb599fc6e8d3dfd1e57f91"} Jul 17 18:46:27.995131 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:27.995109 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-4c6b9" Jul 17 18:46:27.996187 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:27.996162 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" event={"ID":"eb2605f4-45b5-4e77-ad61-9b6224166897","Type":"ContainerStarted","Data":"d7e47e65c13716660f9bf27fb1d23c19892bb4b895a7aeadc102e26ee76bf6e7"} Jul 17 18:46:28.009979 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:28.009929 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-4c6b9" podStartSLOduration=2.194076268 podStartE2EDuration="6.009908269s" totalImagesPullingTime="3.815832001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:46:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:46:28.009108977 +0000 UTC m=+97.040721851" watchObservedRunningTime="2026-07-17 18:46:28.009908269 +0000 UTC m=+97.041521144" Jul 17 18:46:28.057879 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:28.057833 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" podStartSLOduration=1.779044411 podStartE2EDuration="6.05781809s" totalImagesPullingTime="4.278773679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:46:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:46:28.055346278 +0000 UTC m=+97.086959150" watchObservedRunningTime="2026-07-17 18:46:28.05781809 +0000 UTC m=+97.089430960" Jul 17 18:46:29.002945 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:29.002908 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" event={"ID":"939fbff4-14a7-4143-a217-92ff90d33707","Type":"ContainerStarted","Data":"196a395aeaa420276541ecec6b8ebbddf5c6800e8071634046eae5fa8ee778f0"} Jul 17 18:46:29.003525 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:29.002974 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" event={"ID":"939fbff4-14a7-4143-a217-92ff90d33707","Type":"ContainerStarted","Data":"4e4191e0a4cc4a8d75c72958f68a45c10eb4fbe960ea84a7862f3bd32e50ad48"} Jul 17 18:46:29.003525 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:29.003107 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" Jul 17 18:46:29.011833 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:29.011795 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e914793-46ea-4037-91df-cd04bc9d9764","Type":"ContainerStarted","Data":"d5fa99e9b303591fb5381acf6fb6c424be4af7d9038426f3d85db48c0e0fa956"} Jul 17 18:46:29.011997 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:29.011898 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e914793-46ea-4037-91df-cd04bc9d9764","Type":"ContainerStarted","Data":"aa5b9693df17362926c2fa9b2e4907dc650cdbf0ee7e9f2e927cdf2bd66294e2"} Jul 17 18:46:29.011997 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:29.011941 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e914793-46ea-4037-91df-cd04bc9d9764","Type":"ContainerStarted","Data":"0941f061380bc495fbef2bd2f968931c89a214fc4be109523318c466cc0d52be"} Jul 17 18:46:29.014608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:29.014583 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" Jul 17 18:46:29.031449 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:29.031396 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7b896b5749-qzwwf" podStartSLOduration=3.149444626 podStartE2EDuration="9.031383059s" totalImagesPullingTime="5.881938433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:46:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:46:29.030171463 +0000 UTC m=+98.061784329" watchObservedRunningTime="2026-07-17 18:46:29.031383059 +0000 UTC m=+98.062995931" Jul 17 18:46:29.060107 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:29.060055 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.926535979 podStartE2EDuration="11.060040985s" totalImagesPullingTime="5.102253221s" totalInitContainerRuntime="31.251785ms" isStatefulPod=false podCreationTimestamp="2026-07-17 18:46:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:46:29.057930018 +0000 UTC m=+98.089542892" watchObservedRunningTime="2026-07-17 18:46:29.060040985 +0000 UTC m=+98.091653857" Jul 17 18:46:32.992770 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:32.992734 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:46:32.993255 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:32.992837 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:46:32.997608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:32.997580 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:46:33.034927 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:33.034895 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:46:33.150048 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:33.150019 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-599b45ccbf-8v7g9"] Jul 17 18:46:33.446811 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:33.446778 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:33.663420 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:33.663387 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:38.243652 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:38.243625 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:38.328542 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:38.328510 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:42.627131 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:42.627095 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" Jul 17 18:46:42.627523 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:42.627189 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" Jul 17 18:46:42.918821 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:42.918724 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d88fc77f7-lpxhd" podUID="77202810-4e88-4933-b015-9442c761cc6d" containerName="console" containerID="cri-o://cf35111da8f0957769fd1e99c9cda1d2dc9d60e00a4a5bb712e10954026ee1a6" gracePeriod=15 Jul 17 18:46:43.072199 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:43.072166 2559 generic.go:356] "Generic (PLEG): container finished" podID="77202810-4e88-4933-b015-9442c761cc6d" containerID="cf35111da8f0957769fd1e99c9cda1d2dc9d60e00a4a5bb712e10954026ee1a6" exitCode=0 Jul 17 18:46:43.072403 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:43.072237 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d88fc77f7-lpxhd" event={"ID":"77202810-4e88-4933-b015-9442c761cc6d","Type":"ContainerDied","Data":"cf35111da8f0957769fd1e99c9cda1d2dc9d60e00a4a5bb712e10954026ee1a6"} Jul 17 18:46:43.188379 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:43.188296 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d88fc77f7-lpxhd" Jul 17 18:46:43.374149 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:43.374114 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzmmx\" (UniqueName: \"kubernetes.io/projected/77202810-4e88-4933-b015-9442c761cc6d-kube-api-access-fzmmx\") pod \"77202810-4e88-4933-b015-9442c761cc6d\" (UID: \"77202810-4e88-4933-b015-9442c761cc6d\") " Jul 17 18:46:43.374149 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:43.374149 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77202810-4e88-4933-b015-9442c761cc6d-console-config\") pod \"77202810-4e88-4933-b015-9442c761cc6d\" (UID: \"77202810-4e88-4933-b015-9442c761cc6d\") " Jul 17 18:46:43.374538 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:43.374205 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77202810-4e88-4933-b015-9442c761cc6d-oauth-serving-cert\") pod \"77202810-4e88-4933-b015-9442c761cc6d\" (UID: \"77202810-4e88-4933-b015-9442c761cc6d\") " Jul 17 18:46:43.374538 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:43.374233 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77202810-4e88-4933-b015-9442c761cc6d-console-serving-cert\") pod \"77202810-4e88-4933-b015-9442c761cc6d\" (UID: \"77202810-4e88-4933-b015-9442c761cc6d\") " Jul 17 18:46:43.374538 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:43.374266 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77202810-4e88-4933-b015-9442c761cc6d-service-ca\") pod \"77202810-4e88-4933-b015-9442c761cc6d\" (UID: \"77202810-4e88-4933-b015-9442c761cc6d\") " Jul 17 18:46:43.374538 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:43.374401 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77202810-4e88-4933-b015-9442c761cc6d-console-oauth-config\") pod \"77202810-4e88-4933-b015-9442c761cc6d\" (UID: \"77202810-4e88-4933-b015-9442c761cc6d\") " Jul 17 18:46:43.374722 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:43.374667 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77202810-4e88-4933-b015-9442c761cc6d-console-config" (OuterVolumeSpecName: "console-config") pod "77202810-4e88-4933-b015-9442c761cc6d" (UID: "77202810-4e88-4933-b015-9442c761cc6d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:46:43.374722 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:43.374693 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77202810-4e88-4933-b015-9442c761cc6d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "77202810-4e88-4933-b015-9442c761cc6d" (UID: "77202810-4e88-4933-b015-9442c761cc6d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:46:43.374796 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:43.374723 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77202810-4e88-4933-b015-9442c761cc6d-service-ca" (OuterVolumeSpecName: "service-ca") pod "77202810-4e88-4933-b015-9442c761cc6d" (UID: "77202810-4e88-4933-b015-9442c761cc6d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:46:43.376789 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:43.376747 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77202810-4e88-4933-b015-9442c761cc6d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "77202810-4e88-4933-b015-9442c761cc6d" (UID: "77202810-4e88-4933-b015-9442c761cc6d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:46:43.376944 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:43.376923 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77202810-4e88-4933-b015-9442c761cc6d-kube-api-access-fzmmx" (OuterVolumeSpecName: "kube-api-access-fzmmx") pod "77202810-4e88-4933-b015-9442c761cc6d" (UID: "77202810-4e88-4933-b015-9442c761cc6d"). InnerVolumeSpecName "kube-api-access-fzmmx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:46:43.376984 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:43.376944 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77202810-4e88-4933-b015-9442c761cc6d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "77202810-4e88-4933-b015-9442c761cc6d" (UID: "77202810-4e88-4933-b015-9442c761cc6d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:46:43.475742 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:43.475655 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77202810-4e88-4933-b015-9442c761cc6d-console-serving-cert\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:46:43.475742 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:43.475682 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77202810-4e88-4933-b015-9442c761cc6d-service-ca\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:46:43.475742 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:43.475692 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77202810-4e88-4933-b015-9442c761cc6d-console-oauth-config\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:46:43.475742 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:43.475709 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzmmx\" (UniqueName: \"kubernetes.io/projected/77202810-4e88-4933-b015-9442c761cc6d-kube-api-access-fzmmx\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:46:43.475742 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:43.475719 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77202810-4e88-4933-b015-9442c761cc6d-console-config\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:46:43.475742 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:43.475727 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77202810-4e88-4933-b015-9442c761cc6d-oauth-serving-cert\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:46:44.078064 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:44.078036 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d88fc77f7-lpxhd" Jul 17 18:46:44.078064 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:44.078046 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d88fc77f7-lpxhd" event={"ID":"77202810-4e88-4933-b015-9442c761cc6d","Type":"ContainerDied","Data":"4c3e6b86792fa86ea267de5e63a66c100ef741ed0e4d6a25ad1a417c0a9ce95c"} Jul 17 18:46:44.078613 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:44.078100 2559 scope.go:117] "RemoveContainer" containerID="cf35111da8f0957769fd1e99c9cda1d2dc9d60e00a4a5bb712e10954026ee1a6" Jul 17 18:46:44.097509 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:44.097481 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d88fc77f7-lpxhd"] Jul 17 18:46:44.102395 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:44.102371 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d88fc77f7-lpxhd"] Jul 17 18:46:45.487759 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:45.487726 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77202810-4e88-4933-b015-9442c761cc6d" path="/var/lib/kubelet/pods/77202810-4e88-4933-b015-9442c761cc6d/volumes" Jul 17 18:46:47.898164 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:47.897192 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tpstx" Jul 17 18:46:58.170428 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:58.170369 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-599b45ccbf-8v7g9" podUID="c240f071-8183-4461-a7bc-f2104d3ae2c8" containerName="console" containerID="cri-o://979fe8f0018f78f6d552f3e2a45f298a753c4b23fb577140ea9d9ce6557b252b" gracePeriod=15 Jul 17 18:46:58.463132 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:58.463106 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:58.506177 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:58.506148 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c240f071-8183-4461-a7bc-f2104d3ae2c8-oauth-serving-cert\") pod \"c240f071-8183-4461-a7bc-f2104d3ae2c8\" (UID: \"c240f071-8183-4461-a7bc-f2104d3ae2c8\") " Jul 17 18:46:58.506370 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:58.506190 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c240f071-8183-4461-a7bc-f2104d3ae2c8-trusted-ca-bundle\") pod \"c240f071-8183-4461-a7bc-f2104d3ae2c8\" (UID: \"c240f071-8183-4461-a7bc-f2104d3ae2c8\") " Jul 17 18:46:58.506370 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:58.506215 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c240f071-8183-4461-a7bc-f2104d3ae2c8-service-ca\") pod \"c240f071-8183-4461-a7bc-f2104d3ae2c8\" (UID: \"c240f071-8183-4461-a7bc-f2104d3ae2c8\") " Jul 17 18:46:58.506370 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:58.506231 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c240f071-8183-4461-a7bc-f2104d3ae2c8-console-config\") pod \"c240f071-8183-4461-a7bc-f2104d3ae2c8\" (UID: \"c240f071-8183-4461-a7bc-f2104d3ae2c8\") " Jul 17 18:46:58.506370 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:58.506259 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c240f071-8183-4461-a7bc-f2104d3ae2c8-console-serving-cert\") pod \"c240f071-8183-4461-a7bc-f2104d3ae2c8\" (UID: \"c240f071-8183-4461-a7bc-f2104d3ae2c8\") " Jul 17 18:46:58.506370 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:58.506287 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c240f071-8183-4461-a7bc-f2104d3ae2c8-console-oauth-config\") pod \"c240f071-8183-4461-a7bc-f2104d3ae2c8\" (UID: \"c240f071-8183-4461-a7bc-f2104d3ae2c8\") " Jul 17 18:46:58.506370 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:58.506365 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvjdm\" (UniqueName: \"kubernetes.io/projected/c240f071-8183-4461-a7bc-f2104d3ae2c8-kube-api-access-dvjdm\") pod \"c240f071-8183-4461-a7bc-f2104d3ae2c8\" (UID: \"c240f071-8183-4461-a7bc-f2104d3ae2c8\") " Jul 17 18:46:58.506678 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:58.506587 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c240f071-8183-4461-a7bc-f2104d3ae2c8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c240f071-8183-4461-a7bc-f2104d3ae2c8" (UID: "c240f071-8183-4461-a7bc-f2104d3ae2c8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:46:58.506678 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:58.506613 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c240f071-8183-4461-a7bc-f2104d3ae2c8-service-ca" (OuterVolumeSpecName: "service-ca") pod "c240f071-8183-4461-a7bc-f2104d3ae2c8" (UID: "c240f071-8183-4461-a7bc-f2104d3ae2c8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:46:58.506678 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:58.506621 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c240f071-8183-4461-a7bc-f2104d3ae2c8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c240f071-8183-4461-a7bc-f2104d3ae2c8" (UID: "c240f071-8183-4461-a7bc-f2104d3ae2c8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:46:58.506782 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:58.506701 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c240f071-8183-4461-a7bc-f2104d3ae2c8-console-config" (OuterVolumeSpecName: "console-config") pod "c240f071-8183-4461-a7bc-f2104d3ae2c8" (UID: "c240f071-8183-4461-a7bc-f2104d3ae2c8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:46:58.508658 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:58.508633 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c240f071-8183-4461-a7bc-f2104d3ae2c8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c240f071-8183-4461-a7bc-f2104d3ae2c8" (UID: "c240f071-8183-4461-a7bc-f2104d3ae2c8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:46:58.508658 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:58.508647 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c240f071-8183-4461-a7bc-f2104d3ae2c8-kube-api-access-dvjdm" (OuterVolumeSpecName: "kube-api-access-dvjdm") pod "c240f071-8183-4461-a7bc-f2104d3ae2c8" (UID: "c240f071-8183-4461-a7bc-f2104d3ae2c8"). InnerVolumeSpecName "kube-api-access-dvjdm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:46:58.508760 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:58.508691 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c240f071-8183-4461-a7bc-f2104d3ae2c8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c240f071-8183-4461-a7bc-f2104d3ae2c8" (UID: "c240f071-8183-4461-a7bc-f2104d3ae2c8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:46:58.607109 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:58.607077 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c240f071-8183-4461-a7bc-f2104d3ae2c8-trusted-ca-bundle\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:46:58.607109 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:58.607104 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c240f071-8183-4461-a7bc-f2104d3ae2c8-service-ca\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:46:58.607109 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:58.607113 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c240f071-8183-4461-a7bc-f2104d3ae2c8-console-config\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:46:58.607109 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:58.607121 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c240f071-8183-4461-a7bc-f2104d3ae2c8-console-serving-cert\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:46:58.607394 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:58.607129 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c240f071-8183-4461-a7bc-f2104d3ae2c8-console-oauth-config\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:46:58.607394 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:58.607137 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvjdm\" (UniqueName: \"kubernetes.io/projected/c240f071-8183-4461-a7bc-f2104d3ae2c8-kube-api-access-dvjdm\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:46:58.607394 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:58.607145 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c240f071-8183-4461-a7bc-f2104d3ae2c8-oauth-serving-cert\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:46:59.143362 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:59.143291 2559 generic.go:356] "Generic (PLEG): container finished" podID="c240f071-8183-4461-a7bc-f2104d3ae2c8" containerID="979fe8f0018f78f6d552f3e2a45f298a753c4b23fb577140ea9d9ce6557b252b" exitCode=0 Jul 17 18:46:59.143534 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:59.143371 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-599b45ccbf-8v7g9" Jul 17 18:46:59.143534 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:59.143377 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-599b45ccbf-8v7g9" event={"ID":"c240f071-8183-4461-a7bc-f2104d3ae2c8","Type":"ContainerDied","Data":"979fe8f0018f78f6d552f3e2a45f298a753c4b23fb577140ea9d9ce6557b252b"} Jul 17 18:46:59.143534 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:59.143456 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-599b45ccbf-8v7g9" event={"ID":"c240f071-8183-4461-a7bc-f2104d3ae2c8","Type":"ContainerDied","Data":"b5c929601205451190511135cecbaf8261095d637bef23158fb263b6193f02fb"} Jul 17 18:46:59.143534 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:59.143478 2559 scope.go:117] "RemoveContainer" containerID="979fe8f0018f78f6d552f3e2a45f298a753c4b23fb577140ea9d9ce6557b252b" Jul 17 18:46:59.152145 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:59.152127 2559 scope.go:117] "RemoveContainer" containerID="979fe8f0018f78f6d552f3e2a45f298a753c4b23fb577140ea9d9ce6557b252b" Jul 17 18:46:59.152424 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:46:59.152404 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"979fe8f0018f78f6d552f3e2a45f298a753c4b23fb577140ea9d9ce6557b252b\": container with ID starting with 979fe8f0018f78f6d552f3e2a45f298a753c4b23fb577140ea9d9ce6557b252b not found: ID does not exist" containerID="979fe8f0018f78f6d552f3e2a45f298a753c4b23fb577140ea9d9ce6557b252b" Jul 17 18:46:59.152467 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:59.152434 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"979fe8f0018f78f6d552f3e2a45f298a753c4b23fb577140ea9d9ce6557b252b"} err="failed to get container status \"979fe8f0018f78f6d552f3e2a45f298a753c4b23fb577140ea9d9ce6557b252b\": rpc error: code = NotFound desc = could not find container \"979fe8f0018f78f6d552f3e2a45f298a753c4b23fb577140ea9d9ce6557b252b\": container with ID starting with 979fe8f0018f78f6d552f3e2a45f298a753c4b23fb577140ea9d9ce6557b252b not found: ID does not exist" Jul 17 18:46:59.164993 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:59.164969 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-599b45ccbf-8v7g9"] Jul 17 18:46:59.166916 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:59.166892 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-599b45ccbf-8v7g9"] Jul 17 18:46:59.487273 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:46:59.487200 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c240f071-8183-4461-a7bc-f2104d3ae2c8" path="/var/lib/kubelet/pods/c240f071-8183-4461-a7bc-f2104d3ae2c8/volumes" Jul 17 18:47:02.632112 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:02.632077 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" Jul 17 18:47:02.637187 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:02.637159 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-594b5cf56d-x5gsm" Jul 17 18:47:19.350066 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:19.350032 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:37.175827 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:37.175790 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:37.275879 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:37.275842 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:38.140934 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:38.140888 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 18:47:38.141482 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:38.141446 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3e914793-46ea-4037-91df-cd04bc9d9764" containerName="alertmanager" containerID="cri-o://7ac199f3f8e671a0389548c3e8f00236d6e0bb34cbdb599fc6e8d3dfd1e57f91" gracePeriod=120 Jul 17 18:47:38.141732 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:38.141701 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3e914793-46ea-4037-91df-cd04bc9d9764" containerName="kube-rbac-proxy" containerID="cri-o://0941f061380bc495fbef2bd2f968931c89a214fc4be109523318c466cc0d52be" gracePeriod=120 Jul 17 18:47:38.141894 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:38.141873 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3e914793-46ea-4037-91df-cd04bc9d9764" containerName="prom-label-proxy" containerID="cri-o://d5fa99e9b303591fb5381acf6fb6c424be4af7d9038426f3d85db48c0e0fa956" gracePeriod=120 Jul 17 18:47:38.141950 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:38.141887 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3e914793-46ea-4037-91df-cd04bc9d9764" containerName="kube-rbac-proxy-web" containerID="cri-o://50e137d1b9d148ca59b515b68a2a7badbda2948167f88eca20be7d5b41be0d2f" gracePeriod=120 Jul 17 18:47:38.141998 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:38.141986 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3e914793-46ea-4037-91df-cd04bc9d9764" containerName="kube-rbac-proxy-metric" containerID="cri-o://aa5b9693df17362926c2fa9b2e4907dc650cdbf0ee7e9f2e927cdf2bd66294e2" gracePeriod=120 Jul 17 18:47:38.142046 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:38.142000 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3e914793-46ea-4037-91df-cd04bc9d9764" containerName="config-reloader" containerID="cri-o://d57d7fc2eca540ac3ea61787cca1b2ffc4da5bd6f596af73497fc6574654430a" gracePeriod=120 Jul 17 18:47:38.299903 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:38.299872 2559 generic.go:356] "Generic (PLEG): container finished" podID="3e914793-46ea-4037-91df-cd04bc9d9764" containerID="d5fa99e9b303591fb5381acf6fb6c424be4af7d9038426f3d85db48c0e0fa956" exitCode=0 Jul 17 18:47:38.299903 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:38.299898 2559 generic.go:356] "Generic (PLEG): container finished" podID="3e914793-46ea-4037-91df-cd04bc9d9764" containerID="aa5b9693df17362926c2fa9b2e4907dc650cdbf0ee7e9f2e927cdf2bd66294e2" exitCode=0 Jul 17 18:47:38.299903 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:38.299904 2559 generic.go:356] "Generic (PLEG): container finished" podID="3e914793-46ea-4037-91df-cd04bc9d9764" containerID="0941f061380bc495fbef2bd2f968931c89a214fc4be109523318c466cc0d52be" exitCode=0 Jul 17 18:47:38.299903 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:38.299910 2559 generic.go:356] "Generic (PLEG): container finished" podID="3e914793-46ea-4037-91df-cd04bc9d9764" containerID="d57d7fc2eca540ac3ea61787cca1b2ffc4da5bd6f596af73497fc6574654430a" exitCode=0 Jul 17 18:47:38.300440 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:38.299915 2559 generic.go:356] "Generic (PLEG): container finished" podID="3e914793-46ea-4037-91df-cd04bc9d9764" containerID="7ac199f3f8e671a0389548c3e8f00236d6e0bb34cbdb599fc6e8d3dfd1e57f91" exitCode=0 Jul 17 18:47:38.300440 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:38.299953 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e914793-46ea-4037-91df-cd04bc9d9764","Type":"ContainerDied","Data":"d5fa99e9b303591fb5381acf6fb6c424be4af7d9038426f3d85db48c0e0fa956"} Jul 17 18:47:38.300440 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:38.300045 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e914793-46ea-4037-91df-cd04bc9d9764","Type":"ContainerDied","Data":"aa5b9693df17362926c2fa9b2e4907dc650cdbf0ee7e9f2e927cdf2bd66294e2"} Jul 17 18:47:38.300440 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:38.300087 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e914793-46ea-4037-91df-cd04bc9d9764","Type":"ContainerDied","Data":"0941f061380bc495fbef2bd2f968931c89a214fc4be109523318c466cc0d52be"} Jul 17 18:47:38.300440 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:38.300126 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e914793-46ea-4037-91df-cd04bc9d9764","Type":"ContainerDied","Data":"d57d7fc2eca540ac3ea61787cca1b2ffc4da5bd6f596af73497fc6574654430a"} Jul 17 18:47:38.300440 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:38.300168 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e914793-46ea-4037-91df-cd04bc9d9764","Type":"ContainerDied","Data":"7ac199f3f8e671a0389548c3e8f00236d6e0bb34cbdb599fc6e8d3dfd1e57f91"} Jul 17 18:47:39.308106 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.308078 2559 generic.go:356] "Generic (PLEG): container finished" podID="3e914793-46ea-4037-91df-cd04bc9d9764" containerID="50e137d1b9d148ca59b515b68a2a7badbda2948167f88eca20be7d5b41be0d2f" exitCode=0 Jul 17 18:47:39.308460 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.308154 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e914793-46ea-4037-91df-cd04bc9d9764","Type":"ContainerDied","Data":"50e137d1b9d148ca59b515b68a2a7badbda2948167f88eca20be7d5b41be0d2f"} Jul 17 18:47:39.395502 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.395480 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:39.548446 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.548363 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e914793-46ea-4037-91df-cd04bc9d9764-metrics-client-ca\") pod \"3e914793-46ea-4037-91df-cd04bc9d9764\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " Jul 17 18:47:39.548446 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.548403 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e914793-46ea-4037-91df-cd04bc9d9764-config-out\") pod \"3e914793-46ea-4037-91df-cd04bc9d9764\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " Jul 17 18:47:39.548446 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.548435 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-secret-alertmanager-kube-rbac-proxy-metric\") pod \"3e914793-46ea-4037-91df-cd04bc9d9764\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " Jul 17 18:47:39.548717 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.548470 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3e914793-46ea-4037-91df-cd04bc9d9764-alertmanager-main-db\") pod \"3e914793-46ea-4037-91df-cd04bc9d9764\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " Jul 17 18:47:39.548717 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.548494 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-secret-alertmanager-main-tls\") pod \"3e914793-46ea-4037-91df-cd04bc9d9764\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " Jul 17 18:47:39.548717 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.548529 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e914793-46ea-4037-91df-cd04bc9d9764-alertmanager-trusted-ca-bundle\") pod \"3e914793-46ea-4037-91df-cd04bc9d9764\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " Jul 17 18:47:39.548717 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.548557 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-config-volume\") pod \"3e914793-46ea-4037-91df-cd04bc9d9764\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " Jul 17 18:47:39.548717 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.548621 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-web-config\") pod \"3e914793-46ea-4037-91df-cd04bc9d9764\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " Jul 17 18:47:39.548717 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.548651 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-cluster-tls-config\") pod \"3e914793-46ea-4037-91df-cd04bc9d9764\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " Jul 17 18:47:39.548717 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.548683 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-857t6\" (UniqueName: \"kubernetes.io/projected/3e914793-46ea-4037-91df-cd04bc9d9764-kube-api-access-857t6\") pod \"3e914793-46ea-4037-91df-cd04bc9d9764\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " Jul 17 18:47:39.549056 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.548723 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-secret-alertmanager-kube-rbac-proxy\") pod \"3e914793-46ea-4037-91df-cd04bc9d9764\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " Jul 17 18:47:39.549056 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.548752 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e914793-46ea-4037-91df-cd04bc9d9764-tls-assets\") pod \"3e914793-46ea-4037-91df-cd04bc9d9764\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " Jul 17 18:47:39.549056 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.548782 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-secret-alertmanager-kube-rbac-proxy-web\") pod \"3e914793-46ea-4037-91df-cd04bc9d9764\" (UID: \"3e914793-46ea-4037-91df-cd04bc9d9764\") " Jul 17 18:47:39.549056 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.548890 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e914793-46ea-4037-91df-cd04bc9d9764-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "3e914793-46ea-4037-91df-cd04bc9d9764" (UID: "3e914793-46ea-4037-91df-cd04bc9d9764"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:47:39.549056 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.548914 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e914793-46ea-4037-91df-cd04bc9d9764-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "3e914793-46ea-4037-91df-cd04bc9d9764" (UID: "3e914793-46ea-4037-91df-cd04bc9d9764"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:47:39.549056 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.549042 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e914793-46ea-4037-91df-cd04bc9d9764-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "3e914793-46ea-4037-91df-cd04bc9d9764" (UID: "3e914793-46ea-4037-91df-cd04bc9d9764"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:47:39.549563 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.549095 2559 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e914793-46ea-4037-91df-cd04bc9d9764-metrics-client-ca\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:47:39.549563 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.549118 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3e914793-46ea-4037-91df-cd04bc9d9764-alertmanager-main-db\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:47:39.551742 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.551696 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e914793-46ea-4037-91df-cd04bc9d9764-config-out" (OuterVolumeSpecName: "config-out") pod "3e914793-46ea-4037-91df-cd04bc9d9764" (UID: "3e914793-46ea-4037-91df-cd04bc9d9764"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:47:39.552382 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.552356 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-config-volume" (OuterVolumeSpecName: "config-volume") pod "3e914793-46ea-4037-91df-cd04bc9d9764" (UID: "3e914793-46ea-4037-91df-cd04bc9d9764"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:47:39.552382 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.552367 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e914793-46ea-4037-91df-cd04bc9d9764-kube-api-access-857t6" (OuterVolumeSpecName: "kube-api-access-857t6") pod "3e914793-46ea-4037-91df-cd04bc9d9764" (UID: "3e914793-46ea-4037-91df-cd04bc9d9764"). InnerVolumeSpecName "kube-api-access-857t6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:47:39.552571 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.552403 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "3e914793-46ea-4037-91df-cd04bc9d9764" (UID: "3e914793-46ea-4037-91df-cd04bc9d9764"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:47:39.552571 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.552438 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "3e914793-46ea-4037-91df-cd04bc9d9764" (UID: "3e914793-46ea-4037-91df-cd04bc9d9764"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:47:39.552869 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.552846 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "3e914793-46ea-4037-91df-cd04bc9d9764" (UID: "3e914793-46ea-4037-91df-cd04bc9d9764"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:47:39.552983 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.552924 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "3e914793-46ea-4037-91df-cd04bc9d9764" (UID: "3e914793-46ea-4037-91df-cd04bc9d9764"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:47:39.553488 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.553465 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e914793-46ea-4037-91df-cd04bc9d9764-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3e914793-46ea-4037-91df-cd04bc9d9764" (UID: "3e914793-46ea-4037-91df-cd04bc9d9764"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:47:39.556303 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.556271 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "3e914793-46ea-4037-91df-cd04bc9d9764" (UID: "3e914793-46ea-4037-91df-cd04bc9d9764"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:47:39.562562 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.562542 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-web-config" (OuterVolumeSpecName: "web-config") pod "3e914793-46ea-4037-91df-cd04bc9d9764" (UID: "3e914793-46ea-4037-91df-cd04bc9d9764"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:47:39.649602 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.649572 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:47:39.649602 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.649598 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e914793-46ea-4037-91df-cd04bc9d9764-config-out\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:47:39.649602 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.649607 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:47:39.649793 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.649617 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-secret-alertmanager-main-tls\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:47:39.649793 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.649626 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e914793-46ea-4037-91df-cd04bc9d9764-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:47:39.649793 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.649634 2559 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-config-volume\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:47:39.649793 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.649664 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-web-config\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:47:39.649793 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.649672 2559 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-cluster-tls-config\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:47:39.649793 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.649680 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-857t6\" (UniqueName: \"kubernetes.io/projected/3e914793-46ea-4037-91df-cd04bc9d9764-kube-api-access-857t6\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:47:39.649793 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.649688 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e914793-46ea-4037-91df-cd04bc9d9764-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:47:39.649793 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:39.649698 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e914793-46ea-4037-91df-cd04bc9d9764-tls-assets\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:47:40.315512 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.315490 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.315879 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.315484 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e914793-46ea-4037-91df-cd04bc9d9764","Type":"ContainerDied","Data":"0b0cb383fb716cf2453806a27327e482abea487d950dddc30e03349e3da5a63f"} Jul 17 18:47:40.315879 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.315634 2559 scope.go:117] "RemoveContainer" containerID="d5fa99e9b303591fb5381acf6fb6c424be4af7d9038426f3d85db48c0e0fa956" Jul 17 18:47:40.324496 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.324466 2559 scope.go:117] "RemoveContainer" containerID="aa5b9693df17362926c2fa9b2e4907dc650cdbf0ee7e9f2e927cdf2bd66294e2" Jul 17 18:47:40.331719 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.331694 2559 scope.go:117] "RemoveContainer" containerID="0941f061380bc495fbef2bd2f968931c89a214fc4be109523318c466cc0d52be" Jul 17 18:47:40.338096 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.338080 2559 scope.go:117] "RemoveContainer" containerID="50e137d1b9d148ca59b515b68a2a7badbda2948167f88eca20be7d5b41be0d2f" Jul 17 18:47:40.343000 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.342977 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 18:47:40.346518 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.346495 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 18:47:40.346607 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.346534 2559 scope.go:117] "RemoveContainer" containerID="d57d7fc2eca540ac3ea61787cca1b2ffc4da5bd6f596af73497fc6574654430a" Jul 17 18:47:40.353193 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.353176 2559 scope.go:117] "RemoveContainer" containerID="7ac199f3f8e671a0389548c3e8f00236d6e0bb34cbdb599fc6e8d3dfd1e57f91" Jul 17 18:47:40.360025 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.360009 2559 scope.go:117] "RemoveContainer" containerID="742e6a174522b12a58e3ecbb000c02223957548e0dda6d31681771f3a1529751" Jul 17 18:47:40.380988 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.380963 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 18:47:40.381254 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.381242 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e914793-46ea-4037-91df-cd04bc9d9764" containerName="config-reloader" Jul 17 18:47:40.381291 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.381256 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e914793-46ea-4037-91df-cd04bc9d9764" containerName="config-reloader" Jul 17 18:47:40.381291 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.381266 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e914793-46ea-4037-91df-cd04bc9d9764" containerName="kube-rbac-proxy" Jul 17 18:47:40.381291 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.381271 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e914793-46ea-4037-91df-cd04bc9d9764" containerName="kube-rbac-proxy" Jul 17 18:47:40.381291 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.381277 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e914793-46ea-4037-91df-cd04bc9d9764" containerName="prom-label-proxy" Jul 17 18:47:40.381291 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.381282 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e914793-46ea-4037-91df-cd04bc9d9764" containerName="prom-label-proxy" Jul 17 18:47:40.381291 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.381290 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c240f071-8183-4461-a7bc-f2104d3ae2c8" containerName="console" Jul 17 18:47:40.381486 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.381295 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c240f071-8183-4461-a7bc-f2104d3ae2c8" containerName="console" Jul 17 18:47:40.381486 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.381303 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e914793-46ea-4037-91df-cd04bc9d9764" containerName="alertmanager" Jul 17 18:47:40.381486 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.381327 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e914793-46ea-4037-91df-cd04bc9d9764" containerName="alertmanager" Jul 17 18:47:40.381486 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.381337 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77202810-4e88-4933-b015-9442c761cc6d" containerName="console" Jul 17 18:47:40.381486 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.381342 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="77202810-4e88-4933-b015-9442c761cc6d" containerName="console" Jul 17 18:47:40.381486 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.381348 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e914793-46ea-4037-91df-cd04bc9d9764" containerName="kube-rbac-proxy-web" Jul 17 18:47:40.381486 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.381353 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e914793-46ea-4037-91df-cd04bc9d9764" containerName="kube-rbac-proxy-web" Jul 17 18:47:40.381486 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.381360 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e914793-46ea-4037-91df-cd04bc9d9764" containerName="kube-rbac-proxy-metric" Jul 17 18:47:40.381486 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.381366 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e914793-46ea-4037-91df-cd04bc9d9764" containerName="kube-rbac-proxy-metric" Jul 17 18:47:40.381486 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.381375 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e914793-46ea-4037-91df-cd04bc9d9764" containerName="init-config-reloader" Jul 17 18:47:40.381486 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.381380 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e914793-46ea-4037-91df-cd04bc9d9764" containerName="init-config-reloader" Jul 17 18:47:40.381486 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.381426 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e914793-46ea-4037-91df-cd04bc9d9764" containerName="alertmanager" Jul 17 18:47:40.381486 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.381436 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e914793-46ea-4037-91df-cd04bc9d9764" containerName="config-reloader" Jul 17 18:47:40.381486 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.381442 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c240f071-8183-4461-a7bc-f2104d3ae2c8" containerName="console" Jul 17 18:47:40.381486 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.381447 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e914793-46ea-4037-91df-cd04bc9d9764" containerName="kube-rbac-proxy-web" Jul 17 18:47:40.381486 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.381452 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e914793-46ea-4037-91df-cd04bc9d9764" containerName="kube-rbac-proxy" Jul 17 18:47:40.381486 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.381458 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e914793-46ea-4037-91df-cd04bc9d9764" containerName="kube-rbac-proxy-metric" Jul 17 18:47:40.381486 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.381463 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e914793-46ea-4037-91df-cd04bc9d9764" containerName="prom-label-proxy" Jul 17 18:47:40.381486 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.381468 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="77202810-4e88-4933-b015-9442c761cc6d" containerName="console" Jul 17 18:47:40.385236 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.385215 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.388962 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.388941 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 17 18:47:40.389045 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.388941 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 17 18:47:40.389109 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.388941 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 17 18:47:40.389161 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.388941 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 17 18:47:40.389234 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.388989 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 17 18:47:40.389295 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.389281 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 17 18:47:40.389472 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.389453 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 17 18:47:40.389534 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.389488 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 17 18:47:40.389621 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.389603 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4s45f\"" Jul 17 18:47:40.398508 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.398492 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 17 18:47:40.409614 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.409589 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 18:47:40.557722 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.557631 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/81767809-0a22-40b4-b37a-b850b91eba29-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.557722 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.557669 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgkq4\" (UniqueName: \"kubernetes.io/projected/81767809-0a22-40b4-b37a-b850b91eba29-kube-api-access-jgkq4\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.557722 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.557696 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/81767809-0a22-40b4-b37a-b850b91eba29-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.557722 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.557721 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81767809-0a22-40b4-b37a-b850b91eba29-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.558026 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.557747 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/81767809-0a22-40b4-b37a-b850b91eba29-web-config\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.558026 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.557779 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/81767809-0a22-40b4-b37a-b850b91eba29-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.558026 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.557815 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/81767809-0a22-40b4-b37a-b850b91eba29-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.558026 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.557862 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/81767809-0a22-40b4-b37a-b850b91eba29-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.558026 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.557899 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/81767809-0a22-40b4-b37a-b850b91eba29-config-out\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.558026 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.557925 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81767809-0a22-40b4-b37a-b850b91eba29-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.558026 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.557953 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/81767809-0a22-40b4-b37a-b850b91eba29-config-volume\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.558026 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.557999 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/81767809-0a22-40b4-b37a-b850b91eba29-tls-assets\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.558026 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.558023 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/81767809-0a22-40b4-b37a-b850b91eba29-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.659049 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.659011 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/81767809-0a22-40b4-b37a-b850b91eba29-config-out\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.659216 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.659056 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81767809-0a22-40b4-b37a-b850b91eba29-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.659216 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.659084 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/81767809-0a22-40b4-b37a-b850b91eba29-config-volume\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.659216 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.659126 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/81767809-0a22-40b4-b37a-b850b91eba29-tls-assets\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.659216 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.659166 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/81767809-0a22-40b4-b37a-b850b91eba29-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.659216 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.659209 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/81767809-0a22-40b4-b37a-b850b91eba29-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.659522 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.659348 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgkq4\" (UniqueName: \"kubernetes.io/projected/81767809-0a22-40b4-b37a-b850b91eba29-kube-api-access-jgkq4\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.659522 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.659391 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/81767809-0a22-40b4-b37a-b850b91eba29-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.659522 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.659420 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81767809-0a22-40b4-b37a-b850b91eba29-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.659522 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.659454 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/81767809-0a22-40b4-b37a-b850b91eba29-web-config\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.659522 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.659496 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/81767809-0a22-40b4-b37a-b850b91eba29-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.659771 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.659557 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/81767809-0a22-40b4-b37a-b850b91eba29-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.659771 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.659642 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/81767809-0a22-40b4-b37a-b850b91eba29-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.660793 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.660768 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81767809-0a22-40b4-b37a-b850b91eba29-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.662421 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.662327 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/81767809-0a22-40b4-b37a-b850b91eba29-tls-assets\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.662527 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.662464 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/81767809-0a22-40b4-b37a-b850b91eba29-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.662527 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.662510 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/81767809-0a22-40b4-b37a-b850b91eba29-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.662632 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.662582 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/81767809-0a22-40b4-b37a-b850b91eba29-config-volume\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.662632 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.662590 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/81767809-0a22-40b4-b37a-b850b91eba29-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.662745 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.662701 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/81767809-0a22-40b4-b37a-b850b91eba29-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.662974 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.662951 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/81767809-0a22-40b4-b37a-b850b91eba29-config-out\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.663114 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.663097 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/81767809-0a22-40b4-b37a-b850b91eba29-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.663190 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.663174 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81767809-0a22-40b4-b37a-b850b91eba29-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.663441 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.663420 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/81767809-0a22-40b4-b37a-b850b91eba29-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.664922 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.664900 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/81767809-0a22-40b4-b37a-b850b91eba29-web-config\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.672695 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.672676 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgkq4\" (UniqueName: \"kubernetes.io/projected/81767809-0a22-40b4-b37a-b850b91eba29-kube-api-access-jgkq4\") pod \"alertmanager-main-0\" (UID: \"81767809-0a22-40b4-b37a-b850b91eba29\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.695549 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.695526 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:47:40.845115 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:40.845092 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 18:47:40.846625 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:47:40.846600 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81767809_0a22_40b4_b37a_b850b91eba29.slice/crio-ba1b62d14a02bd6f1a00cb9ba0c871fa600e69143f7420b4929294560fc3031e WatchSource:0}: Error finding container ba1b62d14a02bd6f1a00cb9ba0c871fa600e69143f7420b4929294560fc3031e: Status 404 returned error can't find the container with id ba1b62d14a02bd6f1a00cb9ba0c871fa600e69143f7420b4929294560fc3031e Jul 17 18:47:41.322516 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:41.322426 2559 generic.go:356] "Generic (PLEG): container finished" podID="81767809-0a22-40b4-b37a-b850b91eba29" containerID="ab6f404eb8eb9a264a33f9dcde8339c1f531687ea01b0fd034fbbb50117c1ecd" exitCode=0 Jul 17 18:47:41.322516 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:41.322471 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"81767809-0a22-40b4-b37a-b850b91eba29","Type":"ContainerDied","Data":"ab6f404eb8eb9a264a33f9dcde8339c1f531687ea01b0fd034fbbb50117c1ecd"} Jul 17 18:47:41.323050 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:41.322545 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"81767809-0a22-40b4-b37a-b850b91eba29","Type":"ContainerStarted","Data":"ba1b62d14a02bd6f1a00cb9ba0c871fa600e69143f7420b4929294560fc3031e"} Jul 17 18:47:41.487753 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:41.487723 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e914793-46ea-4037-91df-cd04bc9d9764" path="/var/lib/kubelet/pods/3e914793-46ea-4037-91df-cd04bc9d9764/volumes" Jul 17 18:47:42.331078 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.331037 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-666d9d5c59-hqj5j"] Jul 17 18:47:42.333913 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.333882 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" Jul 17 18:47:42.334862 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.334831 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"81767809-0a22-40b4-b37a-b850b91eba29","Type":"ContainerStarted","Data":"0e429cde52afc7e905d23f6fb97ad23e2aa9fce6c67cc1ccdc638eb139c4f5ca"} Jul 17 18:47:42.335000 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.334891 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"81767809-0a22-40b4-b37a-b850b91eba29","Type":"ContainerStarted","Data":"ba5888de5f513b5d9cb475fc3df80ae0ce77c6e63c3cccaa88bb1dbc3c29d2cf"} Jul 17 18:47:42.335000 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.334916 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"81767809-0a22-40b4-b37a-b850b91eba29","Type":"ContainerStarted","Data":"5ad0a6d239e6afba03abcdd97819c2d94d95619c087c2a4410e66381ad913c02"} Jul 17 18:47:42.335000 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.334941 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"81767809-0a22-40b4-b37a-b850b91eba29","Type":"ContainerStarted","Data":"f7c24dc8d525a279cf4c7a73a126cf784fec6f817aa42ab865b03123de6eea29"} Jul 17 18:47:42.335000 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.334967 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"81767809-0a22-40b4-b37a-b850b91eba29","Type":"ContainerStarted","Data":"2163ed4efa9166a7d783b8f87d6cb9542b4347c4e51e34d7eecbfc44271cb833"} Jul 17 18:47:42.335000 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.334990 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"81767809-0a22-40b4-b37a-b850b91eba29","Type":"ContainerStarted","Data":"6e327c46c8e16d307f785460aa836763dfa636e7ea817ca9b4fe27a847dfd262"} Jul 17 18:47:42.338542 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.338523 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 17 18:47:42.338676 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.338525 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 17 18:47:42.338798 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.338783 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 17 18:47:42.339282 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.339270 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-5tp4z\"" Jul 17 18:47:42.339645 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.339629 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 17 18:47:42.339695 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.339660 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 17 18:47:42.354264 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.354243 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 17 18:47:42.369468 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.369442 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-666d9d5c59-hqj5j"] Jul 17 18:47:42.375482 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.375460 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e432a75b-70dd-46ea-90c3-1538cb8e6097-telemeter-client-tls\") pod \"telemeter-client-666d9d5c59-hqj5j\" (UID: \"e432a75b-70dd-46ea-90c3-1538cb8e6097\") " pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" Jul 17 18:47:42.375611 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.375491 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e432a75b-70dd-46ea-90c3-1538cb8e6097-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-666d9d5c59-hqj5j\" (UID: \"e432a75b-70dd-46ea-90c3-1538cb8e6097\") " pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" Jul 17 18:47:42.375611 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.375511 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e432a75b-70dd-46ea-90c3-1538cb8e6097-metrics-client-ca\") pod \"telemeter-client-666d9d5c59-hqj5j\" (UID: \"e432a75b-70dd-46ea-90c3-1538cb8e6097\") " pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" Jul 17 18:47:42.375724 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.375638 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e432a75b-70dd-46ea-90c3-1538cb8e6097-telemeter-trusted-ca-bundle\") pod \"telemeter-client-666d9d5c59-hqj5j\" (UID: \"e432a75b-70dd-46ea-90c3-1538cb8e6097\") " pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" Jul 17 18:47:42.375782 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.375759 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e432a75b-70dd-46ea-90c3-1538cb8e6097-secret-telemeter-client\") pod \"telemeter-client-666d9d5c59-hqj5j\" (UID: \"e432a75b-70dd-46ea-90c3-1538cb8e6097\") " pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" Jul 17 18:47:42.375852 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.375819 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtqx9\" (UniqueName: \"kubernetes.io/projected/e432a75b-70dd-46ea-90c3-1538cb8e6097-kube-api-access-mtqx9\") pod \"telemeter-client-666d9d5c59-hqj5j\" (UID: \"e432a75b-70dd-46ea-90c3-1538cb8e6097\") " pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" Jul 17 18:47:42.375939 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.375854 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e432a75b-70dd-46ea-90c3-1538cb8e6097-federate-client-tls\") pod \"telemeter-client-666d9d5c59-hqj5j\" (UID: \"e432a75b-70dd-46ea-90c3-1538cb8e6097\") " pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" Jul 17 18:47:42.375939 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.375893 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e432a75b-70dd-46ea-90c3-1538cb8e6097-serving-certs-ca-bundle\") pod \"telemeter-client-666d9d5c59-hqj5j\" (UID: \"e432a75b-70dd-46ea-90c3-1538cb8e6097\") " pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" Jul 17 18:47:42.477257 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.477223 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtqx9\" (UniqueName: \"kubernetes.io/projected/e432a75b-70dd-46ea-90c3-1538cb8e6097-kube-api-access-mtqx9\") pod \"telemeter-client-666d9d5c59-hqj5j\" (UID: \"e432a75b-70dd-46ea-90c3-1538cb8e6097\") " pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" Jul 17 18:47:42.477482 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.477265 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e432a75b-70dd-46ea-90c3-1538cb8e6097-federate-client-tls\") pod \"telemeter-client-666d9d5c59-hqj5j\" (UID: \"e432a75b-70dd-46ea-90c3-1538cb8e6097\") " pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" Jul 17 18:47:42.477482 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.477288 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e432a75b-70dd-46ea-90c3-1538cb8e6097-serving-certs-ca-bundle\") pod \"telemeter-client-666d9d5c59-hqj5j\" (UID: \"e432a75b-70dd-46ea-90c3-1538cb8e6097\") " pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" Jul 17 18:47:42.477482 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.477331 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e432a75b-70dd-46ea-90c3-1538cb8e6097-telemeter-client-tls\") pod \"telemeter-client-666d9d5c59-hqj5j\" (UID: \"e432a75b-70dd-46ea-90c3-1538cb8e6097\") " pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" Jul 17 18:47:42.477482 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.477358 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e432a75b-70dd-46ea-90c3-1538cb8e6097-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-666d9d5c59-hqj5j\" (UID: \"e432a75b-70dd-46ea-90c3-1538cb8e6097\") " pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" Jul 17 18:47:42.477482 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.477385 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e432a75b-70dd-46ea-90c3-1538cb8e6097-metrics-client-ca\") pod \"telemeter-client-666d9d5c59-hqj5j\" (UID: \"e432a75b-70dd-46ea-90c3-1538cb8e6097\") " pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" Jul 17 18:47:42.477482 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.477435 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e432a75b-70dd-46ea-90c3-1538cb8e6097-telemeter-trusted-ca-bundle\") pod \"telemeter-client-666d9d5c59-hqj5j\" (UID: \"e432a75b-70dd-46ea-90c3-1538cb8e6097\") " pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" Jul 17 18:47:42.477767 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.477653 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e432a75b-70dd-46ea-90c3-1538cb8e6097-secret-telemeter-client\") pod \"telemeter-client-666d9d5c59-hqj5j\" (UID: \"e432a75b-70dd-46ea-90c3-1538cb8e6097\") " pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" Jul 17 18:47:42.478199 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.478143 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e432a75b-70dd-46ea-90c3-1538cb8e6097-serving-certs-ca-bundle\") pod \"telemeter-client-666d9d5c59-hqj5j\" (UID: \"e432a75b-70dd-46ea-90c3-1538cb8e6097\") " pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" Jul 17 18:47:42.478339 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.478282 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e432a75b-70dd-46ea-90c3-1538cb8e6097-telemeter-trusted-ca-bundle\") pod \"telemeter-client-666d9d5c59-hqj5j\" (UID: \"e432a75b-70dd-46ea-90c3-1538cb8e6097\") " pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" Jul 17 18:47:42.478727 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.478701 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e432a75b-70dd-46ea-90c3-1538cb8e6097-metrics-client-ca\") pod \"telemeter-client-666d9d5c59-hqj5j\" (UID: \"e432a75b-70dd-46ea-90c3-1538cb8e6097\") " pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" Jul 17 18:47:42.480105 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.480080 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e432a75b-70dd-46ea-90c3-1538cb8e6097-telemeter-client-tls\") pod \"telemeter-client-666d9d5c59-hqj5j\" (UID: \"e432a75b-70dd-46ea-90c3-1538cb8e6097\") " pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" Jul 17 18:47:42.480206 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.480183 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e432a75b-70dd-46ea-90c3-1538cb8e6097-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-666d9d5c59-hqj5j\" (UID: \"e432a75b-70dd-46ea-90c3-1538cb8e6097\") " pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" Jul 17 18:47:42.480247 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.480214 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e432a75b-70dd-46ea-90c3-1538cb8e6097-federate-client-tls\") pod \"telemeter-client-666d9d5c59-hqj5j\" (UID: \"e432a75b-70dd-46ea-90c3-1538cb8e6097\") " pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" Jul 17 18:47:42.480460 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.480442 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e432a75b-70dd-46ea-90c3-1538cb8e6097-secret-telemeter-client\") pod \"telemeter-client-666d9d5c59-hqj5j\" (UID: \"e432a75b-70dd-46ea-90c3-1538cb8e6097\") " pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" Jul 17 18:47:42.487496 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.487469 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtqx9\" (UniqueName: \"kubernetes.io/projected/e432a75b-70dd-46ea-90c3-1538cb8e6097-kube-api-access-mtqx9\") pod \"telemeter-client-666d9d5c59-hqj5j\" (UID: \"e432a75b-70dd-46ea-90c3-1538cb8e6097\") " pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" Jul 17 18:47:42.525037 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.524983 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.510910746 podStartE2EDuration="2.524967662s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.056916ms" isStatefulPod=false podCreationTimestamp="2026-07-17 18:47:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:47:42.523920513 +0000 UTC m=+171.555533387" watchObservedRunningTime="2026-07-17 18:47:42.524967662 +0000 UTC m=+171.556580535" Jul 17 18:47:42.644170 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.644142 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" Jul 17 18:47:42.805852 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:42.805820 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-666d9d5c59-hqj5j"] Jul 17 18:47:42.809291 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:47:42.809266 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode432a75b_70dd_46ea_90c3_1538cb8e6097.slice/crio-6f8cae191524973042dc822bcacf4f96751e4cffd45849e9845bac49058bd50b WatchSource:0}: Error finding container 6f8cae191524973042dc822bcacf4f96751e4cffd45849e9845bac49058bd50b: Status 404 returned error can't find the container with id 6f8cae191524973042dc822bcacf4f96751e4cffd45849e9845bac49058bd50b Jul 17 18:47:43.339918 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:43.339883 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" event={"ID":"e432a75b-70dd-46ea-90c3-1538cb8e6097","Type":"ContainerStarted","Data":"6f8cae191524973042dc822bcacf4f96751e4cffd45849e9845bac49058bd50b"} Jul 17 18:47:45.350507 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:45.350477 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" event={"ID":"e432a75b-70dd-46ea-90c3-1538cb8e6097","Type":"ContainerStarted","Data":"90f8e79445583e28b45d3348dd16012d1ccb4dcf85e4d0c28b61eeac21472953"} Jul 17 18:47:45.350949 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:45.350533 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" event={"ID":"e432a75b-70dd-46ea-90c3-1538cb8e6097","Type":"ContainerStarted","Data":"a4819f9d142d56c116ffbd3d4969b6425d16d04fa0cbc546283d1bdebb668cb6"} Jul 17 18:47:45.350949 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:45.350553 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" event={"ID":"e432a75b-70dd-46ea-90c3-1538cb8e6097","Type":"ContainerStarted","Data":"7c714ae4f5124952475ccbe1a5f1bb66a8eb357a2bc559b21d133b95bed3d482"} Jul 17 18:47:45.375412 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:45.375357 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-666d9d5c59-hqj5j" podStartSLOduration=1.116371266 podStartE2EDuration="3.375341161s" totalImagesPullingTime="2.258969895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:47:45.373589604 +0000 UTC m=+174.405202478" watchObservedRunningTime="2026-07-17 18:47:45.375341161 +0000 UTC m=+174.406954033" Jul 17 18:47:46.121718 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:46.121685 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c797c67d5-59cd5"] Jul 17 18:47:46.124214 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:46.124195 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:47:46.140686 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:46.140660 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c797c67d5-59cd5"] Jul 17 18:47:46.207346 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:46.207291 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9dfq\" (UniqueName: \"kubernetes.io/projected/95bfd5c0-cf27-4c85-80ef-2af051270b8e-kube-api-access-n9dfq\") pod \"console-c797c67d5-59cd5\" (UID: \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\") " pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:47:46.207520 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:46.207360 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95bfd5c0-cf27-4c85-80ef-2af051270b8e-trusted-ca-bundle\") pod \"console-c797c67d5-59cd5\" (UID: \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\") " pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:47:46.207520 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:46.207409 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95bfd5c0-cf27-4c85-80ef-2af051270b8e-service-ca\") pod \"console-c797c67d5-59cd5\" (UID: \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\") " pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:47:46.207520 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:46.207449 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95bfd5c0-cf27-4c85-80ef-2af051270b8e-console-serving-cert\") pod \"console-c797c67d5-59cd5\" (UID: \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\") " pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:47:46.207520 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:46.207471 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95bfd5c0-cf27-4c85-80ef-2af051270b8e-console-config\") pod \"console-c797c67d5-59cd5\" (UID: \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\") " pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:47:46.207520 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:46.207489 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95bfd5c0-cf27-4c85-80ef-2af051270b8e-console-oauth-config\") pod \"console-c797c67d5-59cd5\" (UID: \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\") " pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:47:46.207520 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:46.207505 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95bfd5c0-cf27-4c85-80ef-2af051270b8e-oauth-serving-cert\") pod \"console-c797c67d5-59cd5\" (UID: \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\") " pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:47:46.218425 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:46.218404 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:46.308158 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:46.308126 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95bfd5c0-cf27-4c85-80ef-2af051270b8e-trusted-ca-bundle\") pod \"console-c797c67d5-59cd5\" (UID: \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\") " pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:47:46.308382 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:46.308164 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95bfd5c0-cf27-4c85-80ef-2af051270b8e-service-ca\") pod \"console-c797c67d5-59cd5\" (UID: \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\") " pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:47:46.308382 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:46.308191 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95bfd5c0-cf27-4c85-80ef-2af051270b8e-console-serving-cert\") pod \"console-c797c67d5-59cd5\" (UID: \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\") " pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:47:46.308382 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:46.308346 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95bfd5c0-cf27-4c85-80ef-2af051270b8e-console-config\") pod \"console-c797c67d5-59cd5\" (UID: \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\") " pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:47:46.308554 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:46.308397 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95bfd5c0-cf27-4c85-80ef-2af051270b8e-console-oauth-config\") pod \"console-c797c67d5-59cd5\" (UID: \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\") " pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:47:46.308554 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:46.308423 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95bfd5c0-cf27-4c85-80ef-2af051270b8e-oauth-serving-cert\") pod \"console-c797c67d5-59cd5\" (UID: \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\") " pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:47:46.308554 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:46.308512 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9dfq\" (UniqueName: \"kubernetes.io/projected/95bfd5c0-cf27-4c85-80ef-2af051270b8e-kube-api-access-n9dfq\") pod \"console-c797c67d5-59cd5\" (UID: \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\") " pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:47:46.309213 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:46.309182 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95bfd5c0-cf27-4c85-80ef-2af051270b8e-console-config\") pod \"console-c797c67d5-59cd5\" (UID: \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\") " pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:47:46.309425 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:46.309189 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95bfd5c0-cf27-4c85-80ef-2af051270b8e-service-ca\") pod \"console-c797c67d5-59cd5\" (UID: \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\") " pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:47:46.309425 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:46.309402 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95bfd5c0-cf27-4c85-80ef-2af051270b8e-oauth-serving-cert\") pod \"console-c797c67d5-59cd5\" (UID: \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\") " pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:47:46.309551 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:46.309427 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95bfd5c0-cf27-4c85-80ef-2af051270b8e-trusted-ca-bundle\") pod \"console-c797c67d5-59cd5\" (UID: \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\") " pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:47:46.311853 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:46.311831 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95bfd5c0-cf27-4c85-80ef-2af051270b8e-console-oauth-config\") pod \"console-c797c67d5-59cd5\" (UID: \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\") " pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:47:46.311992 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:46.311963 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95bfd5c0-cf27-4c85-80ef-2af051270b8e-console-serving-cert\") pod \"console-c797c67d5-59cd5\" (UID: \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\") " pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:47:46.320748 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:46.320723 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9dfq\" (UniqueName: \"kubernetes.io/projected/95bfd5c0-cf27-4c85-80ef-2af051270b8e-kube-api-access-n9dfq\") pod \"console-c797c67d5-59cd5\" (UID: \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\") " pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:47:46.332026 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:46.331995 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:46.433769 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:46.433677 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:47:46.589875 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:46.589658 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c797c67d5-59cd5"] Jul 17 18:47:46.592232 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:47:46.592195 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95bfd5c0_cf27_4c85_80ef_2af051270b8e.slice/crio-cceddb87c6b2a5acb93428db5c939ea7f7ec7ad33dbda93a51773bc8cda8f726 WatchSource:0}: Error finding container cceddb87c6b2a5acb93428db5c939ea7f7ec7ad33dbda93a51773bc8cda8f726: Status 404 returned error can't find the container with id cceddb87c6b2a5acb93428db5c939ea7f7ec7ad33dbda93a51773bc8cda8f726 Jul 17 18:47:47.360621 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:47.360589 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c797c67d5-59cd5" event={"ID":"95bfd5c0-cf27-4c85-80ef-2af051270b8e","Type":"ContainerStarted","Data":"9975b9e888d40b529658d892c2d2f4e385e17d7994e4189c28b0f2bba1f313f0"} Jul 17 18:47:47.360779 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:47.360634 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c797c67d5-59cd5" event={"ID":"95bfd5c0-cf27-4c85-80ef-2af051270b8e","Type":"ContainerStarted","Data":"cceddb87c6b2a5acb93428db5c939ea7f7ec7ad33dbda93a51773bc8cda8f726"} Jul 17 18:47:47.381823 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:47.381769 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c797c67d5-59cd5" podStartSLOduration=1.381755005 podStartE2EDuration="1.381755005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:47:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:47:47.380102201 +0000 UTC m=+176.411715074" watchObservedRunningTime="2026-07-17 18:47:47.381755005 +0000 UTC m=+176.413367878" Jul 17 18:47:56.434649 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:56.434620 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:47:56.435028 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:56.434670 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:47:56.439297 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:56.439277 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:47:57.402245 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:57.402222 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:47:57.457095 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:57.457066 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bfc878459-8fttq"] Jul 17 18:47:57.561328 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:57.561281 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:57.662698 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:57.662615 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:57.763115 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:47:57.763087 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:48:04.084109 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:04.084074 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:48:04.185919 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:04.185878 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:48:22.486090 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:22.486032 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6bfc878459-8fttq" podUID="531efd22-2331-4027-bb5a-121b025ca91d" containerName="console" containerID="cri-o://3ec6231c21ae1d883f9e1329e0b3064bdeca62adf2b2353c107d95a7c27ea3b3" gracePeriod=15 Jul 17 18:48:22.733362 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:22.733340 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:48:22.827056 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:22.826968 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjmpg\" (UniqueName: \"kubernetes.io/projected/531efd22-2331-4027-bb5a-121b025ca91d-kube-api-access-kjmpg\") pod \"531efd22-2331-4027-bb5a-121b025ca91d\" (UID: \"531efd22-2331-4027-bb5a-121b025ca91d\") " Jul 17 18:48:22.827056 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:22.827025 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/531efd22-2331-4027-bb5a-121b025ca91d-service-ca\") pod \"531efd22-2331-4027-bb5a-121b025ca91d\" (UID: \"531efd22-2331-4027-bb5a-121b025ca91d\") " Jul 17 18:48:22.827278 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:22.827059 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/531efd22-2331-4027-bb5a-121b025ca91d-console-config\") pod \"531efd22-2331-4027-bb5a-121b025ca91d\" (UID: \"531efd22-2331-4027-bb5a-121b025ca91d\") " Jul 17 18:48:22.827278 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:22.827083 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/531efd22-2331-4027-bb5a-121b025ca91d-trusted-ca-bundle\") pod \"531efd22-2331-4027-bb5a-121b025ca91d\" (UID: \"531efd22-2331-4027-bb5a-121b025ca91d\") " Jul 17 18:48:22.827278 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:22.827124 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/531efd22-2331-4027-bb5a-121b025ca91d-console-oauth-config\") pod \"531efd22-2331-4027-bb5a-121b025ca91d\" (UID: \"531efd22-2331-4027-bb5a-121b025ca91d\") " Jul 17 18:48:22.827278 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:22.827163 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/531efd22-2331-4027-bb5a-121b025ca91d-console-serving-cert\") pod \"531efd22-2331-4027-bb5a-121b025ca91d\" (UID: \"531efd22-2331-4027-bb5a-121b025ca91d\") " Jul 17 18:48:22.827278 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:22.827232 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/531efd22-2331-4027-bb5a-121b025ca91d-oauth-serving-cert\") pod \"531efd22-2331-4027-bb5a-121b025ca91d\" (UID: \"531efd22-2331-4027-bb5a-121b025ca91d\") " Jul 17 18:48:22.827632 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:22.827514 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/531efd22-2331-4027-bb5a-121b025ca91d-console-config" (OuterVolumeSpecName: "console-config") pod "531efd22-2331-4027-bb5a-121b025ca91d" (UID: "531efd22-2331-4027-bb5a-121b025ca91d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:48:22.827632 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:22.827521 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/531efd22-2331-4027-bb5a-121b025ca91d-service-ca" (OuterVolumeSpecName: "service-ca") pod "531efd22-2331-4027-bb5a-121b025ca91d" (UID: "531efd22-2331-4027-bb5a-121b025ca91d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:48:22.827632 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:22.827563 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/531efd22-2331-4027-bb5a-121b025ca91d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "531efd22-2331-4027-bb5a-121b025ca91d" (UID: "531efd22-2331-4027-bb5a-121b025ca91d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:48:22.828130 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:22.828102 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/531efd22-2331-4027-bb5a-121b025ca91d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "531efd22-2331-4027-bb5a-121b025ca91d" (UID: "531efd22-2331-4027-bb5a-121b025ca91d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:48:22.829472 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:22.829444 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/531efd22-2331-4027-bb5a-121b025ca91d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "531efd22-2331-4027-bb5a-121b025ca91d" (UID: "531efd22-2331-4027-bb5a-121b025ca91d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:48:22.829562 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:22.829502 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/531efd22-2331-4027-bb5a-121b025ca91d-kube-api-access-kjmpg" (OuterVolumeSpecName: "kube-api-access-kjmpg") pod "531efd22-2331-4027-bb5a-121b025ca91d" (UID: "531efd22-2331-4027-bb5a-121b025ca91d"). InnerVolumeSpecName "kube-api-access-kjmpg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:48:22.829562 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:22.829545 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/531efd22-2331-4027-bb5a-121b025ca91d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "531efd22-2331-4027-bb5a-121b025ca91d" (UID: "531efd22-2331-4027-bb5a-121b025ca91d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:48:22.928419 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:22.928384 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/531efd22-2331-4027-bb5a-121b025ca91d-oauth-serving-cert\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:48:22.928419 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:22.928411 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjmpg\" (UniqueName: \"kubernetes.io/projected/531efd22-2331-4027-bb5a-121b025ca91d-kube-api-access-kjmpg\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:48:22.928419 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:22.928422 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/531efd22-2331-4027-bb5a-121b025ca91d-service-ca\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:48:22.928630 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:22.928430 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/531efd22-2331-4027-bb5a-121b025ca91d-console-config\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:48:22.928630 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:22.928439 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/531efd22-2331-4027-bb5a-121b025ca91d-trusted-ca-bundle\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:48:22.928630 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:22.928447 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/531efd22-2331-4027-bb5a-121b025ca91d-console-oauth-config\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:48:22.928630 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:22.928455 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/531efd22-2331-4027-bb5a-121b025ca91d-console-serving-cert\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:48:23.509644 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:23.509609 2559 generic.go:356] "Generic (PLEG): container finished" podID="531efd22-2331-4027-bb5a-121b025ca91d" containerID="3ec6231c21ae1d883f9e1329e0b3064bdeca62adf2b2353c107d95a7c27ea3b3" exitCode=0 Jul 17 18:48:23.510010 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:23.509658 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bfc878459-8fttq" Jul 17 18:48:23.510010 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:23.509700 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bfc878459-8fttq" event={"ID":"531efd22-2331-4027-bb5a-121b025ca91d","Type":"ContainerDied","Data":"3ec6231c21ae1d883f9e1329e0b3064bdeca62adf2b2353c107d95a7c27ea3b3"} Jul 17 18:48:23.510010 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:23.509752 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bfc878459-8fttq" event={"ID":"531efd22-2331-4027-bb5a-121b025ca91d","Type":"ContainerDied","Data":"ab347e77c70ed936cd5ec3dde47d3322d2c6f7ca7cea0cf14673dcc8122ba92d"} Jul 17 18:48:23.510010 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:23.509773 2559 scope.go:117] "RemoveContainer" containerID="3ec6231c21ae1d883f9e1329e0b3064bdeca62adf2b2353c107d95a7c27ea3b3" Jul 17 18:48:23.518100 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:23.518075 2559 scope.go:117] "RemoveContainer" containerID="3ec6231c21ae1d883f9e1329e0b3064bdeca62adf2b2353c107d95a7c27ea3b3" Jul 17 18:48:23.518424 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:48:23.518403 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ec6231c21ae1d883f9e1329e0b3064bdeca62adf2b2353c107d95a7c27ea3b3\": container with ID starting with 3ec6231c21ae1d883f9e1329e0b3064bdeca62adf2b2353c107d95a7c27ea3b3 not found: ID does not exist" containerID="3ec6231c21ae1d883f9e1329e0b3064bdeca62adf2b2353c107d95a7c27ea3b3" Jul 17 18:48:23.518501 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:23.518435 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ec6231c21ae1d883f9e1329e0b3064bdeca62adf2b2353c107d95a7c27ea3b3"} err="failed to get container status \"3ec6231c21ae1d883f9e1329e0b3064bdeca62adf2b2353c107d95a7c27ea3b3\": rpc error: code = NotFound desc = could not find container \"3ec6231c21ae1d883f9e1329e0b3064bdeca62adf2b2353c107d95a7c27ea3b3\": container with ID starting with 3ec6231c21ae1d883f9e1329e0b3064bdeca62adf2b2353c107d95a7c27ea3b3 not found: ID does not exist" Jul 17 18:48:23.529358 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:23.529333 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bfc878459-8fttq"] Jul 17 18:48:23.530626 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:23.530607 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bfc878459-8fttq"] Jul 17 18:48:25.490521 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:25.487864 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="531efd22-2331-4027-bb5a-121b025ca91d" path="/var/lib/kubelet/pods/531efd22-2331-4027-bb5a-121b025ca91d/volumes" Jul 17 18:48:52.422903 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:52.422868 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:48:52.550184 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:48:52.550149 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:04.299968 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:04.299936 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:04.358489 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:04.358454 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:08.241279 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:08.241242 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:08.525186 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:08.525097 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:30.572696 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.572663 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b759f7874-cscrk"] Jul 17 18:49:30.573081 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.572986 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="531efd22-2331-4027-bb5a-121b025ca91d" containerName="console" Jul 17 18:49:30.573081 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.572998 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="531efd22-2331-4027-bb5a-121b025ca91d" containerName="console" Jul 17 18:49:30.573081 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.573071 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="531efd22-2331-4027-bb5a-121b025ca91d" containerName="console" Jul 17 18:49:30.576066 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.576045 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:49:30.588906 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.588875 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b759f7874-cscrk"] Jul 17 18:49:30.644430 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.644395 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:30.688728 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.688687 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-service-ca\") pod \"console-b759f7874-cscrk\" (UID: \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\") " pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:49:30.688894 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.688742 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-oauth-serving-cert\") pod \"console-b759f7874-cscrk\" (UID: \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\") " pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:49:30.688894 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.688793 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-console-serving-cert\") pod \"console-b759f7874-cscrk\" (UID: \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\") " pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:49:30.688894 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.688815 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-console-config\") pod \"console-b759f7874-cscrk\" (UID: \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\") " pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:49:30.689000 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.688904 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-trusted-ca-bundle\") pod \"console-b759f7874-cscrk\" (UID: \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\") " pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:49:30.689000 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.688965 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-console-oauth-config\") pod \"console-b759f7874-cscrk\" (UID: \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\") " pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:49:30.689000 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.688992 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bh7f\" (UniqueName: \"kubernetes.io/projected/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-kube-api-access-6bh7f\") pod \"console-b759f7874-cscrk\" (UID: \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\") " pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:49:30.746712 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.746663 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:30.789695 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.789668 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-service-ca\") pod \"console-b759f7874-cscrk\" (UID: \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\") " pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:49:30.789851 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.789705 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-oauth-serving-cert\") pod \"console-b759f7874-cscrk\" (UID: \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\") " pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:49:30.789851 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.789836 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-console-serving-cert\") pod \"console-b759f7874-cscrk\" (UID: \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\") " pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:49:30.789928 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.789865 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-console-config\") pod \"console-b759f7874-cscrk\" (UID: \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\") " pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:49:30.789928 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.789903 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-trusted-ca-bundle\") pod \"console-b759f7874-cscrk\" (UID: \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\") " pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:49:30.790042 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.789933 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-console-oauth-config\") pod \"console-b759f7874-cscrk\" (UID: \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\") " pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:49:30.790042 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.789955 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bh7f\" (UniqueName: \"kubernetes.io/projected/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-kube-api-access-6bh7f\") pod \"console-b759f7874-cscrk\" (UID: \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\") " pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:49:30.790473 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.790452 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-oauth-serving-cert\") pod \"console-b759f7874-cscrk\" (UID: \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\") " pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:49:30.790583 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.790514 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-service-ca\") pod \"console-b759f7874-cscrk\" (UID: \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\") " pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:49:30.790583 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.790557 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-console-config\") pod \"console-b759f7874-cscrk\" (UID: \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\") " pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:49:30.790997 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.790974 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-trusted-ca-bundle\") pod \"console-b759f7874-cscrk\" (UID: \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\") " pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:49:30.792479 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.792454 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-console-oauth-config\") pod \"console-b759f7874-cscrk\" (UID: \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\") " pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:49:30.792684 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.792662 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-console-serving-cert\") pod \"console-b759f7874-cscrk\" (UID: \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\") " pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:49:30.798923 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.798902 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bh7f\" (UniqueName: \"kubernetes.io/projected/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-kube-api-access-6bh7f\") pod \"console-b759f7874-cscrk\" (UID: \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\") " pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:49:30.886003 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:30.885974 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:49:31.022448 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:31.022354 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b759f7874-cscrk"] Jul 17 18:49:31.025010 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:49:31.024988 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a55bc06_4bab_4ac0_8924_f3cf1768ed7f.slice/crio-62be91f692d2044f963b1b13d2f13662eefebe0e3549a5a401575966bc08fd68 WatchSource:0}: Error finding container 62be91f692d2044f963b1b13d2f13662eefebe0e3549a5a401575966bc08fd68: Status 404 returned error can't find the container with id 62be91f692d2044f963b1b13d2f13662eefebe0e3549a5a401575966bc08fd68 Jul 17 18:49:31.770082 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:31.770048 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b759f7874-cscrk" event={"ID":"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f","Type":"ContainerStarted","Data":"4a6312114c150dce22f92c26070c70b6f250b206ab6f721e7a205e4a094c4055"} Jul 17 18:49:31.770503 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:31.770098 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b759f7874-cscrk" event={"ID":"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f","Type":"ContainerStarted","Data":"62be91f692d2044f963b1b13d2f13662eefebe0e3549a5a401575966bc08fd68"} Jul 17 18:49:31.791450 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:31.791404 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b759f7874-cscrk" podStartSLOduration=1.791391036 podStartE2EDuration="1.791391036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:49:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:49:31.789421183 +0000 UTC m=+280.821034068" watchObservedRunningTime="2026-07-17 18:49:31.791391036 +0000 UTC m=+280.823003909" Jul 17 18:49:40.886594 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:40.886556 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:49:40.887070 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:40.886632 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:49:40.891238 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:40.891216 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:49:41.814776 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:41.814749 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:49:41.860358 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:41.860303 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c797c67d5-59cd5"] Jul 17 18:49:42.000431 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:42.000401 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:43.914894 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:43.914865 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:51.369048 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:51.369012 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jpl4k_d9bb01d7-7fed-4275-9a94-df46852eeb39/ovn-acl-logging/0.log" Jul 17 18:49:51.370599 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:51.370571 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jpl4k_d9bb01d7-7fed-4275-9a94-df46852eeb39/ovn-acl-logging/0.log" Jul 17 18:49:51.373130 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:51.373113 2559 kubelet.go:1648] "Image garbage collection succeeded" Jul 17 18:49:57.192357 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:57.192306 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:57.284466 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:57.284435 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:57.775786 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:57.775753 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np"] Jul 17 18:49:57.781285 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:57.781257 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np" Jul 17 18:49:57.785986 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:57.785961 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 17 18:49:57.786118 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:57.786062 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 17 18:49:57.786731 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:57.786713 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-llqq2\"" Jul 17 18:49:57.792205 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:57.792179 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np"] Jul 17 18:49:57.912848 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:57.912816 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np\" (UID: \"2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np" Jul 17 18:49:57.912848 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:57.912848 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cn66\" (UniqueName: \"kubernetes.io/projected/2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790-kube-api-access-5cn66\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np\" (UID: \"2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np" Jul 17 18:49:57.913052 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:57.912898 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np\" (UID: \"2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np" Jul 17 18:49:58.013485 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:58.013451 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np\" (UID: \"2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np" Jul 17 18:49:58.013679 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:58.013511 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np\" (UID: \"2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np" Jul 17 18:49:58.013679 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:58.013530 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cn66\" (UniqueName: \"kubernetes.io/projected/2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790-kube-api-access-5cn66\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np\" (UID: \"2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np" Jul 17 18:49:58.013895 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:58.013874 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np\" (UID: \"2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np" Jul 17 18:49:58.013956 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:58.013884 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np\" (UID: \"2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np" Jul 17 18:49:58.022601 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:58.022572 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cn66\" (UniqueName: \"kubernetes.io/projected/2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790-kube-api-access-5cn66\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np\" (UID: \"2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np" Jul 17 18:49:58.091248 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:58.091226 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np" Jul 17 18:49:58.224250 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:58.224141 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np"] Jul 17 18:49:58.226760 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:49:58.226735 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa2aeaf_76fa_4ab6_92a1_44b2a29c5790.slice/crio-c8f92e5196815f3775c9f1869d739a74fce8ade4c1c7e907dbcf0736f175ffce WatchSource:0}: Error finding container c8f92e5196815f3775c9f1869d739a74fce8ade4c1c7e907dbcf0736f175ffce: Status 404 returned error can't find the container with id c8f92e5196815f3775c9f1869d739a74fce8ade4c1c7e907dbcf0736f175ffce Jul 17 18:49:58.228685 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:58.228669 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 18:49:58.883258 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:49:58.883221 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np" event={"ID":"2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790","Type":"ContainerStarted","Data":"c8f92e5196815f3775c9f1869d739a74fce8ade4c1c7e907dbcf0736f175ffce"} Jul 17 18:50:05.914848 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:05.914813 2559 generic.go:356] "Generic (PLEG): container finished" podID="2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790" containerID="de55f1bac2ca300219804233f089ec367ba10b090fa877f6c13e4b0096ae93df" exitCode=0 Jul 17 18:50:05.915255 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:05.914908 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np" event={"ID":"2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790","Type":"ContainerDied","Data":"de55f1bac2ca300219804233f089ec367ba10b090fa877f6c13e4b0096ae93df"} Jul 17 18:50:06.881780 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:06.881735 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c797c67d5-59cd5" podUID="95bfd5c0-cf27-4c85-80ef-2af051270b8e" containerName="console" containerID="cri-o://9975b9e888d40b529658d892c2d2f4e385e17d7994e4189c28b0f2bba1f313f0" gracePeriod=15 Jul 17 18:50:07.143019 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.142952 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:50:07.302666 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.302628 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95bfd5c0-cf27-4c85-80ef-2af051270b8e-console-serving-cert\") pod \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\" (UID: \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\") " Jul 17 18:50:07.302849 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.302688 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95bfd5c0-cf27-4c85-80ef-2af051270b8e-trusted-ca-bundle\") pod \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\" (UID: \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\") " Jul 17 18:50:07.302849 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.302790 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9dfq\" (UniqueName: \"kubernetes.io/projected/95bfd5c0-cf27-4c85-80ef-2af051270b8e-kube-api-access-n9dfq\") pod \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\" (UID: \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\") " Jul 17 18:50:07.302849 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.302824 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95bfd5c0-cf27-4c85-80ef-2af051270b8e-oauth-serving-cert\") pod \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\" (UID: \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\") " Jul 17 18:50:07.303007 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.302852 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95bfd5c0-cf27-4c85-80ef-2af051270b8e-service-ca\") pod \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\" (UID: \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\") " Jul 17 18:50:07.303007 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.302882 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95bfd5c0-cf27-4c85-80ef-2af051270b8e-console-oauth-config\") pod \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\" (UID: \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\") " Jul 17 18:50:07.303007 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.302918 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95bfd5c0-cf27-4c85-80ef-2af051270b8e-console-config\") pod \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\" (UID: \"95bfd5c0-cf27-4c85-80ef-2af051270b8e\") " Jul 17 18:50:07.303215 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.303151 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95bfd5c0-cf27-4c85-80ef-2af051270b8e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "95bfd5c0-cf27-4c85-80ef-2af051270b8e" (UID: "95bfd5c0-cf27-4c85-80ef-2af051270b8e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:50:07.303272 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.303214 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95bfd5c0-cf27-4c85-80ef-2af051270b8e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "95bfd5c0-cf27-4c85-80ef-2af051270b8e" (UID: "95bfd5c0-cf27-4c85-80ef-2af051270b8e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:50:07.303475 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.303413 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95bfd5c0-cf27-4c85-80ef-2af051270b8e-service-ca" (OuterVolumeSpecName: "service-ca") pod "95bfd5c0-cf27-4c85-80ef-2af051270b8e" (UID: "95bfd5c0-cf27-4c85-80ef-2af051270b8e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:50:07.303475 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.303441 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95bfd5c0-cf27-4c85-80ef-2af051270b8e-console-config" (OuterVolumeSpecName: "console-config") pod "95bfd5c0-cf27-4c85-80ef-2af051270b8e" (UID: "95bfd5c0-cf27-4c85-80ef-2af051270b8e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:50:07.305367 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.305340 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95bfd5c0-cf27-4c85-80ef-2af051270b8e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "95bfd5c0-cf27-4c85-80ef-2af051270b8e" (UID: "95bfd5c0-cf27-4c85-80ef-2af051270b8e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:50:07.306047 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.306018 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95bfd5c0-cf27-4c85-80ef-2af051270b8e-kube-api-access-n9dfq" (OuterVolumeSpecName: "kube-api-access-n9dfq") pod "95bfd5c0-cf27-4c85-80ef-2af051270b8e" (UID: "95bfd5c0-cf27-4c85-80ef-2af051270b8e"). InnerVolumeSpecName "kube-api-access-n9dfq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:50:07.306282 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.306252 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95bfd5c0-cf27-4c85-80ef-2af051270b8e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "95bfd5c0-cf27-4c85-80ef-2af051270b8e" (UID: "95bfd5c0-cf27-4c85-80ef-2af051270b8e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:50:07.404570 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.404491 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95bfd5c0-cf27-4c85-80ef-2af051270b8e-oauth-serving-cert\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:50:07.404570 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.404524 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95bfd5c0-cf27-4c85-80ef-2af051270b8e-service-ca\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:50:07.404570 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.404537 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95bfd5c0-cf27-4c85-80ef-2af051270b8e-console-oauth-config\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:50:07.404570 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.404546 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95bfd5c0-cf27-4c85-80ef-2af051270b8e-console-config\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:50:07.404570 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.404554 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95bfd5c0-cf27-4c85-80ef-2af051270b8e-console-serving-cert\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:50:07.404570 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.404563 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95bfd5c0-cf27-4c85-80ef-2af051270b8e-trusted-ca-bundle\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:50:07.404570 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.404571 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9dfq\" (UniqueName: \"kubernetes.io/projected/95bfd5c0-cf27-4c85-80ef-2af051270b8e-kube-api-access-n9dfq\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:50:07.925953 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.925924 2559 generic.go:356] "Generic (PLEG): container finished" podID="95bfd5c0-cf27-4c85-80ef-2af051270b8e" containerID="9975b9e888d40b529658d892c2d2f4e385e17d7994e4189c28b0f2bba1f313f0" exitCode=0 Jul 17 18:50:07.926051 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.926021 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c797c67d5-59cd5" Jul 17 18:50:07.926109 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.926062 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c797c67d5-59cd5" event={"ID":"95bfd5c0-cf27-4c85-80ef-2af051270b8e","Type":"ContainerDied","Data":"9975b9e888d40b529658d892c2d2f4e385e17d7994e4189c28b0f2bba1f313f0"} Jul 17 18:50:07.926170 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.926122 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c797c67d5-59cd5" event={"ID":"95bfd5c0-cf27-4c85-80ef-2af051270b8e","Type":"ContainerDied","Data":"cceddb87c6b2a5acb93428db5c939ea7f7ec7ad33dbda93a51773bc8cda8f726"} Jul 17 18:50:07.926170 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.926154 2559 scope.go:117] "RemoveContainer" containerID="9975b9e888d40b529658d892c2d2f4e385e17d7994e4189c28b0f2bba1f313f0" Jul 17 18:50:07.934465 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.934448 2559 scope.go:117] "RemoveContainer" containerID="9975b9e888d40b529658d892c2d2f4e385e17d7994e4189c28b0f2bba1f313f0" Jul 17 18:50:07.934714 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:50:07.934693 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9975b9e888d40b529658d892c2d2f4e385e17d7994e4189c28b0f2bba1f313f0\": container with ID starting with 9975b9e888d40b529658d892c2d2f4e385e17d7994e4189c28b0f2bba1f313f0 not found: ID does not exist" containerID="9975b9e888d40b529658d892c2d2f4e385e17d7994e4189c28b0f2bba1f313f0" Jul 17 18:50:07.934779 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.934727 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9975b9e888d40b529658d892c2d2f4e385e17d7994e4189c28b0f2bba1f313f0"} err="failed to get container status \"9975b9e888d40b529658d892c2d2f4e385e17d7994e4189c28b0f2bba1f313f0\": rpc error: code = NotFound desc = could not find container \"9975b9e888d40b529658d892c2d2f4e385e17d7994e4189c28b0f2bba1f313f0\": container with ID starting with 9975b9e888d40b529658d892c2d2f4e385e17d7994e4189c28b0f2bba1f313f0 not found: ID does not exist" Jul 17 18:50:07.953744 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.953723 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c797c67d5-59cd5"] Jul 17 18:50:07.960132 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:07.960059 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c797c67d5-59cd5"] Jul 17 18:50:08.931746 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:08.931713 2559 generic.go:356] "Generic (PLEG): container finished" podID="2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790" containerID="1dfb697a3630f0fc82fc0490c03bb73f316893c6c85efc71a14b64ec8a4134a4" exitCode=0 Jul 17 18:50:08.932188 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:08.931798 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np" event={"ID":"2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790","Type":"ContainerDied","Data":"1dfb697a3630f0fc82fc0490c03bb73f316893c6c85efc71a14b64ec8a4134a4"} Jul 17 18:50:09.486623 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:09.486595 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95bfd5c0-cf27-4c85-80ef-2af051270b8e" path="/var/lib/kubelet/pods/95bfd5c0-cf27-4c85-80ef-2af051270b8e/volumes" Jul 17 18:50:16.972388 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:16.972358 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np" event={"ID":"2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790","Type":"ContainerStarted","Data":"86c1db568f83d60b70b71d6d5b8ecf4956d2abd63fd04865a279dae9dbd3105d"} Jul 17 18:50:16.991983 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:16.991929 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np" podStartSLOduration=2.477167866 podStartE2EDuration="19.991909111s" totalImagesPullingTime="17.514741245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:49:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:50:16.990195793 +0000 UTC m=+326.021808669" watchObservedRunningTime="2026-07-17 18:50:16.991909111 +0000 UTC m=+326.023521987" Jul 17 18:50:17.978496 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:17.978465 2559 generic.go:356] "Generic (PLEG): container finished" podID="2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790" containerID="86c1db568f83d60b70b71d6d5b8ecf4956d2abd63fd04865a279dae9dbd3105d" exitCode=0 Jul 17 18:50:17.978902 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:17.978554 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np" event={"ID":"2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790","Type":"ContainerDied","Data":"86c1db568f83d60b70b71d6d5b8ecf4956d2abd63fd04865a279dae9dbd3105d"} Jul 17 18:50:19.150600 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:19.150577 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np" Jul 17 18:50:19.209644 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:19.209616 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790-bundle\") pod \"2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790\" (UID: \"2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790\") " Jul 17 18:50:19.209778 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:19.209674 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cn66\" (UniqueName: \"kubernetes.io/projected/2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790-kube-api-access-5cn66\") pod \"2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790\" (UID: \"2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790\") " Jul 17 18:50:19.209778 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:19.209704 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790-util\") pod \"2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790\" (UID: \"2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790\") " Jul 17 18:50:19.210365 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:19.210339 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790-bundle" (OuterVolumeSpecName: "bundle") pod "2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790" (UID: "2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:50:19.211914 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:19.211887 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790-kube-api-access-5cn66" (OuterVolumeSpecName: "kube-api-access-5cn66") pod "2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790" (UID: "2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790"). InnerVolumeSpecName "kube-api-access-5cn66". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:50:19.214467 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:19.214445 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790-util" (OuterVolumeSpecName: "util") pod "2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790" (UID: "2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:50:19.311224 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:19.311149 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cn66\" (UniqueName: \"kubernetes.io/projected/2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790-kube-api-access-5cn66\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:50:19.311224 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:19.311179 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790-util\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:50:19.311224 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:19.311191 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790-bundle\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:50:19.988752 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:19.988723 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np" Jul 17 18:50:19.988752 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:19.988732 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407j4np" event={"ID":"2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790","Type":"ContainerDied","Data":"c8f92e5196815f3775c9f1869d739a74fce8ade4c1c7e907dbcf0736f175ffce"} Jul 17 18:50:19.988944 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:19.988771 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8f92e5196815f3775c9f1869d739a74fce8ade4c1c7e907dbcf0736f175ffce" Jul 17 18:50:23.957061 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:23.957029 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:24.931019 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:24.930983 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:26.217223 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:26.217187 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fh6zz"] Jul 17 18:50:26.217608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:26.217513 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790" containerName="pull" Jul 17 18:50:26.217608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:26.217524 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790" containerName="pull" Jul 17 18:50:26.217608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:26.217533 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95bfd5c0-cf27-4c85-80ef-2af051270b8e" containerName="console" Jul 17 18:50:26.217608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:26.217538 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="95bfd5c0-cf27-4c85-80ef-2af051270b8e" containerName="console" Jul 17 18:50:26.217608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:26.217545 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790" containerName="extract" Jul 17 18:50:26.217608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:26.217551 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790" containerName="extract" Jul 17 18:50:26.217608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:26.217571 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790" containerName="util" Jul 17 18:50:26.217608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:26.217576 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790" containerName="util" Jul 17 18:50:26.217850 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:26.217624 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fa2aeaf-76fa-4ab6-92a1-44b2a29c5790" containerName="extract" Jul 17 18:50:26.217850 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:26.217632 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="95bfd5c0-cf27-4c85-80ef-2af051270b8e" containerName="console" Jul 17 18:50:26.219790 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:26.219773 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fh6zz" Jul 17 18:50:26.224291 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:26.224265 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-pkd4x\"" Jul 17 18:50:26.224419 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:26.224342 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 17 18:50:26.224419 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:26.224342 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 17 18:50:26.235571 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:26.235545 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fh6zz"] Jul 17 18:50:26.269819 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:26.269783 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfmfn\" (UniqueName: \"kubernetes.io/projected/4181d69e-fc35-4dca-abe2-47c4502141db-kube-api-access-sfmfn\") pod \"cert-manager-operator-controller-manager-55c444bf86-fh6zz\" (UID: \"4181d69e-fc35-4dca-abe2-47c4502141db\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fh6zz" Jul 17 18:50:26.269988 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:26.269888 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4181d69e-fc35-4dca-abe2-47c4502141db-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fh6zz\" (UID: \"4181d69e-fc35-4dca-abe2-47c4502141db\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fh6zz" Jul 17 18:50:26.371273 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:26.371233 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfmfn\" (UniqueName: \"kubernetes.io/projected/4181d69e-fc35-4dca-abe2-47c4502141db-kube-api-access-sfmfn\") pod \"cert-manager-operator-controller-manager-55c444bf86-fh6zz\" (UID: \"4181d69e-fc35-4dca-abe2-47c4502141db\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fh6zz" Jul 17 18:50:26.371455 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:26.371349 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4181d69e-fc35-4dca-abe2-47c4502141db-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fh6zz\" (UID: \"4181d69e-fc35-4dca-abe2-47c4502141db\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fh6zz" Jul 17 18:50:26.371696 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:26.371678 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4181d69e-fc35-4dca-abe2-47c4502141db-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fh6zz\" (UID: \"4181d69e-fc35-4dca-abe2-47c4502141db\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fh6zz" Jul 17 18:50:26.380806 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:26.380775 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfmfn\" (UniqueName: \"kubernetes.io/projected/4181d69e-fc35-4dca-abe2-47c4502141db-kube-api-access-sfmfn\") pod \"cert-manager-operator-controller-manager-55c444bf86-fh6zz\" (UID: \"4181d69e-fc35-4dca-abe2-47c4502141db\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fh6zz" Jul 17 18:50:26.529446 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:26.529343 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fh6zz" Jul 17 18:50:26.670920 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:26.670890 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fh6zz"] Jul 17 18:50:26.674626 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:50:26.674602 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4181d69e_fc35_4dca_abe2_47c4502141db.slice/crio-05b10f6d96eae5b0845aa935b8d9f882efc7968cc1c3f7b14e4b40f1409a6422 WatchSource:0}: Error finding container 05b10f6d96eae5b0845aa935b8d9f882efc7968cc1c3f7b14e4b40f1409a6422: Status 404 returned error can't find the container with id 05b10f6d96eae5b0845aa935b8d9f882efc7968cc1c3f7b14e4b40f1409a6422 Jul 17 18:50:27.020153 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:27.020120 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fh6zz" event={"ID":"4181d69e-fc35-4dca-abe2-47c4502141db","Type":"ContainerStarted","Data":"05b10f6d96eae5b0845aa935b8d9f882efc7968cc1c3f7b14e4b40f1409a6422"} Jul 17 18:50:27.773181 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:27.773139 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:27.865050 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:27.864988 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:30.035963 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.035926 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fh6zz" event={"ID":"4181d69e-fc35-4dca-abe2-47c4502141db","Type":"ContainerStarted","Data":"adf1b3131dd36db11af6f519ebbbf771300e3c7ce6045a941df69fe9f0b22444"} Jul 17 18:50:30.060729 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.060663 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fh6zz" podStartSLOduration=1.229869042 podStartE2EDuration="4.060643227s" totalImagesPullingTime="2.830774185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:50:30.05868792 +0000 UTC m=+339.090300786" watchObservedRunningTime="2026-07-17 18:50:30.060643227 +0000 UTC m=+339.092256101" Jul 17 18:50:30.388506 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.388480 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zwmxf"] Jul 17 18:50:30.391106 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.391091 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-zwmxf" Jul 17 18:50:30.394262 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.394246 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 17 18:50:30.394373 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.394250 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 17 18:50:30.417069 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.417039 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zwmxf"] Jul 17 18:50:30.507296 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.507258 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cqbp\" (UniqueName: \"kubernetes.io/projected/2aa1780d-f099-42cb-be18-0dd10b5f0f2f-kube-api-access-8cqbp\") pod \"cert-manager-webhook-6486ffd997-zwmxf\" (UID: \"2aa1780d-f099-42cb-be18-0dd10b5f0f2f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zwmxf" Jul 17 18:50:30.507507 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.507339 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2aa1780d-f099-42cb-be18-0dd10b5f0f2f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zwmxf\" (UID: \"2aa1780d-f099-42cb-be18-0dd10b5f0f2f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zwmxf" Jul 17 18:50:30.527169 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.527139 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:30.608554 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.608516 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cqbp\" (UniqueName: \"kubernetes.io/projected/2aa1780d-f099-42cb-be18-0dd10b5f0f2f-kube-api-access-8cqbp\") pod \"cert-manager-webhook-6486ffd997-zwmxf\" (UID: \"2aa1780d-f099-42cb-be18-0dd10b5f0f2f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zwmxf" Jul 17 18:50:30.608720 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.608567 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2aa1780d-f099-42cb-be18-0dd10b5f0f2f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zwmxf\" (UID: \"2aa1780d-f099-42cb-be18-0dd10b5f0f2f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zwmxf" Jul 17 18:50:30.628369 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.628338 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2aa1780d-f099-42cb-be18-0dd10b5f0f2f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zwmxf\" (UID: \"2aa1780d-f099-42cb-be18-0dd10b5f0f2f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zwmxf" Jul 17 18:50:30.628707 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.628687 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cqbp\" (UniqueName: \"kubernetes.io/projected/2aa1780d-f099-42cb-be18-0dd10b5f0f2f-kube-api-access-8cqbp\") pod \"cert-manager-webhook-6486ffd997-zwmxf\" (UID: \"2aa1780d-f099-42cb-be18-0dd10b5f0f2f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zwmxf" Jul 17 18:50:30.672435 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.672347 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:30.713443 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.713413 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-zwmxf" Jul 17 18:50:30.771210 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.771164 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn"] Jul 17 18:50:30.774523 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.774495 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn" Jul 17 18:50:30.778404 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.778195 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 17 18:50:30.779741 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.779569 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-llqq2\"" Jul 17 18:50:30.779741 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.779569 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 17 18:50:30.809899 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.809869 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28rzc\" (UniqueName: \"kubernetes.io/projected/54cbd623-d5d7-4bd4-a3d0-65046d26622d-kube-api-access-28rzc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn\" (UID: \"54cbd623-d5d7-4bd4-a3d0-65046d26622d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn" Jul 17 18:50:30.810027 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.809906 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54cbd623-d5d7-4bd4-a3d0-65046d26622d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn\" (UID: \"54cbd623-d5d7-4bd4-a3d0-65046d26622d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn" Jul 17 18:50:30.810027 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.809952 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54cbd623-d5d7-4bd4-a3d0-65046d26622d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn\" (UID: \"54cbd623-d5d7-4bd4-a3d0-65046d26622d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn" Jul 17 18:50:30.856854 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.856820 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn"] Jul 17 18:50:30.864812 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.864789 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zwmxf"] Jul 17 18:50:30.868380 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:50:30.868350 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2aa1780d_f099_42cb_be18_0dd10b5f0f2f.slice/crio-bc06f6474549dd5b0eff789aced8922572b2463b359cc1bcae1003734d4a3ceb WatchSource:0}: Error finding container bc06f6474549dd5b0eff789aced8922572b2463b359cc1bcae1003734d4a3ceb: Status 404 returned error can't find the container with id bc06f6474549dd5b0eff789aced8922572b2463b359cc1bcae1003734d4a3ceb Jul 17 18:50:30.911078 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.911042 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28rzc\" (UniqueName: \"kubernetes.io/projected/54cbd623-d5d7-4bd4-a3d0-65046d26622d-kube-api-access-28rzc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn\" (UID: \"54cbd623-d5d7-4bd4-a3d0-65046d26622d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn" Jul 17 18:50:30.911251 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.911081 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54cbd623-d5d7-4bd4-a3d0-65046d26622d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn\" (UID: \"54cbd623-d5d7-4bd4-a3d0-65046d26622d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn" Jul 17 18:50:30.911251 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.911125 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54cbd623-d5d7-4bd4-a3d0-65046d26622d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn\" (UID: \"54cbd623-d5d7-4bd4-a3d0-65046d26622d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn" Jul 17 18:50:30.911591 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.911570 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54cbd623-d5d7-4bd4-a3d0-65046d26622d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn\" (UID: \"54cbd623-d5d7-4bd4-a3d0-65046d26622d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn" Jul 17 18:50:30.911632 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.911591 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54cbd623-d5d7-4bd4-a3d0-65046d26622d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn\" (UID: \"54cbd623-d5d7-4bd4-a3d0-65046d26622d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn" Jul 17 18:50:30.921656 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:30.921632 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28rzc\" (UniqueName: \"kubernetes.io/projected/54cbd623-d5d7-4bd4-a3d0-65046d26622d-kube-api-access-28rzc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn\" (UID: \"54cbd623-d5d7-4bd4-a3d0-65046d26622d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn" Jul 17 18:50:31.041987 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:31.041900 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-zwmxf" event={"ID":"2aa1780d-f099-42cb-be18-0dd10b5f0f2f","Type":"ContainerStarted","Data":"bc06f6474549dd5b0eff789aced8922572b2463b359cc1bcae1003734d4a3ceb"} Jul 17 18:50:31.087019 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:31.086993 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn" Jul 17 18:50:31.240464 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:31.240270 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn"] Jul 17 18:50:31.242935 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:50:31.242896 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54cbd623_d5d7_4bd4_a3d0_65046d26622d.slice/crio-48c69e39c7e0036f3738b01dcadcf5fde155e715128a6fa1add8112d329891d2 WatchSource:0}: Error finding container 48c69e39c7e0036f3738b01dcadcf5fde155e715128a6fa1add8112d329891d2: Status 404 returned error can't find the container with id 48c69e39c7e0036f3738b01dcadcf5fde155e715128a6fa1add8112d329891d2 Jul 17 18:50:32.047721 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:32.047674 2559 generic.go:356] "Generic (PLEG): container finished" podID="54cbd623-d5d7-4bd4-a3d0-65046d26622d" containerID="7e7d6f9e9c437f0ae71b01eb358feda7327fac6f231160a4ced473727206dd42" exitCode=0 Jul 17 18:50:32.048135 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:32.047759 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn" event={"ID":"54cbd623-d5d7-4bd4-a3d0-65046d26622d","Type":"ContainerDied","Data":"7e7d6f9e9c437f0ae71b01eb358feda7327fac6f231160a4ced473727206dd42"} Jul 17 18:50:32.048135 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:32.047828 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn" event={"ID":"54cbd623-d5d7-4bd4-a3d0-65046d26622d","Type":"ContainerStarted","Data":"48c69e39c7e0036f3738b01dcadcf5fde155e715128a6fa1add8112d329891d2"} Jul 17 18:50:32.652178 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:32.652138 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:33.046803 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:33.046725 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:33.850209 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:33.850172 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-m6tl6"] Jul 17 18:50:33.853226 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:33.853198 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6tl6" Jul 17 18:50:33.855671 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:33.855642 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-sgrc6\"" Jul 17 18:50:33.864551 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:33.864525 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-m6tl6"] Jul 17 18:50:33.937814 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:33.937781 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/acc90041-dea8-47e0-9b94-df20cb91f297-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-m6tl6\" (UID: \"acc90041-dea8-47e0-9b94-df20cb91f297\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6tl6" Jul 17 18:50:33.937995 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:33.937825 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6tg4\" (UniqueName: \"kubernetes.io/projected/acc90041-dea8-47e0-9b94-df20cb91f297-kube-api-access-j6tg4\") pod \"cert-manager-cainjector-559cdd8c87-m6tl6\" (UID: \"acc90041-dea8-47e0-9b94-df20cb91f297\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6tl6" Jul 17 18:50:34.039143 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:34.039103 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/acc90041-dea8-47e0-9b94-df20cb91f297-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-m6tl6\" (UID: \"acc90041-dea8-47e0-9b94-df20cb91f297\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6tl6" Jul 17 18:50:34.039296 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:34.039164 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6tg4\" (UniqueName: \"kubernetes.io/projected/acc90041-dea8-47e0-9b94-df20cb91f297-kube-api-access-j6tg4\") pod \"cert-manager-cainjector-559cdd8c87-m6tl6\" (UID: \"acc90041-dea8-47e0-9b94-df20cb91f297\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6tl6" Jul 17 18:50:34.048704 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:34.048674 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/acc90041-dea8-47e0-9b94-df20cb91f297-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-m6tl6\" (UID: \"acc90041-dea8-47e0-9b94-df20cb91f297\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6tl6" Jul 17 18:50:34.048853 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:34.048794 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6tg4\" (UniqueName: \"kubernetes.io/projected/acc90041-dea8-47e0-9b94-df20cb91f297-kube-api-access-j6tg4\") pod \"cert-manager-cainjector-559cdd8c87-m6tl6\" (UID: \"acc90041-dea8-47e0-9b94-df20cb91f297\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6tl6" Jul 17 18:50:34.166185 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:34.166103 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6tl6" Jul 17 18:50:34.556840 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:34.556750 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:34.656520 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:34.656484 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:34.871261 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:34.871227 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-m6tl6"] Jul 17 18:50:34.875106 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:50:34.875075 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podacc90041_dea8_47e0_9b94_df20cb91f297.slice/crio-283d8c7a0dec8569ba0ed6c3736c1a6e6941e44f3977c025e264d6fc28d99f64 WatchSource:0}: Error finding container 283d8c7a0dec8569ba0ed6c3736c1a6e6941e44f3977c025e264d6fc28d99f64: Status 404 returned error can't find the container with id 283d8c7a0dec8569ba0ed6c3736c1a6e6941e44f3977c025e264d6fc28d99f64 Jul 17 18:50:35.067986 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:35.067895 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6tl6" event={"ID":"acc90041-dea8-47e0-9b94-df20cb91f297","Type":"ContainerStarted","Data":"9cf7e8a8faf597d45e26f6f62d5d0387c9faeaf7672157d10d5086c18b11abec"} Jul 17 18:50:35.067986 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:35.067955 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6tl6" event={"ID":"acc90041-dea8-47e0-9b94-df20cb91f297","Type":"ContainerStarted","Data":"283d8c7a0dec8569ba0ed6c3736c1a6e6941e44f3977c025e264d6fc28d99f64"} Jul 17 18:50:35.069527 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:35.069503 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-zwmxf" event={"ID":"2aa1780d-f099-42cb-be18-0dd10b5f0f2f","Type":"ContainerStarted","Data":"1e29e5dd237566a3a0719d293a3a86d8b5072dd9d211dfe7dfd0ed8459420b28"} Jul 17 18:50:35.069647 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:35.069567 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-zwmxf" Jul 17 18:50:35.071156 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:35.071130 2559 generic.go:356] "Generic (PLEG): container finished" podID="54cbd623-d5d7-4bd4-a3d0-65046d26622d" containerID="bf0563fc7e4b10a74d6ff38a42ad3c23717329de4b17f798f9ebd5328c24f859" exitCode=0 Jul 17 18:50:35.071263 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:35.071166 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn" event={"ID":"54cbd623-d5d7-4bd4-a3d0-65046d26622d","Type":"ContainerDied","Data":"bf0563fc7e4b10a74d6ff38a42ad3c23717329de4b17f798f9ebd5328c24f859"} Jul 17 18:50:35.089959 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:35.089902 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6tl6" podStartSLOduration=2.08988114 podStartE2EDuration="2.08988114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:50:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:50:35.088034265 +0000 UTC m=+344.119647129" watchObservedRunningTime="2026-07-17 18:50:35.08988114 +0000 UTC m=+344.121494017" Jul 17 18:50:35.106922 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:35.106871 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-zwmxf" podStartSLOduration=1.254142078 podStartE2EDuration="5.106855635s" totalImagesPullingTime="3.852713557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:50:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:50:35.106226452 +0000 UTC m=+344.137839324" watchObservedRunningTime="2026-07-17 18:50:35.106855635 +0000 UTC m=+344.138468505" Jul 17 18:50:36.077360 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:36.077327 2559 generic.go:356] "Generic (PLEG): container finished" podID="54cbd623-d5d7-4bd4-a3d0-65046d26622d" containerID="69adcbd87be7a96eca3d7865c823dcc83491f0d84efd1a3f2b3b217a0a916912" exitCode=0 Jul 17 18:50:36.077752 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:36.077390 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn" event={"ID":"54cbd623-d5d7-4bd4-a3d0-65046d26622d","Type":"ContainerDied","Data":"69adcbd87be7a96eca3d7865c823dcc83491f0d84efd1a3f2b3b217a0a916912"} Jul 17 18:50:37.214339 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:37.214297 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn" Jul 17 18:50:37.268475 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:37.268445 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28rzc\" (UniqueName: \"kubernetes.io/projected/54cbd623-d5d7-4bd4-a3d0-65046d26622d-kube-api-access-28rzc\") pod \"54cbd623-d5d7-4bd4-a3d0-65046d26622d\" (UID: \"54cbd623-d5d7-4bd4-a3d0-65046d26622d\") " Jul 17 18:50:37.268594 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:37.268512 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54cbd623-d5d7-4bd4-a3d0-65046d26622d-util\") pod \"54cbd623-d5d7-4bd4-a3d0-65046d26622d\" (UID: \"54cbd623-d5d7-4bd4-a3d0-65046d26622d\") " Jul 17 18:50:37.268594 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:37.268548 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54cbd623-d5d7-4bd4-a3d0-65046d26622d-bundle\") pod \"54cbd623-d5d7-4bd4-a3d0-65046d26622d\" (UID: \"54cbd623-d5d7-4bd4-a3d0-65046d26622d\") " Jul 17 18:50:37.268922 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:37.268902 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54cbd623-d5d7-4bd4-a3d0-65046d26622d-bundle" (OuterVolumeSpecName: "bundle") pod "54cbd623-d5d7-4bd4-a3d0-65046d26622d" (UID: "54cbd623-d5d7-4bd4-a3d0-65046d26622d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:50:37.270594 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:37.270570 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54cbd623-d5d7-4bd4-a3d0-65046d26622d-kube-api-access-28rzc" (OuterVolumeSpecName: "kube-api-access-28rzc") pod "54cbd623-d5d7-4bd4-a3d0-65046d26622d" (UID: "54cbd623-d5d7-4bd4-a3d0-65046d26622d"). InnerVolumeSpecName "kube-api-access-28rzc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:50:37.273374 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:37.273355 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54cbd623-d5d7-4bd4-a3d0-65046d26622d-util" (OuterVolumeSpecName: "util") pod "54cbd623-d5d7-4bd4-a3d0-65046d26622d" (UID: "54cbd623-d5d7-4bd4-a3d0-65046d26622d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:50:37.370005 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:37.369973 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28rzc\" (UniqueName: \"kubernetes.io/projected/54cbd623-d5d7-4bd4-a3d0-65046d26622d-kube-api-access-28rzc\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:50:37.370005 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:37.370000 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54cbd623-d5d7-4bd4-a3d0-65046d26622d-util\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:50:37.370005 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:37.370013 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54cbd623-d5d7-4bd4-a3d0-65046d26622d-bundle\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:50:38.088373 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:38.088335 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn" event={"ID":"54cbd623-d5d7-4bd4-a3d0-65046d26622d","Type":"ContainerDied","Data":"48c69e39c7e0036f3738b01dcadcf5fde155e715128a6fa1add8112d329891d2"} Jul 17 18:50:38.088624 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:38.088394 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="48c69e39c7e0036f3738b01dcadcf5fde155e715128a6fa1add8112d329891d2" Jul 17 18:50:38.088624 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:38.088401 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhqgmn" Jul 17 18:50:40.271326 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:40.271261 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:40.995432 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:40.995398 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-gm5gk"] Jul 17 18:50:40.995756 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:40.995744 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54cbd623-d5d7-4bd4-a3d0-65046d26622d" containerName="pull" Jul 17 18:50:40.995802 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:40.995758 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="54cbd623-d5d7-4bd4-a3d0-65046d26622d" containerName="pull" Jul 17 18:50:40.995802 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:40.995766 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54cbd623-d5d7-4bd4-a3d0-65046d26622d" containerName="util" Jul 17 18:50:40.995802 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:40.995771 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="54cbd623-d5d7-4bd4-a3d0-65046d26622d" containerName="util" Jul 17 18:50:40.995802 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:40.995778 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54cbd623-d5d7-4bd4-a3d0-65046d26622d" containerName="extract" Jul 17 18:50:40.995802 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:40.995784 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="54cbd623-d5d7-4bd4-a3d0-65046d26622d" containerName="extract" Jul 17 18:50:40.995957 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:40.995842 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="54cbd623-d5d7-4bd4-a3d0-65046d26622d" containerName="extract" Jul 17 18:50:40.998071 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:40.998056 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-gm5gk" Jul 17 18:50:41.000710 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:41.000682 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-g8wpc\"" Jul 17 18:50:41.012560 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:41.012539 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-gm5gk"] Jul 17 18:50:41.079663 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:41.079636 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-zwmxf" Jul 17 18:50:41.102045 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:41.102010 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e550cf10-06c6-4d55-bb70-f64f35648450-bound-sa-token\") pod \"cert-manager-55b4d954d5-gm5gk\" (UID: \"e550cf10-06c6-4d55-bb70-f64f35648450\") " pod="cert-manager/cert-manager-55b4d954d5-gm5gk" Jul 17 18:50:41.102207 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:41.102076 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdb88\" (UniqueName: \"kubernetes.io/projected/e550cf10-06c6-4d55-bb70-f64f35648450-kube-api-access-wdb88\") pod \"cert-manager-55b4d954d5-gm5gk\" (UID: \"e550cf10-06c6-4d55-bb70-f64f35648450\") " pod="cert-manager/cert-manager-55b4d954d5-gm5gk" Jul 17 18:50:41.202992 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:41.202946 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdb88\" (UniqueName: \"kubernetes.io/projected/e550cf10-06c6-4d55-bb70-f64f35648450-kube-api-access-wdb88\") pod \"cert-manager-55b4d954d5-gm5gk\" (UID: \"e550cf10-06c6-4d55-bb70-f64f35648450\") " pod="cert-manager/cert-manager-55b4d954d5-gm5gk" Jul 17 18:50:41.203209 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:41.203032 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e550cf10-06c6-4d55-bb70-f64f35648450-bound-sa-token\") pod \"cert-manager-55b4d954d5-gm5gk\" (UID: \"e550cf10-06c6-4d55-bb70-f64f35648450\") " pod="cert-manager/cert-manager-55b4d954d5-gm5gk" Jul 17 18:50:41.212598 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:41.212560 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e550cf10-06c6-4d55-bb70-f64f35648450-bound-sa-token\") pod \"cert-manager-55b4d954d5-gm5gk\" (UID: \"e550cf10-06c6-4d55-bb70-f64f35648450\") " pod="cert-manager/cert-manager-55b4d954d5-gm5gk" Jul 17 18:50:41.212727 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:41.212571 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdb88\" (UniqueName: \"kubernetes.io/projected/e550cf10-06c6-4d55-bb70-f64f35648450-kube-api-access-wdb88\") pod \"cert-manager-55b4d954d5-gm5gk\" (UID: \"e550cf10-06c6-4d55-bb70-f64f35648450\") " pod="cert-manager/cert-manager-55b4d954d5-gm5gk" Jul 17 18:50:41.307661 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:41.307559 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-gm5gk" Jul 17 18:50:41.441861 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:41.441784 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-gm5gk"] Jul 17 18:50:41.443962 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:50:41.443928 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode550cf10_06c6_4d55_bb70_f64f35648450.slice/crio-63578537ce7a32706fc5fd9e53a7e71c01ecb7a1e7126e9a32ce81b4de0cd392 WatchSource:0}: Error finding container 63578537ce7a32706fc5fd9e53a7e71c01ecb7a1e7126e9a32ce81b4de0cd392: Status 404 returned error can't find the container with id 63578537ce7a32706fc5fd9e53a7e71c01ecb7a1e7126e9a32ce81b4de0cd392 Jul 17 18:50:41.975409 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:41.975334 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:42.064514 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:42.064487 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:42.107278 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:42.107253 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-gm5gk" event={"ID":"e550cf10-06c6-4d55-bb70-f64f35648450","Type":"ContainerStarted","Data":"486125c13c6180d909e585910ad020ad84ff4351445ae79b7d2c14a9cfcc04ce"} Jul 17 18:50:42.107441 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:42.107286 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-gm5gk" event={"ID":"e550cf10-06c6-4d55-bb70-f64f35648450","Type":"ContainerStarted","Data":"63578537ce7a32706fc5fd9e53a7e71c01ecb7a1e7126e9a32ce81b4de0cd392"} Jul 17 18:50:42.135019 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:42.134958 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-gm5gk" podStartSLOduration=2.13493897 podStartE2EDuration="2.13493897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:50:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:50:42.128949208 +0000 UTC m=+351.160562083" watchObservedRunningTime="2026-07-17 18:50:42.13493897 +0000 UTC m=+351.166551842" Jul 17 18:50:43.341531 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:43.341497 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8fcjt"] Jul 17 18:50:43.344795 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:43.344780 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8fcjt" Jul 17 18:50:43.347243 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:43.347211 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 17 18:50:43.347387 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:43.347250 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-wm75z\"" Jul 17 18:50:43.347886 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:43.347869 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 17 18:50:43.354167 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:43.354148 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8fcjt"] Jul 17 18:50:43.422046 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:43.422014 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q6pz\" (UniqueName: \"kubernetes.io/projected/1024ffdf-5004-4b88-b187-0547424e6242-kube-api-access-9q6pz\") pod \"openshift-lws-operator-fd8ccff4c-8fcjt\" (UID: \"1024ffdf-5004-4b88-b187-0547424e6242\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8fcjt" Jul 17 18:50:43.422175 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:43.422055 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1024ffdf-5004-4b88-b187-0547424e6242-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8fcjt\" (UID: \"1024ffdf-5004-4b88-b187-0547424e6242\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8fcjt" Jul 17 18:50:43.522986 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:43.522954 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q6pz\" (UniqueName: \"kubernetes.io/projected/1024ffdf-5004-4b88-b187-0547424e6242-kube-api-access-9q6pz\") pod \"openshift-lws-operator-fd8ccff4c-8fcjt\" (UID: \"1024ffdf-5004-4b88-b187-0547424e6242\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8fcjt" Jul 17 18:50:43.523144 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:43.522995 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1024ffdf-5004-4b88-b187-0547424e6242-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8fcjt\" (UID: \"1024ffdf-5004-4b88-b187-0547424e6242\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8fcjt" Jul 17 18:50:43.523358 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:43.523343 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1024ffdf-5004-4b88-b187-0547424e6242-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8fcjt\" (UID: \"1024ffdf-5004-4b88-b187-0547424e6242\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8fcjt" Jul 17 18:50:43.532107 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:43.532084 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q6pz\" (UniqueName: \"kubernetes.io/projected/1024ffdf-5004-4b88-b187-0547424e6242-kube-api-access-9q6pz\") pod \"openshift-lws-operator-fd8ccff4c-8fcjt\" (UID: \"1024ffdf-5004-4b88-b187-0547424e6242\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8fcjt" Jul 17 18:50:43.655120 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:43.655024 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8fcjt" Jul 17 18:50:43.789288 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:43.789262 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8fcjt"] Jul 17 18:50:43.791210 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:50:43.791187 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1024ffdf_5004_4b88_b187_0547424e6242.slice/crio-214f783c63493cbf124609cd609c8111e2f301adf85addbf8ad78b941893f44a WatchSource:0}: Error finding container 214f783c63493cbf124609cd609c8111e2f301adf85addbf8ad78b941893f44a: Status 404 returned error can't find the container with id 214f783c63493cbf124609cd609c8111e2f301adf85addbf8ad78b941893f44a Jul 17 18:50:44.117288 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:44.117251 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8fcjt" event={"ID":"1024ffdf-5004-4b88-b187-0547424e6242","Type":"ContainerStarted","Data":"214f783c63493cbf124609cd609c8111e2f301adf85addbf8ad78b941893f44a"} Jul 17 18:50:47.739035 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:47.738995 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:49.142286 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:49.142253 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8fcjt" event={"ID":"1024ffdf-5004-4b88-b187-0547424e6242","Type":"ContainerStarted","Data":"08f004d930dc3545af4cd160f95a490916a6be6af8203f12876279e76822855e"} Jul 17 18:50:49.159606 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:49.159560 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8fcjt" podStartSLOduration=1.778624752 podStartE2EDuration="6.159546807s" totalImagesPullingTime="4.380922055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:50:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:50:49.158492499 +0000 UTC m=+358.190105372" watchObservedRunningTime="2026-07-17 18:50:49.159546807 +0000 UTC m=+358.191159680" Jul 17 18:50:49.806818 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:49.806790 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:49.911597 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:49.911556 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:51.287326 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:51.287290 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd"] Jul 17 18:50:51.304239 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:51.304213 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd"] Jul 17 18:50:51.304424 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:51.304306 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd" Jul 17 18:50:51.306699 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:51.306677 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 17 18:50:51.306911 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:51.306884 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-llqq2\"" Jul 17 18:50:51.307558 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:51.307537 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 17 18:50:51.391018 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:51.390980 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16ac1740-6246-4898-99e4-ba19c4b5c771-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd\" (UID: \"16ac1740-6246-4898-99e4-ba19c4b5c771\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd" Jul 17 18:50:51.391207 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:51.391042 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16ac1740-6246-4898-99e4-ba19c4b5c771-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd\" (UID: \"16ac1740-6246-4898-99e4-ba19c4b5c771\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd" Jul 17 18:50:51.391207 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:51.391099 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x74cn\" (UniqueName: \"kubernetes.io/projected/16ac1740-6246-4898-99e4-ba19c4b5c771-kube-api-access-x74cn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd\" (UID: \"16ac1740-6246-4898-99e4-ba19c4b5c771\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd" Jul 17 18:50:51.491860 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:51.491828 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16ac1740-6246-4898-99e4-ba19c4b5c771-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd\" (UID: \"16ac1740-6246-4898-99e4-ba19c4b5c771\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd" Jul 17 18:50:51.491860 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:51.491863 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16ac1740-6246-4898-99e4-ba19c4b5c771-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd\" (UID: \"16ac1740-6246-4898-99e4-ba19c4b5c771\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd" Jul 17 18:50:51.492034 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:51.491989 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x74cn\" (UniqueName: \"kubernetes.io/projected/16ac1740-6246-4898-99e4-ba19c4b5c771-kube-api-access-x74cn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd\" (UID: \"16ac1740-6246-4898-99e4-ba19c4b5c771\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd" Jul 17 18:50:51.492166 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:51.492148 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16ac1740-6246-4898-99e4-ba19c4b5c771-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd\" (UID: \"16ac1740-6246-4898-99e4-ba19c4b5c771\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd" Jul 17 18:50:51.492222 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:51.492204 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16ac1740-6246-4898-99e4-ba19c4b5c771-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd\" (UID: \"16ac1740-6246-4898-99e4-ba19c4b5c771\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd" Jul 17 18:50:51.501391 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:51.501374 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 17 18:50:51.511941 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:51.511920 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 17 18:50:51.521671 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:51.521647 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x74cn\" (UniqueName: \"kubernetes.io/projected/16ac1740-6246-4898-99e4-ba19c4b5c771-kube-api-access-x74cn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd\" (UID: \"16ac1740-6246-4898-99e4-ba19c4b5c771\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd" Jul 17 18:50:51.617499 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:51.617473 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-llqq2\"" Jul 17 18:50:51.625784 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:51.625766 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd" Jul 17 18:50:51.781053 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:51.781026 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd"] Jul 17 18:50:51.782970 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:50:51.782941 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16ac1740_6246_4898_99e4_ba19c4b5c771.slice/crio-3901507df5aaf0909a3281a6f8ea5ba0761719c154156b5c9d2365ca3df042db WatchSource:0}: Error finding container 3901507df5aaf0909a3281a6f8ea5ba0761719c154156b5c9d2365ca3df042db: Status 404 returned error can't find the container with id 3901507df5aaf0909a3281a6f8ea5ba0761719c154156b5c9d2365ca3df042db Jul 17 18:50:51.931248 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:51.931225 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:52.157587 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:52.157499 2559 generic.go:356] "Generic (PLEG): container finished" podID="16ac1740-6246-4898-99e4-ba19c4b5c771" containerID="08bd1c9cf0ccd5194a8ab6d0a068d41b65db455d06f25253e4ee8d8f86bfbad4" exitCode=0 Jul 17 18:50:52.157729 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:52.157597 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd" event={"ID":"16ac1740-6246-4898-99e4-ba19c4b5c771","Type":"ContainerDied","Data":"08bd1c9cf0ccd5194a8ab6d0a068d41b65db455d06f25253e4ee8d8f86bfbad4"} Jul 17 18:50:52.157729 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:52.157647 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd" event={"ID":"16ac1740-6246-4898-99e4-ba19c4b5c771","Type":"ContainerStarted","Data":"3901507df5aaf0909a3281a6f8ea5ba0761719c154156b5c9d2365ca3df042db"} Jul 17 18:50:53.358003 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:53.357967 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:54.169080 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:54.169047 2559 generic.go:356] "Generic (PLEG): container finished" podID="16ac1740-6246-4898-99e4-ba19c4b5c771" containerID="51ccb2aa6dea7a8e3e1d55e0c0e28109f976952afca92a45fdfd22c03dc4f1ea" exitCode=0 Jul 17 18:50:54.169358 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:54.169110 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd" event={"ID":"16ac1740-6246-4898-99e4-ba19c4b5c771","Type":"ContainerDied","Data":"51ccb2aa6dea7a8e3e1d55e0c0e28109f976952afca92a45fdfd22c03dc4f1ea"} Jul 17 18:50:55.175371 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:55.175337 2559 generic.go:356] "Generic (PLEG): container finished" podID="16ac1740-6246-4898-99e4-ba19c4b5c771" containerID="378099fd9e8c61ea2bf68062d7e15d832d843d4e484225c8ceefaf675c06e18c" exitCode=0 Jul 17 18:50:55.175822 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:55.175407 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd" event={"ID":"16ac1740-6246-4898-99e4-ba19c4b5c771","Type":"ContainerDied","Data":"378099fd9e8c61ea2bf68062d7e15d832d843d4e484225c8ceefaf675c06e18c"} Jul 17 18:50:56.309816 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:56.309790 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd" Jul 17 18:50:56.436973 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:56.436876 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16ac1740-6246-4898-99e4-ba19c4b5c771-util\") pod \"16ac1740-6246-4898-99e4-ba19c4b5c771\" (UID: \"16ac1740-6246-4898-99e4-ba19c4b5c771\") " Jul 17 18:50:56.436973 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:56.436942 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16ac1740-6246-4898-99e4-ba19c4b5c771-bundle\") pod \"16ac1740-6246-4898-99e4-ba19c4b5c771\" (UID: \"16ac1740-6246-4898-99e4-ba19c4b5c771\") " Jul 17 18:50:56.437175 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:56.437051 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x74cn\" (UniqueName: \"kubernetes.io/projected/16ac1740-6246-4898-99e4-ba19c4b5c771-kube-api-access-x74cn\") pod \"16ac1740-6246-4898-99e4-ba19c4b5c771\" (UID: \"16ac1740-6246-4898-99e4-ba19c4b5c771\") " Jul 17 18:50:56.437688 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:56.437651 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16ac1740-6246-4898-99e4-ba19c4b5c771-bundle" (OuterVolumeSpecName: "bundle") pod "16ac1740-6246-4898-99e4-ba19c4b5c771" (UID: "16ac1740-6246-4898-99e4-ba19c4b5c771"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:50:56.439193 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:56.439169 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16ac1740-6246-4898-99e4-ba19c4b5c771-kube-api-access-x74cn" (OuterVolumeSpecName: "kube-api-access-x74cn") pod "16ac1740-6246-4898-99e4-ba19c4b5c771" (UID: "16ac1740-6246-4898-99e4-ba19c4b5c771"). InnerVolumeSpecName "kube-api-access-x74cn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:50:56.445638 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:56.445595 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16ac1740-6246-4898-99e4-ba19c4b5c771-util" (OuterVolumeSpecName: "util") pod "16ac1740-6246-4898-99e4-ba19c4b5c771" (UID: "16ac1740-6246-4898-99e4-ba19c4b5c771"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:50:56.538066 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:56.538031 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x74cn\" (UniqueName: \"kubernetes.io/projected/16ac1740-6246-4898-99e4-ba19c4b5c771-kube-api-access-x74cn\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:50:56.538066 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:56.538058 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16ac1740-6246-4898-99e4-ba19c4b5c771-util\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:50:56.538066 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:56.538069 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16ac1740-6246-4898-99e4-ba19c4b5c771-bundle\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:50:57.186636 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:57.186597 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd" event={"ID":"16ac1740-6246-4898-99e4-ba19c4b5c771","Type":"ContainerDied","Data":"3901507df5aaf0909a3281a6f8ea5ba0761719c154156b5c9d2365ca3df042db"} Jul 17 18:50:57.186636 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:57.186618 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrsgnd" Jul 17 18:50:57.186636 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:50:57.186644 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3901507df5aaf0909a3281a6f8ea5ba0761719c154156b5c9d2365ca3df042db" Jul 17 18:51:06.591791 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:06.591742 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:06.701660 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:06.701619 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:07.631415 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:07.631381 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:07.804504 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:07.804470 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:08.416572 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:08.416540 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:08.844326 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:08.844280 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68969b7c46-4rq7x"] Jul 17 18:51:08.844713 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:08.844615 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16ac1740-6246-4898-99e4-ba19c4b5c771" containerName="pull" Jul 17 18:51:08.844713 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:08.844625 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="16ac1740-6246-4898-99e4-ba19c4b5c771" containerName="pull" Jul 17 18:51:08.844713 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:08.844642 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16ac1740-6246-4898-99e4-ba19c4b5c771" containerName="util" Jul 17 18:51:08.844713 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:08.844648 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="16ac1740-6246-4898-99e4-ba19c4b5c771" containerName="util" Jul 17 18:51:08.844713 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:08.844663 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16ac1740-6246-4898-99e4-ba19c4b5c771" containerName="extract" Jul 17 18:51:08.844713 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:08.844669 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="16ac1740-6246-4898-99e4-ba19c4b5c771" containerName="extract" Jul 17 18:51:08.844930 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:08.844720 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="16ac1740-6246-4898-99e4-ba19c4b5c771" containerName="extract" Jul 17 18:51:08.847690 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:08.847663 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-4rq7x" Jul 17 18:51:08.851251 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:08.851229 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 17 18:51:08.851404 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:08.851261 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mb6px\"" Jul 17 18:51:08.851756 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:08.851740 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 17 18:51:08.852415 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:08.852400 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 17 18:51:08.853606 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:08.853593 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 17 18:51:08.864176 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:08.864146 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:08.872549 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:08.872522 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68969b7c46-4rq7x"] Jul 17 18:51:08.947146 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:08.947110 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/12de2f06-576d-4a05-aaea-08ad563c385a-webhook-cert\") pod \"opendatahub-operator-controller-manager-68969b7c46-4rq7x\" (UID: \"12de2f06-576d-4a05-aaea-08ad563c385a\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-4rq7x" Jul 17 18:51:08.947364 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:08.947163 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/12de2f06-576d-4a05-aaea-08ad563c385a-manifests\") pod \"opendatahub-operator-controller-manager-68969b7c46-4rq7x\" (UID: \"12de2f06-576d-4a05-aaea-08ad563c385a\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-4rq7x" Jul 17 18:51:08.947364 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:08.947184 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/12de2f06-576d-4a05-aaea-08ad563c385a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68969b7c46-4rq7x\" (UID: \"12de2f06-576d-4a05-aaea-08ad563c385a\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-4rq7x" Jul 17 18:51:08.947364 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:08.947201 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8k6k\" (UniqueName: \"kubernetes.io/projected/12de2f06-576d-4a05-aaea-08ad563c385a-kube-api-access-q8k6k\") pod \"opendatahub-operator-controller-manager-68969b7c46-4rq7x\" (UID: \"12de2f06-576d-4a05-aaea-08ad563c385a\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-4rq7x" Jul 17 18:51:08.947364 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:08.947248 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12de2f06-576d-4a05-aaea-08ad563c385a-tmp\") pod \"opendatahub-operator-controller-manager-68969b7c46-4rq7x\" (UID: \"12de2f06-576d-4a05-aaea-08ad563c385a\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-4rq7x" Jul 17 18:51:08.957857 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:08.957827 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:09.048435 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:09.048403 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/12de2f06-576d-4a05-aaea-08ad563c385a-webhook-cert\") pod \"opendatahub-operator-controller-manager-68969b7c46-4rq7x\" (UID: \"12de2f06-576d-4a05-aaea-08ad563c385a\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-4rq7x" Jul 17 18:51:09.048602 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:09.048480 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/12de2f06-576d-4a05-aaea-08ad563c385a-manifests\") pod \"opendatahub-operator-controller-manager-68969b7c46-4rq7x\" (UID: \"12de2f06-576d-4a05-aaea-08ad563c385a\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-4rq7x" Jul 17 18:51:09.048602 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:09.048501 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/12de2f06-576d-4a05-aaea-08ad563c385a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68969b7c46-4rq7x\" (UID: \"12de2f06-576d-4a05-aaea-08ad563c385a\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-4rq7x" Jul 17 18:51:09.048602 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:09.048517 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8k6k\" (UniqueName: \"kubernetes.io/projected/12de2f06-576d-4a05-aaea-08ad563c385a-kube-api-access-q8k6k\") pod \"opendatahub-operator-controller-manager-68969b7c46-4rq7x\" (UID: \"12de2f06-576d-4a05-aaea-08ad563c385a\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-4rq7x" Jul 17 18:51:09.048602 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:09.048547 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12de2f06-576d-4a05-aaea-08ad563c385a-tmp\") pod \"opendatahub-operator-controller-manager-68969b7c46-4rq7x\" (UID: \"12de2f06-576d-4a05-aaea-08ad563c385a\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-4rq7x" Jul 17 18:51:09.048953 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:09.048917 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/12de2f06-576d-4a05-aaea-08ad563c385a-manifests\") pod \"opendatahub-operator-controller-manager-68969b7c46-4rq7x\" (UID: \"12de2f06-576d-4a05-aaea-08ad563c385a\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-4rq7x" Jul 17 18:51:09.050984 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:09.050959 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12de2f06-576d-4a05-aaea-08ad563c385a-tmp\") pod \"opendatahub-operator-controller-manager-68969b7c46-4rq7x\" (UID: \"12de2f06-576d-4a05-aaea-08ad563c385a\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-4rq7x" Jul 17 18:51:09.051080 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:09.051050 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/12de2f06-576d-4a05-aaea-08ad563c385a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68969b7c46-4rq7x\" (UID: \"12de2f06-576d-4a05-aaea-08ad563c385a\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-4rq7x" Jul 17 18:51:09.051145 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:09.051130 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/12de2f06-576d-4a05-aaea-08ad563c385a-webhook-cert\") pod \"opendatahub-operator-controller-manager-68969b7c46-4rq7x\" (UID: \"12de2f06-576d-4a05-aaea-08ad563c385a\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-4rq7x" Jul 17 18:51:09.062940 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:09.062916 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:09.064514 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:09.064493 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8k6k\" (UniqueName: \"kubernetes.io/projected/12de2f06-576d-4a05-aaea-08ad563c385a-kube-api-access-q8k6k\") pod \"opendatahub-operator-controller-manager-68969b7c46-4rq7x\" (UID: \"12de2f06-576d-4a05-aaea-08ad563c385a\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-4rq7x" Jul 17 18:51:09.157741 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:09.157647 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-4rq7x" Jul 17 18:51:09.167738 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:09.167704 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:09.264287 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:09.264238 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:09.315231 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:09.315205 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68969b7c46-4rq7x"] Jul 17 18:51:09.317417 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:51:09.317390 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12de2f06_576d_4a05_aaea_08ad563c385a.slice/crio-4a99089663cb408ee79098b429c32b5027635ec43cd5927ac6a8014d4ce34dbb WatchSource:0}: Error finding container 4a99089663cb408ee79098b429c32b5027635ec43cd5927ac6a8014d4ce34dbb: Status 404 returned error can't find the container with id 4a99089663cb408ee79098b429c32b5027635ec43cd5927ac6a8014d4ce34dbb Jul 17 18:51:09.361179 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:09.361146 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:09.521628 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:09.521550 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:10.254035 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:10.253993 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-4rq7x" event={"ID":"12de2f06-576d-4a05-aaea-08ad563c385a","Type":"ContainerStarted","Data":"4a99089663cb408ee79098b429c32b5027635ec43cd5927ac6a8014d4ce34dbb"} Jul 17 18:51:13.270824 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:13.270792 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-4rq7x" event={"ID":"12de2f06-576d-4a05-aaea-08ad563c385a","Type":"ContainerStarted","Data":"ddc32b1ee89ad7fd6c64ea280fdfb015024d71b0ef2e582525cd35348e888da3"} Jul 17 18:51:14.277904 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:14.277872 2559 generic.go:356] "Generic (PLEG): container finished" podID="12de2f06-576d-4a05-aaea-08ad563c385a" containerID="ddc32b1ee89ad7fd6c64ea280fdfb015024d71b0ef2e582525cd35348e888da3" exitCode=0 Jul 17 18:51:14.278378 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:14.277955 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-4rq7x" event={"ID":"12de2f06-576d-4a05-aaea-08ad563c385a","Type":"ContainerDied","Data":"ddc32b1ee89ad7fd6c64ea280fdfb015024d71b0ef2e582525cd35348e888da3"} Jul 17 18:51:15.285253 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:15.285215 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-4rq7x" event={"ID":"12de2f06-576d-4a05-aaea-08ad563c385a","Type":"ContainerStarted","Data":"248b1906b76f52fc153ae7582949f027344dcc3081db536247513aec2c0b1ea7"} Jul 17 18:51:15.285770 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:15.285338 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-4rq7x" Jul 17 18:51:15.315918 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:15.315863 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-4rq7x" podStartSLOduration=2.977521001 podStartE2EDuration="7.315845968s" totalImagesPullingTime="3.288710779s" totalInitContainerRuntime="1.049614188s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:51:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:51:15.313289594 +0000 UTC m=+384.344902468" watchObservedRunningTime="2026-07-17 18:51:15.315845968 +0000 UTC m=+384.347458840" Jul 17 18:51:20.553777 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:20.553737 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:20.714630 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:20.714599 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:20.813860 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:20.813636 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:21.088227 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:21.088202 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:21.300029 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:21.299975 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:26.292398 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:26.292362 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-4rq7x" Jul 17 18:51:26.631221 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:26.631187 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:26.730764 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:26.730727 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:28.403505 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:28.403471 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:28.596802 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:28.596764 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:29.001074 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:29.001044 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:29.109560 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:29.109525 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-58f857f879-2z9jp"] Jul 17 18:51:29.118210 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:29.118187 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-58f857f879-2z9jp" Jul 17 18:51:29.120830 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:29.120809 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 17 18:51:29.121036 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:29.121020 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 17 18:51:29.121136 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:29.121114 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 17 18:51:29.121402 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:29.121387 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-cgkdm\"" Jul 17 18:51:29.126385 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:29.126369 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 17 18:51:29.142581 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:29.142550 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-58f857f879-2z9jp"] Jul 17 18:51:29.224057 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:29.224022 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/818c7209-3066-43d4-ac2d-6d401754d07c-tls-certs\") pod \"kube-auth-proxy-58f857f879-2z9jp\" (UID: \"818c7209-3066-43d4-ac2d-6d401754d07c\") " pod="openshift-ingress/kube-auth-proxy-58f857f879-2z9jp" Jul 17 18:51:29.224226 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:29.224097 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/818c7209-3066-43d4-ac2d-6d401754d07c-tmp\") pod \"kube-auth-proxy-58f857f879-2z9jp\" (UID: \"818c7209-3066-43d4-ac2d-6d401754d07c\") " pod="openshift-ingress/kube-auth-proxy-58f857f879-2z9jp" Jul 17 18:51:29.224226 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:29.224119 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxnh4\" (UniqueName: \"kubernetes.io/projected/818c7209-3066-43d4-ac2d-6d401754d07c-kube-api-access-dxnh4\") pod \"kube-auth-proxy-58f857f879-2z9jp\" (UID: \"818c7209-3066-43d4-ac2d-6d401754d07c\") " pod="openshift-ingress/kube-auth-proxy-58f857f879-2z9jp" Jul 17 18:51:29.325290 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:29.325196 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/818c7209-3066-43d4-ac2d-6d401754d07c-tmp\") pod \"kube-auth-proxy-58f857f879-2z9jp\" (UID: \"818c7209-3066-43d4-ac2d-6d401754d07c\") " pod="openshift-ingress/kube-auth-proxy-58f857f879-2z9jp" Jul 17 18:51:29.325290 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:29.325243 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxnh4\" (UniqueName: \"kubernetes.io/projected/818c7209-3066-43d4-ac2d-6d401754d07c-kube-api-access-dxnh4\") pod \"kube-auth-proxy-58f857f879-2z9jp\" (UID: \"818c7209-3066-43d4-ac2d-6d401754d07c\") " pod="openshift-ingress/kube-auth-proxy-58f857f879-2z9jp" Jul 17 18:51:29.325290 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:29.325292 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/818c7209-3066-43d4-ac2d-6d401754d07c-tls-certs\") pod \"kube-auth-proxy-58f857f879-2z9jp\" (UID: \"818c7209-3066-43d4-ac2d-6d401754d07c\") " pod="openshift-ingress/kube-auth-proxy-58f857f879-2z9jp" Jul 17 18:51:29.325524 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:51:29.325464 2559 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 17 18:51:29.325565 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:51:29.325527 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/818c7209-3066-43d4-ac2d-6d401754d07c-tls-certs podName:818c7209-3066-43d4-ac2d-6d401754d07c nodeName:}" failed. No retries permitted until 2026-07-17 18:51:29.825507682 +0000 UTC m=+398.857120534 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/818c7209-3066-43d4-ac2d-6d401754d07c-tls-certs") pod "kube-auth-proxy-58f857f879-2z9jp" (UID: "818c7209-3066-43d4-ac2d-6d401754d07c") : secret "kube-auth-proxy-tls" not found Jul 17 18:51:29.327645 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:29.327623 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/818c7209-3066-43d4-ac2d-6d401754d07c-tmp\") pod \"kube-auth-proxy-58f857f879-2z9jp\" (UID: \"818c7209-3066-43d4-ac2d-6d401754d07c\") " pod="openshift-ingress/kube-auth-proxy-58f857f879-2z9jp" Jul 17 18:51:29.341843 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:29.341813 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxnh4\" (UniqueName: \"kubernetes.io/projected/818c7209-3066-43d4-ac2d-6d401754d07c-kube-api-access-dxnh4\") pod \"kube-auth-proxy-58f857f879-2z9jp\" (UID: \"818c7209-3066-43d4-ac2d-6d401754d07c\") " pod="openshift-ingress/kube-auth-proxy-58f857f879-2z9jp" Jul 17 18:51:29.363590 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:29.363554 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:29.554922 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:29.554891 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:29.778593 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:29.778562 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:29.829785 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:29.829756 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/818c7209-3066-43d4-ac2d-6d401754d07c-tls-certs\") pod \"kube-auth-proxy-58f857f879-2z9jp\" (UID: \"818c7209-3066-43d4-ac2d-6d401754d07c\") " pod="openshift-ingress/kube-auth-proxy-58f857f879-2z9jp" Jul 17 18:51:29.832213 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:29.832192 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/818c7209-3066-43d4-ac2d-6d401754d07c-tls-certs\") pod \"kube-auth-proxy-58f857f879-2z9jp\" (UID: \"818c7209-3066-43d4-ac2d-6d401754d07c\") " pod="openshift-ingress/kube-auth-proxy-58f857f879-2z9jp" Jul 17 18:51:30.028266 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:30.028235 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-58f857f879-2z9jp" Jul 17 18:51:30.058990 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:30.058958 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:30.199623 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:30.199597 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-58f857f879-2z9jp"] Jul 17 18:51:30.200705 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:51:30.200682 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod818c7209_3066_43d4_ac2d_6d401754d07c.slice/crio-c4a60399d1c6e1537f551d0a7a333e3b5a5a25d032ec6886b4ca2ce788f0ed11 WatchSource:0}: Error finding container c4a60399d1c6e1537f551d0a7a333e3b5a5a25d032ec6886b4ca2ce788f0ed11: Status 404 returned error can't find the container with id c4a60399d1c6e1537f551d0a7a333e3b5a5a25d032ec6886b4ca2ce788f0ed11 Jul 17 18:51:30.360028 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:30.359960 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-58f857f879-2z9jp" event={"ID":"818c7209-3066-43d4-ac2d-6d401754d07c","Type":"ContainerStarted","Data":"c4a60399d1c6e1537f551d0a7a333e3b5a5a25d032ec6886b4ca2ce788f0ed11"} Jul 17 18:51:30.904877 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:30.904846 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:31.061336 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:31.061287 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:31.408524 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:31.408481 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:31.518759 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:31.518721 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:33.134364 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:33.134330 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:33.379487 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:33.379455 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-58f857f879-2z9jp" event={"ID":"818c7209-3066-43d4-ac2d-6d401754d07c","Type":"ContainerStarted","Data":"34e8a9c91e59ca8658b07b66dce3e4645d25df8a011db71e8a5758b62f8a50b5"} Jul 17 18:51:33.402284 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:33.402231 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-58f857f879-2z9jp" podStartSLOduration=1.585535307 podStartE2EDuration="4.40221538s" totalImagesPullingTime="2.816680073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:51:33.400694195 +0000 UTC m=+402.432307069" watchObservedRunningTime="2026-07-17 18:51:33.40221538 +0000 UTC m=+402.433828253" Jul 17 18:51:36.815867 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:36.815834 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:36.947543 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:36.947512 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:37.254649 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:37.254615 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-76fdf749bb-6q72k"] Jul 17 18:51:37.257999 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:37.257982 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76fdf749bb-6q72k" Jul 17 18:51:37.262142 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:37.262120 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 17 18:51:37.262286 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:37.262141 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 17 18:51:37.262286 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:37.262175 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-cw8fk\"" Jul 17 18:51:37.263111 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:37.263095 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 17 18:51:37.273298 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:37.273275 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76fdf749bb-6q72k"] Jul 17 18:51:37.394232 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:37.394203 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/93ef279c-435d-42e3-8c91-5c6240eac1dd-manager-config\") pod \"lws-controller-manager-76fdf749bb-6q72k\" (UID: \"93ef279c-435d-42e3-8c91-5c6240eac1dd\") " pod="openshift-lws-operator/lws-controller-manager-76fdf749bb-6q72k" Jul 17 18:51:37.394464 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:37.394254 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/93ef279c-435d-42e3-8c91-5c6240eac1dd-metrics-cert\") pod \"lws-controller-manager-76fdf749bb-6q72k\" (UID: \"93ef279c-435d-42e3-8c91-5c6240eac1dd\") " pod="openshift-lws-operator/lws-controller-manager-76fdf749bb-6q72k" Jul 17 18:51:37.394464 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:37.394283 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m65n9\" (UniqueName: \"kubernetes.io/projected/93ef279c-435d-42e3-8c91-5c6240eac1dd-kube-api-access-m65n9\") pod \"lws-controller-manager-76fdf749bb-6q72k\" (UID: \"93ef279c-435d-42e3-8c91-5c6240eac1dd\") " pod="openshift-lws-operator/lws-controller-manager-76fdf749bb-6q72k" Jul 17 18:51:37.394464 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:37.394374 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93ef279c-435d-42e3-8c91-5c6240eac1dd-cert\") pod \"lws-controller-manager-76fdf749bb-6q72k\" (UID: \"93ef279c-435d-42e3-8c91-5c6240eac1dd\") " pod="openshift-lws-operator/lws-controller-manager-76fdf749bb-6q72k" Jul 17 18:51:37.495278 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:37.495237 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/93ef279c-435d-42e3-8c91-5c6240eac1dd-manager-config\") pod \"lws-controller-manager-76fdf749bb-6q72k\" (UID: \"93ef279c-435d-42e3-8c91-5c6240eac1dd\") " pod="openshift-lws-operator/lws-controller-manager-76fdf749bb-6q72k" Jul 17 18:51:37.495479 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:37.495299 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/93ef279c-435d-42e3-8c91-5c6240eac1dd-metrics-cert\") pod \"lws-controller-manager-76fdf749bb-6q72k\" (UID: \"93ef279c-435d-42e3-8c91-5c6240eac1dd\") " pod="openshift-lws-operator/lws-controller-manager-76fdf749bb-6q72k" Jul 17 18:51:37.495479 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:37.495343 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m65n9\" (UniqueName: \"kubernetes.io/projected/93ef279c-435d-42e3-8c91-5c6240eac1dd-kube-api-access-m65n9\") pod \"lws-controller-manager-76fdf749bb-6q72k\" (UID: \"93ef279c-435d-42e3-8c91-5c6240eac1dd\") " pod="openshift-lws-operator/lws-controller-manager-76fdf749bb-6q72k" Jul 17 18:51:37.495479 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:37.495364 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93ef279c-435d-42e3-8c91-5c6240eac1dd-cert\") pod \"lws-controller-manager-76fdf749bb-6q72k\" (UID: \"93ef279c-435d-42e3-8c91-5c6240eac1dd\") " pod="openshift-lws-operator/lws-controller-manager-76fdf749bb-6q72k" Jul 17 18:51:37.495949 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:37.495925 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/93ef279c-435d-42e3-8c91-5c6240eac1dd-manager-config\") pod \"lws-controller-manager-76fdf749bb-6q72k\" (UID: \"93ef279c-435d-42e3-8c91-5c6240eac1dd\") " pod="openshift-lws-operator/lws-controller-manager-76fdf749bb-6q72k" Jul 17 18:51:37.498048 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:37.498019 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/93ef279c-435d-42e3-8c91-5c6240eac1dd-metrics-cert\") pod \"lws-controller-manager-76fdf749bb-6q72k\" (UID: \"93ef279c-435d-42e3-8c91-5c6240eac1dd\") " pod="openshift-lws-operator/lws-controller-manager-76fdf749bb-6q72k" Jul 17 18:51:37.498195 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:37.498125 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93ef279c-435d-42e3-8c91-5c6240eac1dd-cert\") pod \"lws-controller-manager-76fdf749bb-6q72k\" (UID: \"93ef279c-435d-42e3-8c91-5c6240eac1dd\") " pod="openshift-lws-operator/lws-controller-manager-76fdf749bb-6q72k" Jul 17 18:51:37.536629 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:37.536550 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m65n9\" (UniqueName: \"kubernetes.io/projected/93ef279c-435d-42e3-8c91-5c6240eac1dd-kube-api-access-m65n9\") pod \"lws-controller-manager-76fdf749bb-6q72k\" (UID: \"93ef279c-435d-42e3-8c91-5c6240eac1dd\") " pod="openshift-lws-operator/lws-controller-manager-76fdf749bb-6q72k" Jul 17 18:51:37.567243 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:37.567207 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76fdf749bb-6q72k" Jul 17 18:51:37.736170 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:37.736139 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76fdf749bb-6q72k"] Jul 17 18:51:37.737112 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:51:37.737088 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93ef279c_435d_42e3_8c91_5c6240eac1dd.slice/crio-1e8714f7810ae76888b262644b37e9dbed957e084df105f8151a011e02b84c0b WatchSource:0}: Error finding container 1e8714f7810ae76888b262644b37e9dbed957e084df105f8151a011e02b84c0b: Status 404 returned error can't find the container with id 1e8714f7810ae76888b262644b37e9dbed957e084df105f8151a011e02b84c0b Jul 17 18:51:38.139645 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:38.139610 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:38.405642 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:38.405553 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76fdf749bb-6q72k" event={"ID":"93ef279c-435d-42e3-8c91-5c6240eac1dd","Type":"ContainerStarted","Data":"1e8714f7810ae76888b262644b37e9dbed957e084df105f8151a011e02b84c0b"} Jul 17 18:51:38.556281 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:38.556250 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:38.811846 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:38.811756 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:39.413631 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:39.413599 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76fdf749bb-6q72k" event={"ID":"93ef279c-435d-42e3-8c91-5c6240eac1dd","Type":"ContainerStarted","Data":"c5f64403e54a071d31682d7899a687dc6fec1aebac87ea7c4098085a6104aee9"} Jul 17 18:51:39.414074 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:39.413721 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-76fdf749bb-6q72k" Jul 17 18:51:39.448484 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:39.448437 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-76fdf749bb-6q72k" podStartSLOduration=1.223519091 podStartE2EDuration="2.448421737s" totalImagesPullingTime="1.224902646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:51:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:51:39.44729755 +0000 UTC m=+408.478910424" watchObservedRunningTime="2026-07-17 18:51:39.448421737 +0000 UTC m=+408.480034610" Jul 17 18:51:41.646844 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:41.646808 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:41.815242 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:41.815212 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:42.012437 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:42.012337 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:42.446819 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:42.446787 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:42.999905 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:42.999864 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:43.110898 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:43.110858 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:43.258714 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:43.258629 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:50.420514 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:50.420476 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-76fdf749bb-6q72k" Jul 17 18:51:55.692499 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:55.692465 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:55.791696 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:55.791658 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:57.606597 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:57.606559 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:57.687578 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:51:57.687545 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:52:11.925972 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:11.925882 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:52:11.982625 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:11.982592 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:52:29.845005 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:29.844942 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:52:29.938639 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:29.938607 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:52:30.051426 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:30.051391 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:52:42.133984 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:42.133950 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:52:44.976240 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:44.976206 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g"] Jul 17 18:52:44.978820 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:44.978804 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g" Jul 17 18:52:44.982285 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:44.982258 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 17 18:52:44.982423 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:44.982337 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 17 18:52:44.982423 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:44.982346 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6k9sw\"" Jul 17 18:52:44.985943 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:44.985924 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkt4r\" (UniqueName: \"kubernetes.io/projected/26f47351-05c6-4b42-a109-d8f09aa1e62a-kube-api-access-mkt4r\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g\" (UID: \"26f47351-05c6-4b42-a109-d8f09aa1e62a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g" Jul 17 18:52:44.986021 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:44.985973 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26f47351-05c6-4b42-a109-d8f09aa1e62a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g\" (UID: \"26f47351-05c6-4b42-a109-d8f09aa1e62a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g" Jul 17 18:52:44.986021 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:44.986009 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26f47351-05c6-4b42-a109-d8f09aa1e62a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g\" (UID: \"26f47351-05c6-4b42-a109-d8f09aa1e62a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g" Jul 17 18:52:44.993331 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:44.990062 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g"] Jul 17 18:52:45.086488 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.086453 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkt4r\" (UniqueName: \"kubernetes.io/projected/26f47351-05c6-4b42-a109-d8f09aa1e62a-kube-api-access-mkt4r\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g\" (UID: \"26f47351-05c6-4b42-a109-d8f09aa1e62a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g" Jul 17 18:52:45.086675 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.086500 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26f47351-05c6-4b42-a109-d8f09aa1e62a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g\" (UID: \"26f47351-05c6-4b42-a109-d8f09aa1e62a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g" Jul 17 18:52:45.086675 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.086649 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26f47351-05c6-4b42-a109-d8f09aa1e62a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g\" (UID: \"26f47351-05c6-4b42-a109-d8f09aa1e62a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g" Jul 17 18:52:45.086805 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.086790 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26f47351-05c6-4b42-a109-d8f09aa1e62a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g\" (UID: \"26f47351-05c6-4b42-a109-d8f09aa1e62a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g" Jul 17 18:52:45.086977 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.086961 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26f47351-05c6-4b42-a109-d8f09aa1e62a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g\" (UID: \"26f47351-05c6-4b42-a109-d8f09aa1e62a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g" Jul 17 18:52:45.102195 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.102162 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkt4r\" (UniqueName: \"kubernetes.io/projected/26f47351-05c6-4b42-a109-d8f09aa1e62a-kube-api-access-mkt4r\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g\" (UID: \"26f47351-05c6-4b42-a109-d8f09aa1e62a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g" Jul 17 18:52:45.287738 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.287648 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g" Jul 17 18:52:45.376365 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.376300 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds"] Jul 17 18:52:45.389806 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.389478 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds" Jul 17 18:52:45.391279 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.391249 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds"] Jul 17 18:52:45.432353 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.432300 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g"] Jul 17 18:52:45.434847 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:52:45.434817 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26f47351_05c6_4b42_a109_d8f09aa1e62a.slice/crio-50e975943b1e0748c1c2d032c7254d2bbe5b3be435a9102fe20a504c2fb5126b WatchSource:0}: Error finding container 50e975943b1e0748c1c2d032c7254d2bbe5b3be435a9102fe20a504c2fb5126b: Status 404 returned error can't find the container with id 50e975943b1e0748c1c2d032c7254d2bbe5b3be435a9102fe20a504c2fb5126b Jul 17 18:52:45.488798 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.488771 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9965128e-d2f7-407d-b8b6-a4da7f05e847-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds\" (UID: \"9965128e-d2f7-407d-b8b6-a4da7f05e847\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds" Jul 17 18:52:45.488950 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.488810 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgbb8\" (UniqueName: \"kubernetes.io/projected/9965128e-d2f7-407d-b8b6-a4da7f05e847-kube-api-access-pgbb8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds\" (UID: \"9965128e-d2f7-407d-b8b6-a4da7f05e847\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds" Jul 17 18:52:45.488950 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.488937 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9965128e-d2f7-407d-b8b6-a4da7f05e847-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds\" (UID: \"9965128e-d2f7-407d-b8b6-a4da7f05e847\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds" Jul 17 18:52:45.589858 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.589830 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9965128e-d2f7-407d-b8b6-a4da7f05e847-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds\" (UID: \"9965128e-d2f7-407d-b8b6-a4da7f05e847\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds" Jul 17 18:52:45.589988 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.589872 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9965128e-d2f7-407d-b8b6-a4da7f05e847-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds\" (UID: \"9965128e-d2f7-407d-b8b6-a4da7f05e847\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds" Jul 17 18:52:45.589988 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.589893 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgbb8\" (UniqueName: \"kubernetes.io/projected/9965128e-d2f7-407d-b8b6-a4da7f05e847-kube-api-access-pgbb8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds\" (UID: \"9965128e-d2f7-407d-b8b6-a4da7f05e847\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds" Jul 17 18:52:45.590273 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.590249 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9965128e-d2f7-407d-b8b6-a4da7f05e847-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds\" (UID: \"9965128e-d2f7-407d-b8b6-a4da7f05e847\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds" Jul 17 18:52:45.590340 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.590260 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9965128e-d2f7-407d-b8b6-a4da7f05e847-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds\" (UID: \"9965128e-d2f7-407d-b8b6-a4da7f05e847\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds" Jul 17 18:52:45.598910 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.598884 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgbb8\" (UniqueName: \"kubernetes.io/projected/9965128e-d2f7-407d-b8b6-a4da7f05e847-kube-api-access-pgbb8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds\" (UID: \"9965128e-d2f7-407d-b8b6-a4da7f05e847\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds" Jul 17 18:52:45.702247 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.702215 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds" Jul 17 18:52:45.732575 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.732542 2559 generic.go:356] "Generic (PLEG): container finished" podID="26f47351-05c6-4b42-a109-d8f09aa1e62a" containerID="03a846f32ed1c8636ed44402726c5805ab0e31e6be1687745dcf25e3dcc76b12" exitCode=0 Jul 17 18:52:45.732851 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.732625 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g" event={"ID":"26f47351-05c6-4b42-a109-d8f09aa1e62a","Type":"ContainerDied","Data":"03a846f32ed1c8636ed44402726c5805ab0e31e6be1687745dcf25e3dcc76b12"} Jul 17 18:52:45.732851 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.732679 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g" event={"ID":"26f47351-05c6-4b42-a109-d8f09aa1e62a","Type":"ContainerStarted","Data":"50e975943b1e0748c1c2d032c7254d2bbe5b3be435a9102fe20a504c2fb5126b"} Jul 17 18:52:45.784101 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.784077 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr"] Jul 17 18:52:45.787736 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.787687 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr" Jul 17 18:52:45.800091 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.800066 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr"] Jul 17 18:52:45.837896 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.837875 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds"] Jul 17 18:52:45.839932 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:52:45.839907 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9965128e_d2f7_407d_b8b6_a4da7f05e847.slice/crio-9794e11aa10024120220b85f65cdbc70b28f4d7a38af1728b56581660bdfdb2b WatchSource:0}: Error finding container 9794e11aa10024120220b85f65cdbc70b28f4d7a38af1728b56581660bdfdb2b: Status 404 returned error can't find the container with id 9794e11aa10024120220b85f65cdbc70b28f4d7a38af1728b56581660bdfdb2b Jul 17 18:52:45.891512 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.891493 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b375b40-62a3-4690-8952-46158b78cb18-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr\" (UID: \"8b375b40-62a3-4690-8952-46158b78cb18\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr" Jul 17 18:52:45.891606 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.891534 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b375b40-62a3-4690-8952-46158b78cb18-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr\" (UID: \"8b375b40-62a3-4690-8952-46158b78cb18\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr" Jul 17 18:52:45.891606 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.891573 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4fjn\" (UniqueName: \"kubernetes.io/projected/8b375b40-62a3-4690-8952-46158b78cb18-kube-api-access-n4fjn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr\" (UID: \"8b375b40-62a3-4690-8952-46158b78cb18\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr" Jul 17 18:52:45.992801 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.992768 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b375b40-62a3-4690-8952-46158b78cb18-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr\" (UID: \"8b375b40-62a3-4690-8952-46158b78cb18\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr" Jul 17 18:52:45.993123 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.992821 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b375b40-62a3-4690-8952-46158b78cb18-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr\" (UID: \"8b375b40-62a3-4690-8952-46158b78cb18\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr" Jul 17 18:52:45.993123 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.992881 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4fjn\" (UniqueName: \"kubernetes.io/projected/8b375b40-62a3-4690-8952-46158b78cb18-kube-api-access-n4fjn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr\" (UID: \"8b375b40-62a3-4690-8952-46158b78cb18\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr" Jul 17 18:52:45.993199 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.993183 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b375b40-62a3-4690-8952-46158b78cb18-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr\" (UID: \"8b375b40-62a3-4690-8952-46158b78cb18\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr" Jul 17 18:52:45.993234 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:45.993173 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b375b40-62a3-4690-8952-46158b78cb18-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr\" (UID: \"8b375b40-62a3-4690-8952-46158b78cb18\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr" Jul 17 18:52:46.003020 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:46.002990 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4fjn\" (UniqueName: \"kubernetes.io/projected/8b375b40-62a3-4690-8952-46158b78cb18-kube-api-access-n4fjn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr\" (UID: \"8b375b40-62a3-4690-8952-46158b78cb18\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr" Jul 17 18:52:46.099792 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:46.099762 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr" Jul 17 18:52:46.187054 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:46.187023 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56"] Jul 17 18:52:46.190702 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:46.190621 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56" Jul 17 18:52:46.194353 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:46.194328 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7dc9672-f1c3-4c40-b1de-87ce09e14aa1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56\" (UID: \"b7dc9672-f1c3-4c40-b1de-87ce09e14aa1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56" Jul 17 18:52:46.194468 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:46.194387 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7dc9672-f1c3-4c40-b1de-87ce09e14aa1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56\" (UID: \"b7dc9672-f1c3-4c40-b1de-87ce09e14aa1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56" Jul 17 18:52:46.194540 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:46.194516 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqg8d\" (UniqueName: \"kubernetes.io/projected/b7dc9672-f1c3-4c40-b1de-87ce09e14aa1-kube-api-access-gqg8d\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56\" (UID: \"b7dc9672-f1c3-4c40-b1de-87ce09e14aa1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56" Jul 17 18:52:46.204294 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:46.203899 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56"] Jul 17 18:52:46.235989 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:46.235960 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr"] Jul 17 18:52:46.239511 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:52:46.239484 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b375b40_62a3_4690_8952_46158b78cb18.slice/crio-5a7a046662ae46c6155e62ebd0c3769afbd193fae4ee1933b10c2685dc5bd2d3 WatchSource:0}: Error finding container 5a7a046662ae46c6155e62ebd0c3769afbd193fae4ee1933b10c2685dc5bd2d3: Status 404 returned error can't find the container with id 5a7a046662ae46c6155e62ebd0c3769afbd193fae4ee1933b10c2685dc5bd2d3 Jul 17 18:52:46.295295 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:46.295270 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqg8d\" (UniqueName: \"kubernetes.io/projected/b7dc9672-f1c3-4c40-b1de-87ce09e14aa1-kube-api-access-gqg8d\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56\" (UID: \"b7dc9672-f1c3-4c40-b1de-87ce09e14aa1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56" Jul 17 18:52:46.295405 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:46.295327 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7dc9672-f1c3-4c40-b1de-87ce09e14aa1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56\" (UID: \"b7dc9672-f1c3-4c40-b1de-87ce09e14aa1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56" Jul 17 18:52:46.295405 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:46.295366 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7dc9672-f1c3-4c40-b1de-87ce09e14aa1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56\" (UID: \"b7dc9672-f1c3-4c40-b1de-87ce09e14aa1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56" Jul 17 18:52:46.295728 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:46.295704 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7dc9672-f1c3-4c40-b1de-87ce09e14aa1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56\" (UID: \"b7dc9672-f1c3-4c40-b1de-87ce09e14aa1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56" Jul 17 18:52:46.295728 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:46.295716 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7dc9672-f1c3-4c40-b1de-87ce09e14aa1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56\" (UID: \"b7dc9672-f1c3-4c40-b1de-87ce09e14aa1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56" Jul 17 18:52:46.304978 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:46.304956 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqg8d\" (UniqueName: \"kubernetes.io/projected/b7dc9672-f1c3-4c40-b1de-87ce09e14aa1-kube-api-access-gqg8d\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56\" (UID: \"b7dc9672-f1c3-4c40-b1de-87ce09e14aa1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56" Jul 17 18:52:46.505454 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:46.505371 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56" Jul 17 18:52:46.638108 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:46.638081 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56"] Jul 17 18:52:46.683677 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:52:46.683646 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7dc9672_f1c3_4c40_b1de_87ce09e14aa1.slice/crio-ad35df07e7210a76bf449d3ca35086f809b9d9d1929a266c77d392cf14c28721 WatchSource:0}: Error finding container ad35df07e7210a76bf449d3ca35086f809b9d9d1929a266c77d392cf14c28721: Status 404 returned error can't find the container with id ad35df07e7210a76bf449d3ca35086f809b9d9d1929a266c77d392cf14c28721 Jul 17 18:52:46.740951 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:46.740923 2559 generic.go:356] "Generic (PLEG): container finished" podID="8b375b40-62a3-4690-8952-46158b78cb18" containerID="9dae9bc7758fc7fc6be6bdc94d60512f6849588999f28554350ddeb0a3df311d" exitCode=0 Jul 17 18:52:46.741072 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:46.741007 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr" event={"ID":"8b375b40-62a3-4690-8952-46158b78cb18","Type":"ContainerDied","Data":"9dae9bc7758fc7fc6be6bdc94d60512f6849588999f28554350ddeb0a3df311d"} Jul 17 18:52:46.741072 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:46.741059 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr" event={"ID":"8b375b40-62a3-4690-8952-46158b78cb18","Type":"ContainerStarted","Data":"5a7a046662ae46c6155e62ebd0c3769afbd193fae4ee1933b10c2685dc5bd2d3"} Jul 17 18:52:46.742429 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:46.742404 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56" event={"ID":"b7dc9672-f1c3-4c40-b1de-87ce09e14aa1","Type":"ContainerStarted","Data":"ad35df07e7210a76bf449d3ca35086f809b9d9d1929a266c77d392cf14c28721"} Jul 17 18:52:46.744105 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:46.744079 2559 generic.go:356] "Generic (PLEG): container finished" podID="9965128e-d2f7-407d-b8b6-a4da7f05e847" containerID="a7e637dd12950a440f9318c6406e65a04fec0bbd01e1cf14ea831c8a555ee06e" exitCode=0 Jul 17 18:52:46.744211 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:46.744185 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds" event={"ID":"9965128e-d2f7-407d-b8b6-a4da7f05e847","Type":"ContainerDied","Data":"a7e637dd12950a440f9318c6406e65a04fec0bbd01e1cf14ea831c8a555ee06e"} Jul 17 18:52:46.744408 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:46.744230 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds" event={"ID":"9965128e-d2f7-407d-b8b6-a4da7f05e847","Type":"ContainerStarted","Data":"9794e11aa10024120220b85f65cdbc70b28f4d7a38af1728b56581660bdfdb2b"} Jul 17 18:52:47.750626 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:47.750593 2559 generic.go:356] "Generic (PLEG): container finished" podID="26f47351-05c6-4b42-a109-d8f09aa1e62a" containerID="546f26c0c015821b676f6a73c4297f9335bbb57cbb285518e6a23ffac3a192c9" exitCode=0 Jul 17 18:52:47.751008 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:47.750677 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g" event={"ID":"26f47351-05c6-4b42-a109-d8f09aa1e62a","Type":"ContainerDied","Data":"546f26c0c015821b676f6a73c4297f9335bbb57cbb285518e6a23ffac3a192c9"} Jul 17 18:52:47.752547 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:47.752527 2559 generic.go:356] "Generic (PLEG): container finished" podID="8b375b40-62a3-4690-8952-46158b78cb18" containerID="5efc9d7080e1136da4ec210fc6d81f8d377550db8e687a2748c93807627cae4f" exitCode=0 Jul 17 18:52:47.752633 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:47.752612 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr" event={"ID":"8b375b40-62a3-4690-8952-46158b78cb18","Type":"ContainerDied","Data":"5efc9d7080e1136da4ec210fc6d81f8d377550db8e687a2748c93807627cae4f"} Jul 17 18:52:47.754996 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:47.754969 2559 generic.go:356] "Generic (PLEG): container finished" podID="b7dc9672-f1c3-4c40-b1de-87ce09e14aa1" containerID="ca6d4984501f0d15fb43716db268ff8738e8afff4fdf1e8ede4caa8c83fcd5ed" exitCode=0 Jul 17 18:52:47.755279 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:47.755227 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56" event={"ID":"b7dc9672-f1c3-4c40-b1de-87ce09e14aa1","Type":"ContainerDied","Data":"ca6d4984501f0d15fb43716db268ff8738e8afff4fdf1e8ede4caa8c83fcd5ed"} Jul 17 18:52:47.762161 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:47.762137 2559 generic.go:356] "Generic (PLEG): container finished" podID="9965128e-d2f7-407d-b8b6-a4da7f05e847" containerID="007a0154c06a1591c0e07944eaf2abca805a3601cf699a7ae927dff3f1fdd4a6" exitCode=0 Jul 17 18:52:47.762270 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:47.762208 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds" event={"ID":"9965128e-d2f7-407d-b8b6-a4da7f05e847","Type":"ContainerDied","Data":"007a0154c06a1591c0e07944eaf2abca805a3601cf699a7ae927dff3f1fdd4a6"} Jul 17 18:52:48.769022 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:48.768935 2559 generic.go:356] "Generic (PLEG): container finished" podID="26f47351-05c6-4b42-a109-d8f09aa1e62a" containerID="20cc843145e0934cdd19f1d614b8ad99fcc8bbbc5bf1427d17045e45423873dc" exitCode=0 Jul 17 18:52:48.769022 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:48.769008 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g" event={"ID":"26f47351-05c6-4b42-a109-d8f09aa1e62a","Type":"ContainerDied","Data":"20cc843145e0934cdd19f1d614b8ad99fcc8bbbc5bf1427d17045e45423873dc"} Jul 17 18:52:48.771362 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:48.771334 2559 generic.go:356] "Generic (PLEG): container finished" podID="8b375b40-62a3-4690-8952-46158b78cb18" containerID="4b191b68aabf89b810a57f3d1198cf803cd443174c6ecff97a96dd3add27071e" exitCode=0 Jul 17 18:52:48.771468 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:48.771403 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr" event={"ID":"8b375b40-62a3-4690-8952-46158b78cb18","Type":"ContainerDied","Data":"4b191b68aabf89b810a57f3d1198cf803cd443174c6ecff97a96dd3add27071e"} Jul 17 18:52:48.773647 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:48.773625 2559 generic.go:356] "Generic (PLEG): container finished" podID="b7dc9672-f1c3-4c40-b1de-87ce09e14aa1" containerID="f5d60c5e995388808ea6f42fdab5ee80aafae6118eca7b5e649bf158892ff32a" exitCode=0 Jul 17 18:52:48.773770 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:48.773709 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56" event={"ID":"b7dc9672-f1c3-4c40-b1de-87ce09e14aa1","Type":"ContainerDied","Data":"f5d60c5e995388808ea6f42fdab5ee80aafae6118eca7b5e649bf158892ff32a"} Jul 17 18:52:48.775658 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:48.775636 2559 generic.go:356] "Generic (PLEG): container finished" podID="9965128e-d2f7-407d-b8b6-a4da7f05e847" containerID="a0bb175d07497f2844c75c389ea58b4854f8c411921aa694aff11b77ea44b374" exitCode=0 Jul 17 18:52:48.775783 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:48.775711 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds" event={"ID":"9965128e-d2f7-407d-b8b6-a4da7f05e847","Type":"ContainerDied","Data":"a0bb175d07497f2844c75c389ea58b4854f8c411921aa694aff11b77ea44b374"} Jul 17 18:52:48.920332 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:48.920292 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86749c6985-8rrz8"] Jul 17 18:52:48.922621 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:48.922602 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86749c6985-8rrz8" Jul 17 18:52:48.937073 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:48.937046 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86749c6985-8rrz8"] Jul 17 18:52:48.988104 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:48.988077 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:52:49.015279 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.015235 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6461c10-dad4-4d20-aee6-f7a0ed5d10f1-console-serving-cert\") pod \"console-86749c6985-8rrz8\" (UID: \"e6461c10-dad4-4d20-aee6-f7a0ed5d10f1\") " pod="openshift-console/console-86749c6985-8rrz8" Jul 17 18:52:49.015463 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.015368 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kvm2\" (UniqueName: \"kubernetes.io/projected/e6461c10-dad4-4d20-aee6-f7a0ed5d10f1-kube-api-access-2kvm2\") pod \"console-86749c6985-8rrz8\" (UID: \"e6461c10-dad4-4d20-aee6-f7a0ed5d10f1\") " pod="openshift-console/console-86749c6985-8rrz8" Jul 17 18:52:49.015463 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.015424 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6461c10-dad4-4d20-aee6-f7a0ed5d10f1-console-config\") pod \"console-86749c6985-8rrz8\" (UID: \"e6461c10-dad4-4d20-aee6-f7a0ed5d10f1\") " pod="openshift-console/console-86749c6985-8rrz8" Jul 17 18:52:49.015463 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.015445 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6461c10-dad4-4d20-aee6-f7a0ed5d10f1-console-oauth-config\") pod \"console-86749c6985-8rrz8\" (UID: \"e6461c10-dad4-4d20-aee6-f7a0ed5d10f1\") " pod="openshift-console/console-86749c6985-8rrz8" Jul 17 18:52:49.015463 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.015461 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6461c10-dad4-4d20-aee6-f7a0ed5d10f1-trusted-ca-bundle\") pod \"console-86749c6985-8rrz8\" (UID: \"e6461c10-dad4-4d20-aee6-f7a0ed5d10f1\") " pod="openshift-console/console-86749c6985-8rrz8" Jul 17 18:52:49.015604 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.015498 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6461c10-dad4-4d20-aee6-f7a0ed5d10f1-oauth-serving-cert\") pod \"console-86749c6985-8rrz8\" (UID: \"e6461c10-dad4-4d20-aee6-f7a0ed5d10f1\") " pod="openshift-console/console-86749c6985-8rrz8" Jul 17 18:52:49.015604 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.015586 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6461c10-dad4-4d20-aee6-f7a0ed5d10f1-service-ca\") pod \"console-86749c6985-8rrz8\" (UID: \"e6461c10-dad4-4d20-aee6-f7a0ed5d10f1\") " pod="openshift-console/console-86749c6985-8rrz8" Jul 17 18:52:49.047182 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.047103 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:52:49.114684 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.114655 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:52:49.116830 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.116812 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6461c10-dad4-4d20-aee6-f7a0ed5d10f1-trusted-ca-bundle\") pod \"console-86749c6985-8rrz8\" (UID: \"e6461c10-dad4-4d20-aee6-f7a0ed5d10f1\") " pod="openshift-console/console-86749c6985-8rrz8" Jul 17 18:52:49.116885 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.116850 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6461c10-dad4-4d20-aee6-f7a0ed5d10f1-oauth-serving-cert\") pod \"console-86749c6985-8rrz8\" (UID: \"e6461c10-dad4-4d20-aee6-f7a0ed5d10f1\") " pod="openshift-console/console-86749c6985-8rrz8" Jul 17 18:52:49.116924 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.116888 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6461c10-dad4-4d20-aee6-f7a0ed5d10f1-service-ca\") pod \"console-86749c6985-8rrz8\" (UID: \"e6461c10-dad4-4d20-aee6-f7a0ed5d10f1\") " pod="openshift-console/console-86749c6985-8rrz8" Jul 17 18:52:49.116924 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.116912 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6461c10-dad4-4d20-aee6-f7a0ed5d10f1-console-serving-cert\") pod \"console-86749c6985-8rrz8\" (UID: \"e6461c10-dad4-4d20-aee6-f7a0ed5d10f1\") " pod="openshift-console/console-86749c6985-8rrz8" Jul 17 18:52:49.117026 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.116991 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kvm2\" (UniqueName: \"kubernetes.io/projected/e6461c10-dad4-4d20-aee6-f7a0ed5d10f1-kube-api-access-2kvm2\") pod \"console-86749c6985-8rrz8\" (UID: \"e6461c10-dad4-4d20-aee6-f7a0ed5d10f1\") " pod="openshift-console/console-86749c6985-8rrz8" Jul 17 18:52:49.117157 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.117061 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6461c10-dad4-4d20-aee6-f7a0ed5d10f1-console-config\") pod \"console-86749c6985-8rrz8\" (UID: \"e6461c10-dad4-4d20-aee6-f7a0ed5d10f1\") " pod="openshift-console/console-86749c6985-8rrz8" Jul 17 18:52:49.117157 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.117090 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6461c10-dad4-4d20-aee6-f7a0ed5d10f1-console-oauth-config\") pod \"console-86749c6985-8rrz8\" (UID: \"e6461c10-dad4-4d20-aee6-f7a0ed5d10f1\") " pod="openshift-console/console-86749c6985-8rrz8" Jul 17 18:52:49.117764 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.117726 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6461c10-dad4-4d20-aee6-f7a0ed5d10f1-service-ca\") pod \"console-86749c6985-8rrz8\" (UID: \"e6461c10-dad4-4d20-aee6-f7a0ed5d10f1\") " pod="openshift-console/console-86749c6985-8rrz8" Jul 17 18:52:49.117849 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.117827 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6461c10-dad4-4d20-aee6-f7a0ed5d10f1-oauth-serving-cert\") pod \"console-86749c6985-8rrz8\" (UID: \"e6461c10-dad4-4d20-aee6-f7a0ed5d10f1\") " pod="openshift-console/console-86749c6985-8rrz8" Jul 17 18:52:49.117849 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.117834 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6461c10-dad4-4d20-aee6-f7a0ed5d10f1-trusted-ca-bundle\") pod \"console-86749c6985-8rrz8\" (UID: \"e6461c10-dad4-4d20-aee6-f7a0ed5d10f1\") " pod="openshift-console/console-86749c6985-8rrz8" Jul 17 18:52:49.117954 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.117844 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6461c10-dad4-4d20-aee6-f7a0ed5d10f1-console-config\") pod \"console-86749c6985-8rrz8\" (UID: \"e6461c10-dad4-4d20-aee6-f7a0ed5d10f1\") " pod="openshift-console/console-86749c6985-8rrz8" Jul 17 18:52:49.120280 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.120260 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6461c10-dad4-4d20-aee6-f7a0ed5d10f1-console-oauth-config\") pod \"console-86749c6985-8rrz8\" (UID: \"e6461c10-dad4-4d20-aee6-f7a0ed5d10f1\") " pod="openshift-console/console-86749c6985-8rrz8" Jul 17 18:52:49.120459 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.120410 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6461c10-dad4-4d20-aee6-f7a0ed5d10f1-console-serving-cert\") pod \"console-86749c6985-8rrz8\" (UID: \"e6461c10-dad4-4d20-aee6-f7a0ed5d10f1\") " pod="openshift-console/console-86749c6985-8rrz8" Jul 17 18:52:49.125700 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.125678 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kvm2\" (UniqueName: \"kubernetes.io/projected/e6461c10-dad4-4d20-aee6-f7a0ed5d10f1-kube-api-access-2kvm2\") pod \"console-86749c6985-8rrz8\" (UID: \"e6461c10-dad4-4d20-aee6-f7a0ed5d10f1\") " pod="openshift-console/console-86749c6985-8rrz8" Jul 17 18:52:49.178527 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.178491 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:52:49.275587 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.275545 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86749c6985-8rrz8" Jul 17 18:52:49.411976 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.411950 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86749c6985-8rrz8"] Jul 17 18:52:49.414255 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:52:49.414228 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6461c10_dad4_4d20_aee6_f7a0ed5d10f1.slice/crio-4c2d6f608048a7c1b82370810b04b02bfafe6972493c91e050d5b0d8c1b9b93b WatchSource:0}: Error finding container 4c2d6f608048a7c1b82370810b04b02bfafe6972493c91e050d5b0d8c1b9b93b: Status 404 returned error can't find the container with id 4c2d6f608048a7c1b82370810b04b02bfafe6972493c91e050d5b0d8c1b9b93b Jul 17 18:52:49.719974 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.719944 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:52:49.782717 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.782684 2559 generic.go:356] "Generic (PLEG): container finished" podID="b7dc9672-f1c3-4c40-b1de-87ce09e14aa1" containerID="c71b7edce9ceb65f42cad7dc98a5a4e1d120965a9ed3cb37937ec1fbda772181" exitCode=0 Jul 17 18:52:49.783168 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.782757 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56" event={"ID":"b7dc9672-f1c3-4c40-b1de-87ce09e14aa1","Type":"ContainerDied","Data":"c71b7edce9ceb65f42cad7dc98a5a4e1d120965a9ed3cb37937ec1fbda772181"} Jul 17 18:52:49.784384 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.784359 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86749c6985-8rrz8" event={"ID":"e6461c10-dad4-4d20-aee6-f7a0ed5d10f1","Type":"ContainerStarted","Data":"20a612f26679a3fddc1488b29d9e63db3cbeaa286d209dc6c6c49e5e70912be8"} Jul 17 18:52:49.784477 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.784403 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86749c6985-8rrz8" event={"ID":"e6461c10-dad4-4d20-aee6-f7a0ed5d10f1","Type":"ContainerStarted","Data":"4c2d6f608048a7c1b82370810b04b02bfafe6972493c91e050d5b0d8c1b9b93b"} Jul 17 18:52:49.807029 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.806979 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:52:49.824163 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.823986 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86749c6985-8rrz8" podStartSLOduration=1.8239644959999999 podStartE2EDuration="1.823964496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:52:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:52:49.819926158 +0000 UTC m=+478.851539032" watchObservedRunningTime="2026-07-17 18:52:49.823964496 +0000 UTC m=+478.855577373" Jul 17 18:52:49.929048 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.929011 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds" Jul 17 18:52:49.963217 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.963190 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g" Jul 17 18:52:49.967159 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:49.967139 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr" Jul 17 18:52:50.023926 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.023848 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkt4r\" (UniqueName: \"kubernetes.io/projected/26f47351-05c6-4b42-a109-d8f09aa1e62a-kube-api-access-mkt4r\") pod \"26f47351-05c6-4b42-a109-d8f09aa1e62a\" (UID: \"26f47351-05c6-4b42-a109-d8f09aa1e62a\") " Jul 17 18:52:50.024071 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.023935 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgbb8\" (UniqueName: \"kubernetes.io/projected/9965128e-d2f7-407d-b8b6-a4da7f05e847-kube-api-access-pgbb8\") pod \"9965128e-d2f7-407d-b8b6-a4da7f05e847\" (UID: \"9965128e-d2f7-407d-b8b6-a4da7f05e847\") " Jul 17 18:52:50.024071 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.023979 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9965128e-d2f7-407d-b8b6-a4da7f05e847-bundle\") pod \"9965128e-d2f7-407d-b8b6-a4da7f05e847\" (UID: \"9965128e-d2f7-407d-b8b6-a4da7f05e847\") " Jul 17 18:52:50.024071 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.024019 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b375b40-62a3-4690-8952-46158b78cb18-bundle\") pod \"8b375b40-62a3-4690-8952-46158b78cb18\" (UID: \"8b375b40-62a3-4690-8952-46158b78cb18\") " Jul 17 18:52:50.024203 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.024144 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26f47351-05c6-4b42-a109-d8f09aa1e62a-util\") pod \"26f47351-05c6-4b42-a109-d8f09aa1e62a\" (UID: \"26f47351-05c6-4b42-a109-d8f09aa1e62a\") " Jul 17 18:52:50.024203 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.024188 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26f47351-05c6-4b42-a109-d8f09aa1e62a-bundle\") pod \"26f47351-05c6-4b42-a109-d8f09aa1e62a\" (UID: \"26f47351-05c6-4b42-a109-d8f09aa1e62a\") " Jul 17 18:52:50.024325 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.024222 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b375b40-62a3-4690-8952-46158b78cb18-util\") pod \"8b375b40-62a3-4690-8952-46158b78cb18\" (UID: \"8b375b40-62a3-4690-8952-46158b78cb18\") " Jul 17 18:52:50.024325 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.024264 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9965128e-d2f7-407d-b8b6-a4da7f05e847-util\") pod \"9965128e-d2f7-407d-b8b6-a4da7f05e847\" (UID: \"9965128e-d2f7-407d-b8b6-a4da7f05e847\") " Jul 17 18:52:50.024444 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.024302 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4fjn\" (UniqueName: \"kubernetes.io/projected/8b375b40-62a3-4690-8952-46158b78cb18-kube-api-access-n4fjn\") pod \"8b375b40-62a3-4690-8952-46158b78cb18\" (UID: \"8b375b40-62a3-4690-8952-46158b78cb18\") " Jul 17 18:52:50.024782 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.024560 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b375b40-62a3-4690-8952-46158b78cb18-bundle" (OuterVolumeSpecName: "bundle") pod "8b375b40-62a3-4690-8952-46158b78cb18" (UID: "8b375b40-62a3-4690-8952-46158b78cb18"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:52:50.024782 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.024686 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b375b40-62a3-4690-8952-46158b78cb18-bundle\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:52:50.025178 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.025147 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9965128e-d2f7-407d-b8b6-a4da7f05e847-bundle" (OuterVolumeSpecName: "bundle") pod "9965128e-d2f7-407d-b8b6-a4da7f05e847" (UID: "9965128e-d2f7-407d-b8b6-a4da7f05e847"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:52:50.025255 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.025225 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26f47351-05c6-4b42-a109-d8f09aa1e62a-bundle" (OuterVolumeSpecName: "bundle") pod "26f47351-05c6-4b42-a109-d8f09aa1e62a" (UID: "26f47351-05c6-4b42-a109-d8f09aa1e62a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:52:50.027180 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.027156 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9965128e-d2f7-407d-b8b6-a4da7f05e847-kube-api-access-pgbb8" (OuterVolumeSpecName: "kube-api-access-pgbb8") pod "9965128e-d2f7-407d-b8b6-a4da7f05e847" (UID: "9965128e-d2f7-407d-b8b6-a4da7f05e847"). InnerVolumeSpecName "kube-api-access-pgbb8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:52:50.027294 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.027251 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26f47351-05c6-4b42-a109-d8f09aa1e62a-kube-api-access-mkt4r" (OuterVolumeSpecName: "kube-api-access-mkt4r") pod "26f47351-05c6-4b42-a109-d8f09aa1e62a" (UID: "26f47351-05c6-4b42-a109-d8f09aa1e62a"). InnerVolumeSpecName "kube-api-access-mkt4r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:52:50.027386 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.027368 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b375b40-62a3-4690-8952-46158b78cb18-kube-api-access-n4fjn" (OuterVolumeSpecName: "kube-api-access-n4fjn") pod "8b375b40-62a3-4690-8952-46158b78cb18" (UID: "8b375b40-62a3-4690-8952-46158b78cb18"). InnerVolumeSpecName "kube-api-access-n4fjn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:52:50.029995 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.029976 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b375b40-62a3-4690-8952-46158b78cb18-util" (OuterVolumeSpecName: "util") pod "8b375b40-62a3-4690-8952-46158b78cb18" (UID: "8b375b40-62a3-4690-8952-46158b78cb18"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:52:50.030717 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.030697 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9965128e-d2f7-407d-b8b6-a4da7f05e847-util" (OuterVolumeSpecName: "util") pod "9965128e-d2f7-407d-b8b6-a4da7f05e847" (UID: "9965128e-d2f7-407d-b8b6-a4da7f05e847"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:52:50.031230 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.031205 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26f47351-05c6-4b42-a109-d8f09aa1e62a-util" (OuterVolumeSpecName: "util") pod "26f47351-05c6-4b42-a109-d8f09aa1e62a" (UID: "26f47351-05c6-4b42-a109-d8f09aa1e62a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:52:50.125565 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.125527 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkt4r\" (UniqueName: \"kubernetes.io/projected/26f47351-05c6-4b42-a109-d8f09aa1e62a-kube-api-access-mkt4r\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:52:50.125565 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.125557 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgbb8\" (UniqueName: \"kubernetes.io/projected/9965128e-d2f7-407d-b8b6-a4da7f05e847-kube-api-access-pgbb8\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:52:50.125565 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.125566 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9965128e-d2f7-407d-b8b6-a4da7f05e847-bundle\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:52:50.125565 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.125575 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26f47351-05c6-4b42-a109-d8f09aa1e62a-util\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:52:50.125831 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.125584 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26f47351-05c6-4b42-a109-d8f09aa1e62a-bundle\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:52:50.125831 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.125595 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b375b40-62a3-4690-8952-46158b78cb18-util\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:52:50.125831 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.125602 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9965128e-d2f7-407d-b8b6-a4da7f05e847-util\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:52:50.125831 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.125609 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4fjn\" (UniqueName: \"kubernetes.io/projected/8b375b40-62a3-4690-8952-46158b78cb18-kube-api-access-n4fjn\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:52:50.794533 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.794496 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds" Jul 17 18:52:50.794984 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.794505 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds" event={"ID":"9965128e-d2f7-407d-b8b6-a4da7f05e847","Type":"ContainerDied","Data":"9794e11aa10024120220b85f65cdbc70b28f4d7a38af1728b56581660bdfdb2b"} Jul 17 18:52:50.794984 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.794651 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9794e11aa10024120220b85f65cdbc70b28f4d7a38af1728b56581660bdfdb2b" Jul 17 18:52:50.796405 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.796382 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g" event={"ID":"26f47351-05c6-4b42-a109-d8f09aa1e62a","Type":"ContainerDied","Data":"50e975943b1e0748c1c2d032c7254d2bbe5b3be435a9102fe20a504c2fb5126b"} Jul 17 18:52:50.796405 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.796397 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g" Jul 17 18:52:50.796568 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.796416 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50e975943b1e0748c1c2d032c7254d2bbe5b3be435a9102fe20a504c2fb5126b" Jul 17 18:52:50.798302 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.798285 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr" Jul 17 18:52:50.798443 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.798338 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr" event={"ID":"8b375b40-62a3-4690-8952-46158b78cb18","Type":"ContainerDied","Data":"5a7a046662ae46c6155e62ebd0c3769afbd193fae4ee1933b10c2685dc5bd2d3"} Jul 17 18:52:50.798443 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.798376 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a7a046662ae46c6155e62ebd0c3769afbd193fae4ee1933b10c2685dc5bd2d3" Jul 17 18:52:50.932491 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:50.932461 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56" Jul 17 18:52:51.034931 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:51.034894 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqg8d\" (UniqueName: \"kubernetes.io/projected/b7dc9672-f1c3-4c40-b1de-87ce09e14aa1-kube-api-access-gqg8d\") pod \"b7dc9672-f1c3-4c40-b1de-87ce09e14aa1\" (UID: \"b7dc9672-f1c3-4c40-b1de-87ce09e14aa1\") " Jul 17 18:52:51.035110 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:51.034952 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7dc9672-f1c3-4c40-b1de-87ce09e14aa1-util\") pod \"b7dc9672-f1c3-4c40-b1de-87ce09e14aa1\" (UID: \"b7dc9672-f1c3-4c40-b1de-87ce09e14aa1\") " Jul 17 18:52:51.035110 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:51.034999 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7dc9672-f1c3-4c40-b1de-87ce09e14aa1-bundle\") pod \"b7dc9672-f1c3-4c40-b1de-87ce09e14aa1\" (UID: \"b7dc9672-f1c3-4c40-b1de-87ce09e14aa1\") " Jul 17 18:52:51.035541 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:51.035521 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7dc9672-f1c3-4c40-b1de-87ce09e14aa1-bundle" (OuterVolumeSpecName: "bundle") pod "b7dc9672-f1c3-4c40-b1de-87ce09e14aa1" (UID: "b7dc9672-f1c3-4c40-b1de-87ce09e14aa1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:52:51.037021 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:51.036999 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7dc9672-f1c3-4c40-b1de-87ce09e14aa1-kube-api-access-gqg8d" (OuterVolumeSpecName: "kube-api-access-gqg8d") pod "b7dc9672-f1c3-4c40-b1de-87ce09e14aa1" (UID: "b7dc9672-f1c3-4c40-b1de-87ce09e14aa1"). InnerVolumeSpecName "kube-api-access-gqg8d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:52:51.040152 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:51.040124 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7dc9672-f1c3-4c40-b1de-87ce09e14aa1-util" (OuterVolumeSpecName: "util") pod "b7dc9672-f1c3-4c40-b1de-87ce09e14aa1" (UID: "b7dc9672-f1c3-4c40-b1de-87ce09e14aa1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:52:51.136418 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:51.136381 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqg8d\" (UniqueName: \"kubernetes.io/projected/b7dc9672-f1c3-4c40-b1de-87ce09e14aa1-kube-api-access-gqg8d\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:52:51.136418 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:51.136413 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7dc9672-f1c3-4c40-b1de-87ce09e14aa1-util\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:52:51.136418 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:51.136423 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7dc9672-f1c3-4c40-b1de-87ce09e14aa1-bundle\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:52:51.805908 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:51.805827 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56" Jul 17 18:52:51.806244 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:51.805833 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56" event={"ID":"b7dc9672-f1c3-4c40-b1de-87ce09e14aa1","Type":"ContainerDied","Data":"ad35df07e7210a76bf449d3ca35086f809b9d9d1929a266c77d392cf14c28721"} Jul 17 18:52:51.806244 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:51.805953 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ad35df07e7210a76bf449d3ca35086f809b9d9d1929a266c77d392cf14c28721" Jul 17 18:52:57.706781 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:57.706754 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:52:58.304225 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:58.304182 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:52:59.276449 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:59.276405 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86749c6985-8rrz8" Jul 17 18:52:59.276937 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:59.276513 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86749c6985-8rrz8" Jul 17 18:52:59.281164 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:59.281139 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86749c6985-8rrz8" Jul 17 18:52:59.347848 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:59.347817 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:52:59.865574 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:59.865545 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86749c6985-8rrz8" Jul 17 18:52:59.922000 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:52:59.921972 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b759f7874-cscrk"] Jul 17 18:53:00.039721 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:00.039683 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:00.140223 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:00.140139 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:00.243803 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:00.243772 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:00.318763 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:00.318727 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:02.742933 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:02.742845 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:05.314865 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:05.314828 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:06.790182 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:06.790152 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:08.160747 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:08.160710 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:09.605195 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:09.605161 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:10.726418 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:10.726367 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:12.980013 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:12.979982 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:13.079527 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:13.079486 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:13.338719 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:13.338668 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:13.431755 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:13.431722 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:16.726502 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:16.726474 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:16.827155 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:16.827121 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:17.794554 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:17.794519 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:18.573394 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:18.573360 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:20.722470 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:20.722434 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:20.800567 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:20.800536 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:24.943557 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:24.943506 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b759f7874-cscrk" podUID="4a55bc06-4bab-4ac0-8924-f3cf1768ed7f" containerName="console" containerID="cri-o://4a6312114c150dce22f92c26070c70b6f250b206ab6f721e7a205e4a094c4055" gracePeriod=15 Jul 17 18:53:25.188295 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:25.188273 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:53:25.352263 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:25.352225 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-console-config\") pod \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\" (UID: \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\") " Jul 17 18:53:25.352263 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:25.352260 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-trusted-ca-bundle\") pod \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\" (UID: \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\") " Jul 17 18:53:25.352500 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:25.352361 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-service-ca\") pod \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\" (UID: \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\") " Jul 17 18:53:25.352500 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:25.352385 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-oauth-serving-cert\") pod \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\" (UID: \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\") " Jul 17 18:53:25.352500 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:25.352421 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bh7f\" (UniqueName: \"kubernetes.io/projected/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-kube-api-access-6bh7f\") pod \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\" (UID: \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\") " Jul 17 18:53:25.352652 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:25.352500 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-console-serving-cert\") pod \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\" (UID: \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\") " Jul 17 18:53:25.352652 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:25.352538 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-console-oauth-config\") pod \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\" (UID: \"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f\") " Jul 17 18:53:25.352782 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:25.352752 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-console-config" (OuterVolumeSpecName: "console-config") pod "4a55bc06-4bab-4ac0-8924-f3cf1768ed7f" (UID: "4a55bc06-4bab-4ac0-8924-f3cf1768ed7f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:53:25.352955 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:25.352839 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4a55bc06-4bab-4ac0-8924-f3cf1768ed7f" (UID: "4a55bc06-4bab-4ac0-8924-f3cf1768ed7f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:53:25.352955 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:25.352868 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-service-ca" (OuterVolumeSpecName: "service-ca") pod "4a55bc06-4bab-4ac0-8924-f3cf1768ed7f" (UID: "4a55bc06-4bab-4ac0-8924-f3cf1768ed7f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:53:25.353115 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:25.352958 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4a55bc06-4bab-4ac0-8924-f3cf1768ed7f" (UID: "4a55bc06-4bab-4ac0-8924-f3cf1768ed7f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:53:25.354771 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:25.354732 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-kube-api-access-6bh7f" (OuterVolumeSpecName: "kube-api-access-6bh7f") pod "4a55bc06-4bab-4ac0-8924-f3cf1768ed7f" (UID: "4a55bc06-4bab-4ac0-8924-f3cf1768ed7f"). InnerVolumeSpecName "kube-api-access-6bh7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:53:25.354771 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:25.354760 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4a55bc06-4bab-4ac0-8924-f3cf1768ed7f" (UID: "4a55bc06-4bab-4ac0-8924-f3cf1768ed7f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:53:25.354893 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:25.354775 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4a55bc06-4bab-4ac0-8924-f3cf1768ed7f" (UID: "4a55bc06-4bab-4ac0-8924-f3cf1768ed7f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:53:25.453436 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:25.453399 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-console-oauth-config\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:53:25.453436 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:25.453431 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-console-config\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:53:25.453436 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:25.453440 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-trusted-ca-bundle\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:53:25.453673 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:25.453450 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-service-ca\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:53:25.453673 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:25.453458 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-oauth-serving-cert\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:53:25.453673 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:25.453466 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bh7f\" (UniqueName: \"kubernetes.io/projected/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-kube-api-access-6bh7f\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:53:25.453673 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:25.453475 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f-console-serving-cert\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:53:26.007101 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:26.007068 2559 generic.go:356] "Generic (PLEG): container finished" podID="4a55bc06-4bab-4ac0-8924-f3cf1768ed7f" containerID="4a6312114c150dce22f92c26070c70b6f250b206ab6f721e7a205e4a094c4055" exitCode=0 Jul 17 18:53:26.007524 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:26.007134 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b759f7874-cscrk" Jul 17 18:53:26.007524 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:26.007137 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b759f7874-cscrk" event={"ID":"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f","Type":"ContainerDied","Data":"4a6312114c150dce22f92c26070c70b6f250b206ab6f721e7a205e4a094c4055"} Jul 17 18:53:26.007524 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:26.007272 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b759f7874-cscrk" event={"ID":"4a55bc06-4bab-4ac0-8924-f3cf1768ed7f","Type":"ContainerDied","Data":"62be91f692d2044f963b1b13d2f13662eefebe0e3549a5a401575966bc08fd68"} Jul 17 18:53:26.007524 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:26.007291 2559 scope.go:117] "RemoveContainer" containerID="4a6312114c150dce22f92c26070c70b6f250b206ab6f721e7a205e4a094c4055" Jul 17 18:53:26.016754 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:26.016734 2559 scope.go:117] "RemoveContainer" containerID="4a6312114c150dce22f92c26070c70b6f250b206ab6f721e7a205e4a094c4055" Jul 17 18:53:26.017031 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:53:26.017013 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a6312114c150dce22f92c26070c70b6f250b206ab6f721e7a205e4a094c4055\": container with ID starting with 4a6312114c150dce22f92c26070c70b6f250b206ab6f721e7a205e4a094c4055 not found: ID does not exist" containerID="4a6312114c150dce22f92c26070c70b6f250b206ab6f721e7a205e4a094c4055" Jul 17 18:53:26.017092 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:26.017040 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a6312114c150dce22f92c26070c70b6f250b206ab6f721e7a205e4a094c4055"} err="failed to get container status \"4a6312114c150dce22f92c26070c70b6f250b206ab6f721e7a205e4a094c4055\": rpc error: code = NotFound desc = could not find container \"4a6312114c150dce22f92c26070c70b6f250b206ab6f721e7a205e4a094c4055\": container with ID starting with 4a6312114c150dce22f92c26070c70b6f250b206ab6f721e7a205e4a094c4055 not found: ID does not exist" Jul 17 18:53:26.031801 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:26.031776 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b759f7874-cscrk"] Jul 17 18:53:26.038208 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:26.038182 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b759f7874-cscrk"] Jul 17 18:53:27.487712 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:27.487672 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a55bc06-4bab-4ac0-8924-f3cf1768ed7f" path="/var/lib/kubelet/pods/4a55bc06-4bab-4ac0-8924-f3cf1768ed7f/volumes" Jul 17 18:53:28.548634 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:28.548602 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:28.646725 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:28.646698 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:33.944981 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:33.944941 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:34.013522 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:34.013485 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:34.519300 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:34.519234 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:34.585243 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:34.585213 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:36.109794 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:36.109748 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:38.340897 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:38.340864 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:38.470099 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:38.470058 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:41.737250 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:41.737175 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:41.801594 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:41.801560 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:47.868787 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:47.868754 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:47.968092 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:47.968048 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:48.259638 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:48.259553 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:48.333919 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:53:48.333886 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:54:01.706222 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:01.706166 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:54:01.805862 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:01.805830 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:54:03.716487 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:03.716452 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:54:03.818061 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:03.818025 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:54:03.895470 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:03.895436 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:54:04.053026 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.052931 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 18:54:04.053405 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053387 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b375b40-62a3-4690-8952-46158b78cb18" containerName="util" Jul 17 18:54:04.053505 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053407 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b375b40-62a3-4690-8952-46158b78cb18" containerName="util" Jul 17 18:54:04.053505 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053420 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b375b40-62a3-4690-8952-46158b78cb18" containerName="pull" Jul 17 18:54:04.053505 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053428 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b375b40-62a3-4690-8952-46158b78cb18" containerName="pull" Jul 17 18:54:04.053505 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053438 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7dc9672-f1c3-4c40-b1de-87ce09e14aa1" containerName="pull" Jul 17 18:54:04.053505 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053446 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7dc9672-f1c3-4c40-b1de-87ce09e14aa1" containerName="pull" Jul 17 18:54:04.053505 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053454 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7dc9672-f1c3-4c40-b1de-87ce09e14aa1" containerName="extract" Jul 17 18:54:04.053505 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053461 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7dc9672-f1c3-4c40-b1de-87ce09e14aa1" containerName="extract" Jul 17 18:54:04.053505 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053476 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9965128e-d2f7-407d-b8b6-a4da7f05e847" containerName="pull" Jul 17 18:54:04.053505 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053484 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9965128e-d2f7-407d-b8b6-a4da7f05e847" containerName="pull" Jul 17 18:54:04.053505 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053499 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a55bc06-4bab-4ac0-8924-f3cf1768ed7f" containerName="console" Jul 17 18:54:04.053505 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053507 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a55bc06-4bab-4ac0-8924-f3cf1768ed7f" containerName="console" Jul 17 18:54:04.054053 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053524 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9965128e-d2f7-407d-b8b6-a4da7f05e847" containerName="extract" Jul 17 18:54:04.054053 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053532 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9965128e-d2f7-407d-b8b6-a4da7f05e847" containerName="extract" Jul 17 18:54:04.054053 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053544 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b375b40-62a3-4690-8952-46158b78cb18" containerName="extract" Jul 17 18:54:04.054053 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053552 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b375b40-62a3-4690-8952-46158b78cb18" containerName="extract" Jul 17 18:54:04.054053 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053565 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26f47351-05c6-4b42-a109-d8f09aa1e62a" containerName="util" Jul 17 18:54:04.054053 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053574 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="26f47351-05c6-4b42-a109-d8f09aa1e62a" containerName="util" Jul 17 18:54:04.054053 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053581 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9965128e-d2f7-407d-b8b6-a4da7f05e847" containerName="util" Jul 17 18:54:04.054053 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053590 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9965128e-d2f7-407d-b8b6-a4da7f05e847" containerName="util" Jul 17 18:54:04.054053 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053603 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7dc9672-f1c3-4c40-b1de-87ce09e14aa1" containerName="util" Jul 17 18:54:04.054053 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053611 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7dc9672-f1c3-4c40-b1de-87ce09e14aa1" containerName="util" Jul 17 18:54:04.054053 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053618 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26f47351-05c6-4b42-a109-d8f09aa1e62a" containerName="pull" Jul 17 18:54:04.054053 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053627 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="26f47351-05c6-4b42-a109-d8f09aa1e62a" containerName="pull" Jul 17 18:54:04.054053 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053635 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26f47351-05c6-4b42-a109-d8f09aa1e62a" containerName="extract" Jul 17 18:54:04.054053 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053643 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="26f47351-05c6-4b42-a109-d8f09aa1e62a" containerName="extract" Jul 17 18:54:04.054053 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053767 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b375b40-62a3-4690-8952-46158b78cb18" containerName="extract" Jul 17 18:54:04.054053 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053778 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="26f47351-05c6-4b42-a109-d8f09aa1e62a" containerName="extract" Jul 17 18:54:04.054053 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053794 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9965128e-d2f7-407d-b8b6-a4da7f05e847" containerName="extract" Jul 17 18:54:04.054053 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053803 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7dc9672-f1c3-4c40-b1de-87ce09e14aa1" containerName="extract" Jul 17 18:54:04.054053 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.053812 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a55bc06-4bab-4ac0-8924-f3cf1768ed7f" containerName="console" Jul 17 18:54:04.058468 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.058447 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-czv4z" Jul 17 18:54:04.060886 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.060863 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 17 18:54:04.061012 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.060930 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 17 18:54:04.061087 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.061056 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6k9sw\"" Jul 17 18:54:04.061159 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.061103 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 17 18:54:04.068278 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.068257 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 18:54:04.102089 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.102057 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 18:54:04.177137 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.177099 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5cb0721c-64cd-4e5b-8791-b7d30f3ab7ba-config-file\") pod \"limitador-limitador-54d6d988d5-czv4z\" (UID: \"5cb0721c-64cd-4e5b-8791-b7d30f3ab7ba\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-czv4z" Jul 17 18:54:04.177306 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.177200 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfhvw\" (UniqueName: \"kubernetes.io/projected/5cb0721c-64cd-4e5b-8791-b7d30f3ab7ba-kube-api-access-hfhvw\") pod \"limitador-limitador-54d6d988d5-czv4z\" (UID: \"5cb0721c-64cd-4e5b-8791-b7d30f3ab7ba\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-czv4z" Jul 17 18:54:04.277849 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.277812 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfhvw\" (UniqueName: \"kubernetes.io/projected/5cb0721c-64cd-4e5b-8791-b7d30f3ab7ba-kube-api-access-hfhvw\") pod \"limitador-limitador-54d6d988d5-czv4z\" (UID: \"5cb0721c-64cd-4e5b-8791-b7d30f3ab7ba\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-czv4z" Jul 17 18:54:04.278021 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.277895 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5cb0721c-64cd-4e5b-8791-b7d30f3ab7ba-config-file\") pod \"limitador-limitador-54d6d988d5-czv4z\" (UID: \"5cb0721c-64cd-4e5b-8791-b7d30f3ab7ba\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-czv4z" Jul 17 18:54:04.278524 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.278505 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5cb0721c-64cd-4e5b-8791-b7d30f3ab7ba-config-file\") pod \"limitador-limitador-54d6d988d5-czv4z\" (UID: \"5cb0721c-64cd-4e5b-8791-b7d30f3ab7ba\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-czv4z" Jul 17 18:54:04.287442 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.287403 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfhvw\" (UniqueName: \"kubernetes.io/projected/5cb0721c-64cd-4e5b-8791-b7d30f3ab7ba-kube-api-access-hfhvw\") pod \"limitador-limitador-54d6d988d5-czv4z\" (UID: \"5cb0721c-64cd-4e5b-8791-b7d30f3ab7ba\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-czv4z" Jul 17 18:54:04.369221 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.369190 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-czv4z" Jul 17 18:54:04.514996 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.514966 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-zfjck"] Jul 17 18:54:04.518963 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.518936 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zfjck" Jul 17 18:54:04.521721 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.521696 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rdvvm\"" Jul 17 18:54:04.523903 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.523878 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zfjck"] Jul 17 18:54:04.537387 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.537361 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 18:54:04.540331 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:54:04.540290 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cb0721c_64cd_4e5b_8791_b7d30f3ab7ba.slice/crio-5d6af3a7e5c4fa6b2016eddbdde71768cae0d46428e08409e17fa952469440e4 WatchSource:0}: Error finding container 5d6af3a7e5c4fa6b2016eddbdde71768cae0d46428e08409e17fa952469440e4: Status 404 returned error can't find the container with id 5d6af3a7e5c4fa6b2016eddbdde71768cae0d46428e08409e17fa952469440e4 Jul 17 18:54:04.546047 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.546003 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:54:04.580760 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.580723 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jpnw\" (UniqueName: \"kubernetes.io/projected/f45d194d-f91e-4063-9465-e24c7625578d-kube-api-access-2jpnw\") pod \"authorino-58cd955675-zfjck\" (UID: \"f45d194d-f91e-4063-9465-e24c7625578d\") " pod="kuadrant-system/authorino-58cd955675-zfjck" Jul 17 18:54:04.613344 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.613297 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:54:04.681852 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.681751 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jpnw\" (UniqueName: \"kubernetes.io/projected/f45d194d-f91e-4063-9465-e24c7625578d-kube-api-access-2jpnw\") pod \"authorino-58cd955675-zfjck\" (UID: \"f45d194d-f91e-4063-9465-e24c7625578d\") " pod="kuadrant-system/authorino-58cd955675-zfjck" Jul 17 18:54:04.694528 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.694495 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jpnw\" (UniqueName: \"kubernetes.io/projected/f45d194d-f91e-4063-9465-e24c7625578d-kube-api-access-2jpnw\") pod \"authorino-58cd955675-zfjck\" (UID: \"f45d194d-f91e-4063-9465-e24c7625578d\") " pod="kuadrant-system/authorino-58cd955675-zfjck" Jul 17 18:54:04.830054 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.830014 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zfjck" Jul 17 18:54:04.969926 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:04.969893 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zfjck"] Jul 17 18:54:05.217427 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:05.217325 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zfjck" event={"ID":"f45d194d-f91e-4063-9465-e24c7625578d","Type":"ContainerStarted","Data":"71492d0d6339e9a88ef108f97bbda610c0b02f58caffb7e07982492ef015a2b0"} Jul 17 18:54:05.218567 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:05.218538 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-czv4z" event={"ID":"5cb0721c-64cd-4e5b-8791-b7d30f3ab7ba","Type":"ContainerStarted","Data":"5d6af3a7e5c4fa6b2016eddbdde71768cae0d46428e08409e17fa952469440e4"} Jul 17 18:54:09.796787 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:09.796751 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zfjck"] Jul 17 18:54:10.253612 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:10.253573 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-czv4z" event={"ID":"5cb0721c-64cd-4e5b-8791-b7d30f3ab7ba","Type":"ContainerStarted","Data":"6be3dbd5ac0beff79171229fc0cf884426566eaecab49ac97ad69463a523ffb8"} Jul 17 18:54:10.253838 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:10.253821 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-czv4z" Jul 17 18:54:10.255181 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:10.255158 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zfjck" event={"ID":"f45d194d-f91e-4063-9465-e24c7625578d","Type":"ContainerStarted","Data":"5f4bd45545ed9ecdfed3eefe20ff9c0e52db27a3baa9816df1736049bc9d98c0"} Jul 17 18:54:10.296355 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:10.296278 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-czv4z" podStartSLOduration=1.654311412 podStartE2EDuration="6.296260895s" totalImagesPullingTime="4.641949483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:54:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:54:10.295783749 +0000 UTC m=+559.327396623" watchObservedRunningTime="2026-07-17 18:54:10.296260895 +0000 UTC m=+559.327873782" Jul 17 18:54:10.335568 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:10.335518 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-zfjck" podStartSLOduration=2.124757179 podStartE2EDuration="6.335501663s" totalImagesPullingTime="4.210744484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:54:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:54:10.334252231 +0000 UTC m=+559.365865104" watchObservedRunningTime="2026-07-17 18:54:10.335501663 +0000 UTC m=+559.367114536" Jul 17 18:54:11.260668 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:11.260625 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-zfjck" podUID="f45d194d-f91e-4063-9465-e24c7625578d" containerName="authorino" containerID="cri-o://5f4bd45545ed9ecdfed3eefe20ff9c0e52db27a3baa9816df1736049bc9d98c0" gracePeriod=30 Jul 17 18:54:11.508000 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:11.507969 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zfjck" Jul 17 18:54:11.651846 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:11.651818 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jpnw\" (UniqueName: \"kubernetes.io/projected/f45d194d-f91e-4063-9465-e24c7625578d-kube-api-access-2jpnw\") pod \"f45d194d-f91e-4063-9465-e24c7625578d\" (UID: \"f45d194d-f91e-4063-9465-e24c7625578d\") " Jul 17 18:54:11.653905 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:11.653868 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f45d194d-f91e-4063-9465-e24c7625578d-kube-api-access-2jpnw" (OuterVolumeSpecName: "kube-api-access-2jpnw") pod "f45d194d-f91e-4063-9465-e24c7625578d" (UID: "f45d194d-f91e-4063-9465-e24c7625578d"). InnerVolumeSpecName "kube-api-access-2jpnw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:54:11.753531 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:11.753491 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jpnw\" (UniqueName: \"kubernetes.io/projected/f45d194d-f91e-4063-9465-e24c7625578d-kube-api-access-2jpnw\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:54:12.267025 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:12.266989 2559 generic.go:356] "Generic (PLEG): container finished" podID="f45d194d-f91e-4063-9465-e24c7625578d" containerID="5f4bd45545ed9ecdfed3eefe20ff9c0e52db27a3baa9816df1736049bc9d98c0" exitCode=0 Jul 17 18:54:12.267542 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:12.267038 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zfjck" Jul 17 18:54:12.267542 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:12.267056 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zfjck" event={"ID":"f45d194d-f91e-4063-9465-e24c7625578d","Type":"ContainerDied","Data":"5f4bd45545ed9ecdfed3eefe20ff9c0e52db27a3baa9816df1736049bc9d98c0"} Jul 17 18:54:12.267542 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:12.267088 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zfjck" event={"ID":"f45d194d-f91e-4063-9465-e24c7625578d","Type":"ContainerDied","Data":"71492d0d6339e9a88ef108f97bbda610c0b02f58caffb7e07982492ef015a2b0"} Jul 17 18:54:12.267542 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:12.267108 2559 scope.go:117] "RemoveContainer" containerID="5f4bd45545ed9ecdfed3eefe20ff9c0e52db27a3baa9816df1736049bc9d98c0" Jul 17 18:54:12.276203 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:12.276184 2559 scope.go:117] "RemoveContainer" containerID="5f4bd45545ed9ecdfed3eefe20ff9c0e52db27a3baa9816df1736049bc9d98c0" Jul 17 18:54:12.276496 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:54:12.276478 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f4bd45545ed9ecdfed3eefe20ff9c0e52db27a3baa9816df1736049bc9d98c0\": container with ID starting with 5f4bd45545ed9ecdfed3eefe20ff9c0e52db27a3baa9816df1736049bc9d98c0 not found: ID does not exist" containerID="5f4bd45545ed9ecdfed3eefe20ff9c0e52db27a3baa9816df1736049bc9d98c0" Jul 17 18:54:12.276563 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:12.276510 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f4bd45545ed9ecdfed3eefe20ff9c0e52db27a3baa9816df1736049bc9d98c0"} err="failed to get container status \"5f4bd45545ed9ecdfed3eefe20ff9c0e52db27a3baa9816df1736049bc9d98c0\": rpc error: code = NotFound desc = could not find container \"5f4bd45545ed9ecdfed3eefe20ff9c0e52db27a3baa9816df1736049bc9d98c0\": container with ID starting with 5f4bd45545ed9ecdfed3eefe20ff9c0e52db27a3baa9816df1736049bc9d98c0 not found: ID does not exist" Jul 17 18:54:12.288598 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:12.288569 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zfjck"] Jul 17 18:54:12.291959 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:12.291937 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-zfjck"] Jul 17 18:54:13.487539 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:13.487503 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f45d194d-f91e-4063-9465-e24c7625578d" path="/var/lib/kubelet/pods/f45d194d-f91e-4063-9465-e24c7625578d/volumes" Jul 17 18:54:21.261660 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:21.261630 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-czv4z" Jul 17 18:54:24.992342 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:24.992279 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:54:25.082058 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:25.082026 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:54:25.489589 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:25.489553 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:54:37.212790 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:37.212753 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:54:37.436099 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:37.436069 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:54:37.466596 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:37.466519 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2drx4"] Jul 17 18:54:37.466905 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:37.466891 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f45d194d-f91e-4063-9465-e24c7625578d" containerName="authorino" Jul 17 18:54:37.466952 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:37.466907 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f45d194d-f91e-4063-9465-e24c7625578d" containerName="authorino" Jul 17 18:54:37.466986 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:37.466982 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f45d194d-f91e-4063-9465-e24c7625578d" containerName="authorino" Jul 17 18:54:37.474566 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:37.474550 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2drx4" Jul 17 18:54:37.477226 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:37.477205 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rdvvm\"" Jul 17 18:54:37.478332 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:37.478284 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2drx4"] Jul 17 18:54:37.571362 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:37.571325 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7pnv\" (UniqueName: \"kubernetes.io/projected/5c491107-b902-4633-91e2-65d6953d57ee-kube-api-access-r7pnv\") pod \"authorino-5d4b67c446-2drx4\" (UID: \"5c491107-b902-4633-91e2-65d6953d57ee\") " pod="kuadrant-system/authorino-5d4b67c446-2drx4" Jul 17 18:54:37.672009 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:37.671969 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7pnv\" (UniqueName: \"kubernetes.io/projected/5c491107-b902-4633-91e2-65d6953d57ee-kube-api-access-r7pnv\") pod \"authorino-5d4b67c446-2drx4\" (UID: \"5c491107-b902-4633-91e2-65d6953d57ee\") " pod="kuadrant-system/authorino-5d4b67c446-2drx4" Jul 17 18:54:37.684827 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:37.684797 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7pnv\" (UniqueName: \"kubernetes.io/projected/5c491107-b902-4633-91e2-65d6953d57ee-kube-api-access-r7pnv\") pod \"authorino-5d4b67c446-2drx4\" (UID: \"5c491107-b902-4633-91e2-65d6953d57ee\") " pod="kuadrant-system/authorino-5d4b67c446-2drx4" Jul 17 18:54:37.710796 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:37.710761 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2drx4"] Jul 17 18:54:37.711066 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:37.711053 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2drx4" Jul 17 18:54:37.744996 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:37.744962 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c475b6d9b-bjjg2"] Jul 17 18:54:37.748950 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:37.748927 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c475b6d9b-bjjg2" Jul 17 18:54:37.758112 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:37.758089 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c475b6d9b-bjjg2"] Jul 17 18:54:37.772693 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:37.772665 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh62f\" (UniqueName: \"kubernetes.io/projected/d185bc6d-6c96-41d6-9912-5d1407207bec-kube-api-access-gh62f\") pod \"authorino-7c475b6d9b-bjjg2\" (UID: \"d185bc6d-6c96-41d6-9912-5d1407207bec\") " pod="kuadrant-system/authorino-7c475b6d9b-bjjg2" Jul 17 18:54:37.846865 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:37.846839 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2drx4"] Jul 17 18:54:37.848247 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:54:37.848216 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c491107_b902_4633_91e2_65d6953d57ee.slice/crio-0b909a69d5e444065c29c875c119d7a9592bd4946325e90d405518f0546255a6 WatchSource:0}: Error finding container 0b909a69d5e444065c29c875c119d7a9592bd4946325e90d405518f0546255a6: Status 404 returned error can't find the container with id 0b909a69d5e444065c29c875c119d7a9592bd4946325e90d405518f0546255a6 Jul 17 18:54:37.873843 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:37.873809 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh62f\" (UniqueName: \"kubernetes.io/projected/d185bc6d-6c96-41d6-9912-5d1407207bec-kube-api-access-gh62f\") pod \"authorino-7c475b6d9b-bjjg2\" (UID: \"d185bc6d-6c96-41d6-9912-5d1407207bec\") " pod="kuadrant-system/authorino-7c475b6d9b-bjjg2" Jul 17 18:54:37.882958 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:37.882933 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh62f\" (UniqueName: \"kubernetes.io/projected/d185bc6d-6c96-41d6-9912-5d1407207bec-kube-api-access-gh62f\") pod \"authorino-7c475b6d9b-bjjg2\" (UID: \"d185bc6d-6c96-41d6-9912-5d1407207bec\") " pod="kuadrant-system/authorino-7c475b6d9b-bjjg2" Jul 17 18:54:37.922120 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:37.922092 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c475b6d9b-bjjg2"] Jul 17 18:54:37.922379 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:37.922367 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c475b6d9b-bjjg2" Jul 17 18:54:38.055442 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:38.055416 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c475b6d9b-bjjg2"] Jul 17 18:54:38.056899 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:54:38.056874 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd185bc6d_6c96_41d6_9912_5d1407207bec.slice/crio-558158b94dbb0facd5016a56276e62d63e9e15648d724f290d088f422005aeb5 WatchSource:0}: Error finding container 558158b94dbb0facd5016a56276e62d63e9e15648d724f290d088f422005aeb5: Status 404 returned error can't find the container with id 558158b94dbb0facd5016a56276e62d63e9e15648d724f290d088f422005aeb5 Jul 17 18:54:38.416132 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:38.416089 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2drx4" event={"ID":"5c491107-b902-4633-91e2-65d6953d57ee","Type":"ContainerStarted","Data":"1ded815f1ea985cc8b82192b6ce1b4712d14e9454ff89e76d1851e0bc92b9cf0"} Jul 17 18:54:38.416132 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:38.416123 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-2drx4" podUID="5c491107-b902-4633-91e2-65d6953d57ee" containerName="authorino" containerID="cri-o://1ded815f1ea985cc8b82192b6ce1b4712d14e9454ff89e76d1851e0bc92b9cf0" gracePeriod=30 Jul 17 18:54:38.416653 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:38.416141 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2drx4" event={"ID":"5c491107-b902-4633-91e2-65d6953d57ee","Type":"ContainerStarted","Data":"0b909a69d5e444065c29c875c119d7a9592bd4946325e90d405518f0546255a6"} Jul 17 18:54:38.417389 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:38.417365 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c475b6d9b-bjjg2" event={"ID":"d185bc6d-6c96-41d6-9912-5d1407207bec","Type":"ContainerStarted","Data":"558158b94dbb0facd5016a56276e62d63e9e15648d724f290d088f422005aeb5"} Jul 17 18:54:38.443186 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:38.443148 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-2drx4" podStartSLOduration=1.133031575 podStartE2EDuration="1.443134436s" totalImagesPullingTime="310.102861ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:54:38.442484381 +0000 UTC m=+587.474097256" watchObservedRunningTime="2026-07-17 18:54:38.443134436 +0000 UTC m=+587.474747331" Jul 17 18:54:38.664000 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:38.663972 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2drx4" Jul 17 18:54:38.681149 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:38.681077 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7pnv\" (UniqueName: \"kubernetes.io/projected/5c491107-b902-4633-91e2-65d6953d57ee-kube-api-access-r7pnv\") pod \"5c491107-b902-4633-91e2-65d6953d57ee\" (UID: \"5c491107-b902-4633-91e2-65d6953d57ee\") " Jul 17 18:54:38.683494 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:38.683463 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c491107-b902-4633-91e2-65d6953d57ee-kube-api-access-r7pnv" (OuterVolumeSpecName: "kube-api-access-r7pnv") pod "5c491107-b902-4633-91e2-65d6953d57ee" (UID: "5c491107-b902-4633-91e2-65d6953d57ee"). InnerVolumeSpecName "kube-api-access-r7pnv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:54:38.782563 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:38.782525 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7pnv\" (UniqueName: \"kubernetes.io/projected/5c491107-b902-4633-91e2-65d6953d57ee-kube-api-access-r7pnv\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:54:39.424036 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:39.424001 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c475b6d9b-bjjg2" event={"ID":"d185bc6d-6c96-41d6-9912-5d1407207bec","Type":"ContainerStarted","Data":"52b2f29f9f6b705752736cce79943482a0041e706a6a656c5db67478cf9e6447"} Jul 17 18:54:39.424036 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:39.424003 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7c475b6d9b-bjjg2" podUID="d185bc6d-6c96-41d6-9912-5d1407207bec" containerName="authorino" containerID="cri-o://52b2f29f9f6b705752736cce79943482a0041e706a6a656c5db67478cf9e6447" gracePeriod=30 Jul 17 18:54:39.425466 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:39.425443 2559 generic.go:356] "Generic (PLEG): container finished" podID="5c491107-b902-4633-91e2-65d6953d57ee" containerID="1ded815f1ea985cc8b82192b6ce1b4712d14e9454ff89e76d1851e0bc92b9cf0" exitCode=0 Jul 17 18:54:39.425590 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:39.425482 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2drx4" Jul 17 18:54:39.425590 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:39.425504 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2drx4" event={"ID":"5c491107-b902-4633-91e2-65d6953d57ee","Type":"ContainerDied","Data":"1ded815f1ea985cc8b82192b6ce1b4712d14e9454ff89e76d1851e0bc92b9cf0"} Jul 17 18:54:39.425590 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:39.425539 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2drx4" event={"ID":"5c491107-b902-4633-91e2-65d6953d57ee","Type":"ContainerDied","Data":"0b909a69d5e444065c29c875c119d7a9592bd4946325e90d405518f0546255a6"} Jul 17 18:54:39.425590 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:39.425562 2559 scope.go:117] "RemoveContainer" containerID="1ded815f1ea985cc8b82192b6ce1b4712d14e9454ff89e76d1851e0bc92b9cf0" Jul 17 18:54:39.441400 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:39.441380 2559 scope.go:117] "RemoveContainer" containerID="1ded815f1ea985cc8b82192b6ce1b4712d14e9454ff89e76d1851e0bc92b9cf0" Jul 17 18:54:39.441752 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:54:39.441724 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ded815f1ea985cc8b82192b6ce1b4712d14e9454ff89e76d1851e0bc92b9cf0\": container with ID starting with 1ded815f1ea985cc8b82192b6ce1b4712d14e9454ff89e76d1851e0bc92b9cf0 not found: ID does not exist" containerID="1ded815f1ea985cc8b82192b6ce1b4712d14e9454ff89e76d1851e0bc92b9cf0" Jul 17 18:54:39.441880 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:39.441855 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ded815f1ea985cc8b82192b6ce1b4712d14e9454ff89e76d1851e0bc92b9cf0"} err="failed to get container status \"1ded815f1ea985cc8b82192b6ce1b4712d14e9454ff89e76d1851e0bc92b9cf0\": rpc error: code = NotFound desc = could not find container \"1ded815f1ea985cc8b82192b6ce1b4712d14e9454ff89e76d1851e0bc92b9cf0\": container with ID starting with 1ded815f1ea985cc8b82192b6ce1b4712d14e9454ff89e76d1851e0bc92b9cf0 not found: ID does not exist" Jul 17 18:54:39.443012 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:39.442964 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7c475b6d9b-bjjg2" podStartSLOduration=2.068119959 podStartE2EDuration="2.442952182s" totalImagesPullingTime="374.832223ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:54:39.4422186 +0000 UTC m=+588.473831472" watchObservedRunningTime="2026-07-17 18:54:39.442952182 +0000 UTC m=+588.474565055" Jul 17 18:54:39.494264 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:39.494235 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2drx4"] Jul 17 18:54:39.498561 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:39.498540 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2drx4"] Jul 17 18:54:39.666981 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:39.666955 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c475b6d9b-bjjg2" Jul 17 18:54:39.689788 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:39.689712 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gh62f\" (UniqueName: \"kubernetes.io/projected/d185bc6d-6c96-41d6-9912-5d1407207bec-kube-api-access-gh62f\") pod \"d185bc6d-6c96-41d6-9912-5d1407207bec\" (UID: \"d185bc6d-6c96-41d6-9912-5d1407207bec\") " Jul 17 18:54:39.692003 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:39.691966 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d185bc6d-6c96-41d6-9912-5d1407207bec-kube-api-access-gh62f" (OuterVolumeSpecName: "kube-api-access-gh62f") pod "d185bc6d-6c96-41d6-9912-5d1407207bec" (UID: "d185bc6d-6c96-41d6-9912-5d1407207bec"). InnerVolumeSpecName "kube-api-access-gh62f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:54:39.791369 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:39.791304 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gh62f\" (UniqueName: \"kubernetes.io/projected/d185bc6d-6c96-41d6-9912-5d1407207bec-kube-api-access-gh62f\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 18:54:40.433139 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:40.433101 2559 generic.go:356] "Generic (PLEG): container finished" podID="d185bc6d-6c96-41d6-9912-5d1407207bec" containerID="52b2f29f9f6b705752736cce79943482a0041e706a6a656c5db67478cf9e6447" exitCode=0 Jul 17 18:54:40.433609 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:40.433148 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c475b6d9b-bjjg2" Jul 17 18:54:40.433609 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:40.433186 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c475b6d9b-bjjg2" event={"ID":"d185bc6d-6c96-41d6-9912-5d1407207bec","Type":"ContainerDied","Data":"52b2f29f9f6b705752736cce79943482a0041e706a6a656c5db67478cf9e6447"} Jul 17 18:54:40.433609 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:40.433230 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c475b6d9b-bjjg2" event={"ID":"d185bc6d-6c96-41d6-9912-5d1407207bec","Type":"ContainerDied","Data":"558158b94dbb0facd5016a56276e62d63e9e15648d724f290d088f422005aeb5"} Jul 17 18:54:40.433609 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:40.433247 2559 scope.go:117] "RemoveContainer" containerID="52b2f29f9f6b705752736cce79943482a0041e706a6a656c5db67478cf9e6447" Jul 17 18:54:40.442251 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:40.442231 2559 scope.go:117] "RemoveContainer" containerID="52b2f29f9f6b705752736cce79943482a0041e706a6a656c5db67478cf9e6447" Jul 17 18:54:40.442523 ip-10-0-131-36 kubenswrapper[2559]: E0717 18:54:40.442504 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52b2f29f9f6b705752736cce79943482a0041e706a6a656c5db67478cf9e6447\": container with ID starting with 52b2f29f9f6b705752736cce79943482a0041e706a6a656c5db67478cf9e6447 not found: ID does not exist" containerID="52b2f29f9f6b705752736cce79943482a0041e706a6a656c5db67478cf9e6447" Jul 17 18:54:40.442586 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:40.442531 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52b2f29f9f6b705752736cce79943482a0041e706a6a656c5db67478cf9e6447"} err="failed to get container status \"52b2f29f9f6b705752736cce79943482a0041e706a6a656c5db67478cf9e6447\": rpc error: code = NotFound desc = could not find container \"52b2f29f9f6b705752736cce79943482a0041e706a6a656c5db67478cf9e6447\": container with ID starting with 52b2f29f9f6b705752736cce79943482a0041e706a6a656c5db67478cf9e6447 not found: ID does not exist" Jul 17 18:54:40.456656 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:40.456631 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c475b6d9b-bjjg2"] Jul 17 18:54:40.461797 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:40.461778 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7c475b6d9b-bjjg2"] Jul 17 18:54:41.488115 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:41.488086 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c491107-b902-4633-91e2-65d6953d57ee" path="/var/lib/kubelet/pods/5c491107-b902-4633-91e2-65d6953d57ee/volumes" Jul 17 18:54:41.488765 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:41.488599 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d185bc6d-6c96-41d6-9912-5d1407207bec" path="/var/lib/kubelet/pods/d185bc6d-6c96-41d6-9912-5d1407207bec/volumes" Jul 17 18:54:44.695846 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:44.695815 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:54:46.824009 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:46.823974 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:54:48.284080 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:48.284046 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:54:48.403056 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:48.403026 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:54:51.408774 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:51.408746 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jpl4k_d9bb01d7-7fed-4275-9a94-df46852eeb39/ovn-acl-logging/0.log" Jul 17 18:54:51.409506 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:54:51.409481 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jpl4k_d9bb01d7-7fed-4275-9a94-df46852eeb39/ovn-acl-logging/0.log" Jul 17 18:55:20.153664 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:55:20.153530 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:55:20.392685 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:55:20.392652 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:55:20.702775 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:55:20.702739 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:55:20.879890 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:55:20.879858 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:55:21.486973 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:55:21.486944 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:55:21.591325 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:55:21.591289 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:55:21.849460 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:55:21.849431 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 18:55:31.312903 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:55:31.312874 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:55:38.265198 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:55:38.265163 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 18:55:41.466712 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:55:41.466667 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:55:41.537685 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:55:41.537647 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:55:46.453210 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:55:46.453151 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:55:46.553754 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:55:46.553721 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:56:04.600095 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:04.600055 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:56:05.363231 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:05.363196 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 18:56:11.319654 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.319619 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk"] Jul 17 18:56:11.320051 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.320003 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d185bc6d-6c96-41d6-9912-5d1407207bec" containerName="authorino" Jul 17 18:56:11.320051 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.320014 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d185bc6d-6c96-41d6-9912-5d1407207bec" containerName="authorino" Jul 17 18:56:11.320051 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.320025 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c491107-b902-4633-91e2-65d6953d57ee" containerName="authorino" Jul 17 18:56:11.320051 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.320030 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c491107-b902-4633-91e2-65d6953d57ee" containerName="authorino" Jul 17 18:56:11.320205 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.320082 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c491107-b902-4633-91e2-65d6953d57ee" containerName="authorino" Jul 17 18:56:11.320205 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.320092 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d185bc6d-6c96-41d6-9912-5d1407207bec" containerName="authorino" Jul 17 18:56:11.323159 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.323144 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk" Jul 17 18:56:11.329796 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.329496 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 17 18:56:11.330300 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.330281 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tmjdx\"" Jul 17 18:56:11.330436 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.330336 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 17 18:56:11.330793 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.330777 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 17 18:56:11.349232 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.349205 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk"] Jul 17 18:56:11.389064 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.389034 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:56:11.402769 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.402742 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/285bf799-8464-4ea6-a7db-1e61d4c70ff5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgqk\" (UID: \"285bf799-8464-4ea6-a7db-1e61d4c70ff5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk" Jul 17 18:56:11.402897 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.402779 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/285bf799-8464-4ea6-a7db-1e61d4c70ff5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgqk\" (UID: \"285bf799-8464-4ea6-a7db-1e61d4c70ff5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk" Jul 17 18:56:11.402897 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.402840 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/285bf799-8464-4ea6-a7db-1e61d4c70ff5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgqk\" (UID: \"285bf799-8464-4ea6-a7db-1e61d4c70ff5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk" Jul 17 18:56:11.402897 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.402883 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c9kn\" (UniqueName: \"kubernetes.io/projected/285bf799-8464-4ea6-a7db-1e61d4c70ff5-kube-api-access-9c9kn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgqk\" (UID: \"285bf799-8464-4ea6-a7db-1e61d4c70ff5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk" Jul 17 18:56:11.403063 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.402928 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/285bf799-8464-4ea6-a7db-1e61d4c70ff5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgqk\" (UID: \"285bf799-8464-4ea6-a7db-1e61d4c70ff5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk" Jul 17 18:56:11.403063 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.402988 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/285bf799-8464-4ea6-a7db-1e61d4c70ff5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgqk\" (UID: \"285bf799-8464-4ea6-a7db-1e61d4c70ff5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk" Jul 17 18:56:11.504075 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.504047 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c9kn\" (UniqueName: \"kubernetes.io/projected/285bf799-8464-4ea6-a7db-1e61d4c70ff5-kube-api-access-9c9kn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgqk\" (UID: \"285bf799-8464-4ea6-a7db-1e61d4c70ff5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk" Jul 17 18:56:11.504261 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.504097 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/285bf799-8464-4ea6-a7db-1e61d4c70ff5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgqk\" (UID: \"285bf799-8464-4ea6-a7db-1e61d4c70ff5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk" Jul 17 18:56:11.504261 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.504134 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/285bf799-8464-4ea6-a7db-1e61d4c70ff5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgqk\" (UID: \"285bf799-8464-4ea6-a7db-1e61d4c70ff5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk" Jul 17 18:56:11.504261 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.504169 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/285bf799-8464-4ea6-a7db-1e61d4c70ff5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgqk\" (UID: \"285bf799-8464-4ea6-a7db-1e61d4c70ff5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk" Jul 17 18:56:11.504261 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.504194 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/285bf799-8464-4ea6-a7db-1e61d4c70ff5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgqk\" (UID: \"285bf799-8464-4ea6-a7db-1e61d4c70ff5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk" Jul 17 18:56:11.504261 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.504239 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/285bf799-8464-4ea6-a7db-1e61d4c70ff5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgqk\" (UID: \"285bf799-8464-4ea6-a7db-1e61d4c70ff5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk" Jul 17 18:56:11.504644 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.504608 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/285bf799-8464-4ea6-a7db-1e61d4c70ff5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgqk\" (UID: \"285bf799-8464-4ea6-a7db-1e61d4c70ff5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk" Jul 17 18:56:11.504687 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.504654 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/285bf799-8464-4ea6-a7db-1e61d4c70ff5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgqk\" (UID: \"285bf799-8464-4ea6-a7db-1e61d4c70ff5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk" Jul 17 18:56:11.504725 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.504698 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/285bf799-8464-4ea6-a7db-1e61d4c70ff5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgqk\" (UID: \"285bf799-8464-4ea6-a7db-1e61d4c70ff5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk" Jul 17 18:56:11.506578 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.506557 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/285bf799-8464-4ea6-a7db-1e61d4c70ff5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgqk\" (UID: \"285bf799-8464-4ea6-a7db-1e61d4c70ff5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk" Jul 17 18:56:11.506859 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.506843 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/285bf799-8464-4ea6-a7db-1e61d4c70ff5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgqk\" (UID: \"285bf799-8464-4ea6-a7db-1e61d4c70ff5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk" Jul 17 18:56:11.517893 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.517868 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c9kn\" (UniqueName: \"kubernetes.io/projected/285bf799-8464-4ea6-a7db-1e61d4c70ff5-kube-api-access-9c9kn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgqk\" (UID: \"285bf799-8464-4ea6-a7db-1e61d4c70ff5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk" Jul 17 18:56:11.633193 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.633162 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk" Jul 17 18:56:11.780715 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.780686 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk"] Jul 17 18:56:11.782262 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:56:11.782234 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod285bf799_8464_4ea6_a7db_1e61d4c70ff5.slice/crio-a028ff72dde884c93ab0010dbbb0d8fc64c68296e9c5e5b9f6d55b8630f18565 WatchSource:0}: Error finding container a028ff72dde884c93ab0010dbbb0d8fc64c68296e9c5e5b9f6d55b8630f18565: Status 404 returned error can't find the container with id a028ff72dde884c93ab0010dbbb0d8fc64c68296e9c5e5b9f6d55b8630f18565 Jul 17 18:56:11.783678 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.783650 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 18:56:11.920260 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:11.920164 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk" event={"ID":"285bf799-8464-4ea6-a7db-1e61d4c70ff5","Type":"ContainerStarted","Data":"a028ff72dde884c93ab0010dbbb0d8fc64c68296e9c5e5b9f6d55b8630f18565"} Jul 17 18:56:12.476395 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:12.476361 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 18:56:12.927863 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:12.927827 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk" event={"ID":"285bf799-8464-4ea6-a7db-1e61d4c70ff5","Type":"ContainerStarted","Data":"a995b7ec51fbff7896c98846d4b4b8416ec16770c61dfaf406914381fe2de2db"} Jul 17 18:56:12.950368 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:12.950319 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk" podStartSLOduration=0.924821548 podStartE2EDuration="1.950290361s" totalImagesPullingTime="1.025468813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:56:12.947832747 +0000 UTC m=+681.979445621" watchObservedRunningTime="2026-07-17 18:56:12.950290361 +0000 UTC m=+681.981903234" Jul 17 18:56:21.633965 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:21.633934 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk" Jul 17 18:56:21.634378 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:21.633990 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk" Jul 17 18:56:21.646899 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:21.646873 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk" Jul 17 18:56:21.986920 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:21.986842 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgqk" Jul 17 18:56:31.868165 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:31.868118 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:56:33.477628 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:33.477586 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 18:56:44.597466 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:44.597363 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:56:46.665124 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:46.665088 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 18:56:51.073000 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:51.072954 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:56:53.871093 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:56:53.871056 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 18:57:52.794647 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:57:52.794614 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-649fb68f7-z94zg"] Jul 17 18:57:52.799341 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:57:52.798841 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-649fb68f7-z94zg" Jul 17 18:57:52.803271 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:57:52.803247 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rdvvm\"" Jul 17 18:57:52.803449 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:57:52.803297 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 17 18:57:52.811473 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:57:52.811452 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-649fb68f7-z94zg"] Jul 17 18:57:52.902551 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:57:52.902510 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a5c0ae18-b74c-440d-820e-7d3b12c0c92e-tls-cert\") pod \"authorino-649fb68f7-z94zg\" (UID: \"a5c0ae18-b74c-440d-820e-7d3b12c0c92e\") " pod="kuadrant-system/authorino-649fb68f7-z94zg" Jul 17 18:57:52.902719 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:57:52.902589 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zmct\" (UniqueName: \"kubernetes.io/projected/a5c0ae18-b74c-440d-820e-7d3b12c0c92e-kube-api-access-2zmct\") pod \"authorino-649fb68f7-z94zg\" (UID: \"a5c0ae18-b74c-440d-820e-7d3b12c0c92e\") " pod="kuadrant-system/authorino-649fb68f7-z94zg" Jul 17 18:57:53.003873 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:57:53.003824 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a5c0ae18-b74c-440d-820e-7d3b12c0c92e-tls-cert\") pod \"authorino-649fb68f7-z94zg\" (UID: \"a5c0ae18-b74c-440d-820e-7d3b12c0c92e\") " pod="kuadrant-system/authorino-649fb68f7-z94zg" Jul 17 18:57:53.004075 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:57:53.003934 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zmct\" (UniqueName: \"kubernetes.io/projected/a5c0ae18-b74c-440d-820e-7d3b12c0c92e-kube-api-access-2zmct\") pod \"authorino-649fb68f7-z94zg\" (UID: \"a5c0ae18-b74c-440d-820e-7d3b12c0c92e\") " pod="kuadrant-system/authorino-649fb68f7-z94zg" Jul 17 18:57:53.006506 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:57:53.006484 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a5c0ae18-b74c-440d-820e-7d3b12c0c92e-tls-cert\") pod \"authorino-649fb68f7-z94zg\" (UID: \"a5c0ae18-b74c-440d-820e-7d3b12c0c92e\") " pod="kuadrant-system/authorino-649fb68f7-z94zg" Jul 17 18:57:53.020496 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:57:53.020471 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zmct\" (UniqueName: \"kubernetes.io/projected/a5c0ae18-b74c-440d-820e-7d3b12c0c92e-kube-api-access-2zmct\") pod \"authorino-649fb68f7-z94zg\" (UID: \"a5c0ae18-b74c-440d-820e-7d3b12c0c92e\") " pod="kuadrant-system/authorino-649fb68f7-z94zg" Jul 17 18:57:53.110915 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:57:53.110890 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-649fb68f7-z94zg" Jul 17 18:57:53.271667 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:57:53.271575 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:57:53.273937 ip-10-0-131-36 kubenswrapper[2559]: W0717 18:57:53.273910 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5c0ae18_b74c_440d_820e_7d3b12c0c92e.slice/crio-b742d759495b44e56e638c309003a80f9290b712ab10378a0ef94455bcbad629 WatchSource:0}: Error finding container b742d759495b44e56e638c309003a80f9290b712ab10378a0ef94455bcbad629: Status 404 returned error can't find the container with id b742d759495b44e56e638c309003a80f9290b712ab10378a0ef94455bcbad629 Jul 17 18:57:53.280535 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:57:53.280510 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-649fb68f7-z94zg"] Jul 17 18:57:53.404436 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:57:53.404338 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:57:53.463695 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:57:53.463656 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-649fb68f7-z94zg" event={"ID":"a5c0ae18-b74c-440d-820e-7d3b12c0c92e","Type":"ContainerStarted","Data":"b742d759495b44e56e638c309003a80f9290b712ab10378a0ef94455bcbad629"} Jul 17 18:57:54.472628 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:57:54.472588 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-649fb68f7-z94zg" event={"ID":"a5c0ae18-b74c-440d-820e-7d3b12c0c92e","Type":"ContainerStarted","Data":"93623164ee5d12b7621241af1fdcbd76b9dab68bc728bce81e08f6a5e4c88494"} Jul 17 18:57:54.563611 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:57:54.563578 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:57:54.767342 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:57:54.767257 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:58:24.272097 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:58:24.271992 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-649fb68f7-z94zg" podStartSLOduration=31.815104958 podStartE2EDuration="32.271974562s" totalImagesPullingTime="456.869604ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:57:54.517661451 +0000 UTC m=+783.549274324" watchObservedRunningTime="2026-07-17 18:58:24.271974562 +0000 UTC m=+813.303587435" Jul 17 18:58:24.272608 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:58:24.272496 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 18:58:34.490091 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:58:34.490050 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 18:58:46.478008 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:58:46.477971 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 18:58:47.205035 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:58:47.205003 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:58:47.332695 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:58:47.332662 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:59:15.334612 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:59:15.334581 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 18:59:51.443757 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:59:51.443688 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jpl4k_d9bb01d7-7fed-4275-9a94-df46852eeb39/ovn-acl-logging/0.log" Jul 17 18:59:51.446840 ip-10-0-131-36 kubenswrapper[2559]: I0717 18:59:51.446820 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jpl4k_d9bb01d7-7fed-4275-9a94-df46852eeb39/ovn-acl-logging/0.log" Jul 17 19:00:01.092608 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:00:01.092576 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:00:05.417356 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:00:05.417296 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:00:27.568932 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:00:27.568893 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:00:36.840917 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:00:36.840885 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:00:36.936250 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:00:36.936217 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:00:37.069995 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:00:37.069960 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:00:42.842852 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:00:42.842818 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:00:42.946373 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:00:42.946342 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:00:43.045050 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:00:43.045019 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:00:43.194711 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:00:43.194583 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:00:49.114623 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:00:49.114589 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:00:49.512135 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:00:49.512032 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:01:05.058944 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:01:05.058912 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:01:15.959438 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:01:15.959363 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:01:23.381620 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:01:23.381559 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:01:23.481962 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:01:23.481930 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:01:28.564535 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:01:28.564498 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:01:37.552410 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:01:37.552376 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:01:40.824492 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:01:40.824453 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:01:45.579969 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:01:45.579937 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:01:45.640627 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:01:45.640597 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:01:46.057021 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:01:46.056983 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:01:56.455361 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:01:56.455324 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:02:06.997061 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:02:06.997018 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:02:16.631806 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:02:16.631769 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:02:37.961964 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:02:37.961928 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:02:47.755450 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:02:47.755369 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:03:08.193452 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:03:08.193413 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:03:13.770609 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:03:13.770564 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:03:26.452347 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:03:26.452294 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:03:42.856578 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:03:42.856541 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:03:52.565980 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:03:52.565935 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:04:02.466629 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:04:02.466594 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:04:11.365017 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:04:11.364981 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:04:20.355424 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:04:20.355385 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:04:51.478717 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:04:51.478684 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jpl4k_d9bb01d7-7fed-4275-9a94-df46852eeb39/ovn-acl-logging/0.log" Jul 17 19:04:51.483652 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:04:51.483619 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jpl4k_d9bb01d7-7fed-4275-9a94-df46852eeb39/ovn-acl-logging/0.log" Jul 17 19:06:08.862424 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:06:08.862331 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:06:20.587786 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:06:20.587753 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:06:30.672879 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:06:30.672844 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:06:42.900807 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:06:42.900765 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:06:53.778751 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:06:53.778722 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:07:04.670683 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:07:04.670651 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:07:14.055366 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:07:14.055254 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:07:26.209802 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:07:26.209762 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:07:35.907900 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:07:35.907855 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:07:44.903040 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:07:44.902999 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:07:54.762971 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:07:54.762935 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:08:09.484360 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:08:09.484327 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:08:17.375161 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:08:17.375124 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:08:22.111568 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:08:22.111531 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:08:26.663697 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:08:26.663658 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:08:36.358149 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:08:36.358110 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:08:47.358797 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:08:47.358704 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:09:04.959905 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:09:04.959866 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:09:14.864346 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:09:14.864292 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:09:24.448153 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:09:24.448117 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:09:34.642797 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:09:34.642764 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:09:43.987479 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:09:43.987440 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:09:51.523498 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:09:51.523469 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jpl4k_d9bb01d7-7fed-4275-9a94-df46852eeb39/ovn-acl-logging/0.log" Jul 17 19:09:51.525399 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:09:51.525379 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jpl4k_d9bb01d7-7fed-4275-9a94-df46852eeb39/ovn-acl-logging/0.log" Jul 17 19:09:53.778947 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:09:53.778913 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:10:07.464681 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:10:07.464644 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:10:16.259061 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:10:16.258971 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:10:26.987859 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:10:26.987824 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:10:35.041921 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:10:35.041884 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:10:40.388154 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:10:40.388113 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:10:49.687976 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:10:49.687940 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:11:00.875017 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:11:00.874979 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:11:12.869302 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:11:12.869265 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:11:25.667590 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:11:25.667553 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:11:34.862713 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:11:34.862675 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:11:47.474661 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:11:47.474578 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:11:48.385061 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:11:48.385008 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:11:55.869855 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:11:55.869809 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:11:58.559481 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:11:58.559442 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:12:04.117983 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:12:04.117946 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:12:04.557612 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:12:04.557526 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:12:04.620448 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:12:04.620420 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:12:09.245425 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:12:09.245384 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:12:12.172392 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:12:12.172356 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:12:12.338724 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:12:12.338686 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:12:12.387911 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:12:12.387881 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:12:12.631061 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:12:12.631022 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:12:19.040084 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:12:19.040042 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:12:19.159569 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:12:19.159534 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:12:19.297585 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:12:19.297492 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:12:19.718500 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:12:19.718466 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:12:19.953856 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:12:19.953823 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:12:22.447260 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:12:22.447223 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:12:22.555475 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:12:22.555442 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:12:22.776044 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:12:22.775951 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:12:22.983949 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:12:22.983914 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:12:23.767337 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:12:23.767290 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:12:24.002859 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:12:24.002831 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:12:28.672422 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:12:28.672387 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:12:58.641260 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:12:58.641223 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:13:01.762132 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:01.762097 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:13:03.087763 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:03.087725 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:13:03.230954 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:03.230922 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:13:03.469963 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:03.469843 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:13:03.752834 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:03.752728 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:13:03.849830 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:03.849798 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:13:03.973645 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:03.973605 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:13:04.371177 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:04.371127 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:13:04.592732 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:04.592698 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:13:06.748324 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:06.748284 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:13:06.908349 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:06.908297 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:13:07.058592 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:07.058492 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:13:07.459303 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:07.459249 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:13:07.561728 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:07.561693 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:13:09.860553 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:09.860516 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:13:25.094476 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:25.094373 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:13:42.305681 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:42.305642 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:13:45.180659 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:45.180624 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:13:46.806792 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:46.806751 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:13:47.027746 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:47.027688 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:13:47.269707 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:47.269674 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:13:47.531014 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:47.530924 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:13:47.854899 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:47.854869 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:13:48.151512 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:48.151427 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:13:49.950071 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:49.950038 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:13:50.063819 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:50.063786 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:13:50.237142 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:50.237052 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:13:50.578140 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:50.578050 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:13:51.156265 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:51.156231 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:13:51.272057 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:51.272020 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:13:55.898000 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:13:55.897961 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:14:26.368413 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:14:26.368373 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:14:29.292283 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:14:29.292246 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:14:30.683841 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:14:30.683803 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:14:32.030994 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:14:32.030954 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:14:32.197984 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:14:32.197951 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:14:32.473827 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:14:32.473796 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:14:32.936195 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:14:32.936160 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:14:33.055020 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:14:33.054989 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:14:35.096137 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:14:35.096106 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:14:35.247045 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:14:35.247013 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:14:35.405674 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:14:35.405576 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:14:36.044682 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:14:36.044646 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:14:36.151084 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:14:36.151019 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:14:40.567581 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:14:40.567547 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:14:51.561020 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:14:51.560993 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jpl4k_d9bb01d7-7fed-4275-9a94-df46852eeb39/ovn-acl-logging/0.log" Jul 17 19:14:51.563595 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:14:51.563575 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jpl4k_d9bb01d7-7fed-4275-9a94-df46852eeb39/ovn-acl-logging/0.log" Jul 17 19:15:00.136625 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:00.136588 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738595-x6hgt"] Jul 17 19:15:00.140016 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:00.140000 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738595-x6hgt" Jul 17 19:15:00.143908 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:00.143885 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bwjqx\"" Jul 17 19:15:00.148586 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:00.148561 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738595-x6hgt"] Jul 17 19:15:00.151902 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:00.151884 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738595-x6hgt" Jul 17 19:15:00.292891 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:00.292865 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738595-x6hgt"] Jul 17 19:15:00.295256 ip-10-0-131-36 kubenswrapper[2559]: W0717 19:15:00.295229 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad37f147_5374_4050_8d46_77ec4e3a2821.slice/crio-4418c56217ac682acdd43998f7875c4fe5a5f039c2f0cbadab2bdd9330ed69d2 WatchSource:0}: Error finding container 4418c56217ac682acdd43998f7875c4fe5a5f039c2f0cbadab2bdd9330ed69d2: Status 404 returned error can't find the container with id 4418c56217ac682acdd43998f7875c4fe5a5f039c2f0cbadab2bdd9330ed69d2 Jul 17 19:15:00.297557 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:00.297541 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 19:15:01.036625 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:01.036586 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738595-x6hgt" event={"ID":"ad37f147-5374-4050-8d46-77ec4e3a2821","Type":"ContainerStarted","Data":"4418c56217ac682acdd43998f7875c4fe5a5f039c2f0cbadab2bdd9330ed69d2"} Jul 17 19:15:03.050141 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:03.050036 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738595-x6hgt" event={"ID":"ad37f147-5374-4050-8d46-77ec4e3a2821","Type":"ContainerStarted","Data":"7c1a7072be9d3d628c847e087a196ef0b74c6612802079a11638242ec8ea83cd"} Jul 17 19:15:03.066871 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:03.066820 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738595-x6hgt" podStartSLOduration=1.076922689 podStartE2EDuration="3.066804464s" totalImagesPullingTime="1.989881775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:15:03.065666528 +0000 UTC m=+1812.097279401" watchObservedRunningTime="2026-07-17 19:15:03.066804464 +0000 UTC m=+1812.098417337" Jul 17 19:15:04.056593 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:04.056562 2559 generic.go:356] "Generic (PLEG): container finished" podID="ad37f147-5374-4050-8d46-77ec4e3a2821" containerID="7c1a7072be9d3d628c847e087a196ef0b74c6612802079a11638242ec8ea83cd" exitCode=0 Jul 17 19:15:04.056978 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:04.056663 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738595-x6hgt" event={"ID":"ad37f147-5374-4050-8d46-77ec4e3a2821","Type":"ContainerDied","Data":"7c1a7072be9d3d628c847e087a196ef0b74c6612802079a11638242ec8ea83cd"} Jul 17 19:15:05.190816 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:05.190789 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738595-x6hgt" Jul 17 19:15:06.068832 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:06.068803 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738595-x6hgt" Jul 17 19:15:06.068832 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:06.068807 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738595-x6hgt" event={"ID":"ad37f147-5374-4050-8d46-77ec4e3a2821","Type":"ContainerDied","Data":"4418c56217ac682acdd43998f7875c4fe5a5f039c2f0cbadab2bdd9330ed69d2"} Jul 17 19:15:06.069035 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:06.068849 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4418c56217ac682acdd43998f7875c4fe5a5f039c2f0cbadab2bdd9330ed69d2" Jul 17 19:15:10.833355 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:10.833298 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:15:13.854743 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:13.854699 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:15:14.984333 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:14.984259 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:15:15.167459 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:15.167420 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:15:15.398088 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:15.398054 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:15:15.856598 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:15.856558 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:15:15.955754 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:15.955722 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:15:16.056942 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:16.056908 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:15:17.492716 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:17.492674 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:15:25.420268 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:25.420223 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:15:25.520744 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:25.520703 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:15:25.642636 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:25.642603 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:15:25.739090 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:25.738993 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:15:25.836361 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:25.836321 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:15:26.228086 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:26.228051 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:15:52.223908 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:52.223865 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:15:58.576389 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:58.576335 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:15:58.680738 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:58.680693 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:15:58.783782 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:15:58.783741 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:16:14.694608 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:16:14.694570 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:16:21.261757 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:16:21.261722 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:16:21.379083 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:16:21.379038 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:16:21.478563 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:16:21.478527 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:16:32.001608 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:16:32.001565 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:16:32.792482 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:16:32.792443 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:16:39.211622 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:16:39.211582 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:16:39.367607 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:16:39.367570 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:16:39.532824 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:16:39.532726 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:16:39.626911 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:16:39.626870 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:16:40.327795 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:16:40.327755 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:16:40.431235 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:16:40.431201 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:16:42.176362 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:16:42.176305 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:16:42.655468 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:16:42.655434 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:16:48.094430 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:16:48.094400 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:16:48.195118 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:16:48.195086 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:16:48.777895 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:16:48.777856 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:16:54.457781 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:16:54.457741 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:16:55.590252 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:16:55.590210 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:16:55.760884 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:16:55.760849 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:16:55.863863 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:16:55.863771 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:16:56.194938 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:16:56.194844 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:16:56.740350 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:16:56.740304 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:16:59.359535 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:16:59.359494 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:16:59.647613 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:16:59.647517 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:16:59.829363 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:16:59.829304 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:00.396462 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:00.396420 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:00.494132 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:00.494079 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:03.756605 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:03.756573 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:04.393357 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:04.393300 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:04.493149 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:04.493110 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:04.880694 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:04.880662 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:06.655066 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:06.655033 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:17:08.410517 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:08.410478 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:11.358875 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:11.358838 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:11.449644 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:11.449611 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:22.354164 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:22.354118 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:25.360241 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:25.360202 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:17:26.773515 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:26.773478 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:27.148502 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:27.148470 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:33.420953 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:33.420918 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:33.492456 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:33.492413 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:33.712234 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:33.712144 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:33.964369 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:33.964288 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:34.115214 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:34.115162 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:34.212795 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:34.212761 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:34.339715 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:34.339682 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:40.108323 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:40.108264 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:40.229504 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:40.229457 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:40.413867 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:40.413780 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:40.644491 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:40.644450 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:46.624654 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:46.624571 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:46.702056 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:46.702027 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:53.580379 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:53.580341 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:54.086299 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:54.086259 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:54.186901 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:54.186867 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:56.640604 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:56.640564 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:56.742231 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:56.742192 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:56.833223 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:56.833187 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:57.444457 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:57.444416 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:17:57.530985 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:17:57.530933 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:18:01.177076 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:18:01.177041 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:18:03.857724 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:18:03.857673 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:18:20.502857 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:18:20.502823 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:18:23.967411 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:18:23.967375 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:18:31.820331 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:18:31.820276 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:18:56.784037 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:18:56.784000 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:19:14.360304 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:19:14.360224 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:19:15.899022 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:19:15.898977 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:19:20.391031 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:19:20.390995 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:19:22.546768 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:19:22.546725 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:19:24.961527 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:19:24.961491 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:19:27.628025 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:19:27.627992 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:19:39.506415 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:19:39.506380 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:19:51.596883 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:19:51.596852 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jpl4k_d9bb01d7-7fed-4275-9a94-df46852eeb39/ovn-acl-logging/0.log" Jul 17 19:19:51.601092 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:19:51.601071 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jpl4k_d9bb01d7-7fed-4275-9a94-df46852eeb39/ovn-acl-logging/0.log" Jul 17 19:20:04.207021 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:20:04.206979 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:20:05.204956 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:20:05.204921 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:20:10.871165 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:20:10.871127 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:20:10.977075 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:20:10.977038 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:20:11.264879 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:20:11.264791 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:20:11.429182 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:20:11.429117 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:20:12.550108 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:20:12.550072 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:20:12.703027 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:20:12.702992 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:20:13.431565 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:20:13.431514 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:20:13.630102 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:20:13.630063 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:20:13.748037 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:20:13.747949 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:20:15.055155 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:20:15.055122 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:20:15.255870 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:20:15.255826 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:20:21.771915 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:20:21.771881 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:20:21.871522 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:20:21.871492 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:20:22.205799 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:20:22.205767 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:20:24.963021 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:20:24.962977 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:20:26.440087 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:20:26.440053 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:20:26.541117 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:20:26.541072 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:20:28.821276 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:20:28.821245 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:20:28.931556 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:20:28.931522 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:20:29.030042 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:20:29.030007 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:20:39.541099 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:20:39.541061 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:20:39.868413 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:20:39.868380 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:21:00.864850 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:21:00.864752 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:21:07.079255 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:21:07.079210 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:21:07.179583 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:21:07.179546 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:21:07.471658 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:21:07.471618 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:21:07.773406 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:21:07.773304 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:21:07.911422 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:21:07.911382 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:21:10.596371 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:21:10.596335 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:21:10.703166 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:21:10.703132 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:21:10.802635 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:21:10.802604 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:21:10.903121 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:21:10.903041 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:21:11.292084 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:21:11.291993 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:21:11.392411 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:21:11.392374 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:21:15.071919 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:21:15.071867 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:21:15.417376 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:21:15.417339 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:21:15.727450 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:21:15.727353 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:21:15.866385 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:21:15.866351 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:21:16.357886 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:21:16.357855 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:21:16.705359 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:21:16.705243 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:21:28.665782 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:21:28.665745 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:21:28.764320 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:21:28.764275 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:21:30.083131 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:21:30.083099 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:21:32.192150 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:21:32.192112 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:21:32.292972 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:21:32.292930 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:21:40.358823 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:21:40.358788 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:21:40.471585 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:21:40.471547 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:21:42.812003 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:21:42.811962 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:21:43.883732 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:21:43.883695 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:21:57.293071 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:21:57.293036 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:22:01.582124 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:22:01.582085 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:22:16.205790 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:22:16.205709 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:22:27.093808 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:22:27.093770 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:22:28.047904 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:22:28.047860 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:22:28.748346 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:22:28.748294 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:22:28.846923 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:22:28.846890 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:22:31.678577 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:22:31.678541 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:22:38.823337 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:22:38.823275 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:22:43.237678 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:22:43.237627 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:22:43.693773 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:22:43.693737 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:22:45.513807 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:22:45.513769 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:22:47.969505 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:22:47.969463 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:22:49.767831 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:22:49.767794 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:22:49.836569 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:22:49.836526 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:22:50.058563 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:22:50.058468 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:22:50.294318 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:22:50.294284 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:22:50.949291 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:22:50.949251 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:22:51.051636 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:22:51.051606 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:00.918500 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:00.918454 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:03.659167 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:03.659129 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:23:05.483846 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:05.483802 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:05.912709 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:05.912650 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:12.103996 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:12.103955 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:12.209475 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:12.209440 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:12.392891 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:12.392802 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:12.615040 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:12.615006 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:12.957931 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:12.957893 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:13.300466 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:13.300381 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:13.665824 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:13.665790 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:16.293588 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:16.293557 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:16.392592 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:16.392553 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:16.481813 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:16.481782 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:16.763444 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:16.763379 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:17.184001 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:17.183968 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:17.287149 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:17.287111 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:20.831739 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:20.831702 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:21.365003 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:21.364966 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:21.735285 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:21.735200 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:21.884981 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:21.884941 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:22.069922 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:22.069832 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:23:24.401764 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:24.401720 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:24.553820 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:24.553777 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:24.680789 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:24.680679 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:25.014789 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:25.014698 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:25.472178 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:25.472117 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:25.587872 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:25.587836 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:28.910593 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:28.910546 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:32.002121 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:32.002084 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:23:37.919960 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:37.919927 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:39.662605 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:39.662574 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:41.831216 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:41.831124 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:46.492836 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:46.492803 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:46.593628 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:46.593595 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:52.815614 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:52.815573 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:55.065197 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:55.065152 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:23:57.356733 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:57.356702 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:23:57.765045 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:23:57.764963 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:03.744896 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:03.744843 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:03.846019 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:03.845969 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:04.055298 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:04.055205 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:04.310787 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:04.310671 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:20.150219 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:20.150181 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:24.579345 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:24.579277 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:24.986733 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:24.986693 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:24.995807 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:24.995771 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:24:32.586988 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:32.586944 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:32.699419 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:32.699380 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:32.914616 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:32.914586 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:33.148804 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:33.148759 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:33.520171 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:33.520139 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:33.903225 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:33.903196 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:34.066967 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:34.066932 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:36.754931 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:36.754899 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:36.943005 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:36.942967 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:37.074628 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:37.074533 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:37.270399 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:37.270361 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:37.649276 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:37.649242 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:37.749231 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:37.749189 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:41.281289 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:41.281243 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:41.629748 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:41.629710 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:42.006796 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:42.006717 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:42.311323 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:42.311217 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:42.662204 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:42.662173 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:24:43.696173 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:43.696129 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:43.800609 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:43.800573 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:44.910579 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:44.910543 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:45.043057 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:45.043013 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:45.768656 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:45.768623 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:45.894237 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:45.894202 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:49.284921 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:49.284874 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:51.632501 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:51.632475 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jpl4k_d9bb01d7-7fed-4275-9a94-df46852eeb39/ovn-acl-logging/0.log" Jul 17 19:24:51.639279 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:51.639258 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jpl4k_d9bb01d7-7fed-4275-9a94-df46852eeb39/ovn-acl-logging/0.log" Jul 17 19:24:54.666954 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:54.666920 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:24:58.522138 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:58.522106 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:24:58.622760 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:24:58.622701 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:25:00.274067 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.274033 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv"] Jul 17 19:25:00.274450 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.274434 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad37f147-5374-4050-8d46-77ec4e3a2821" containerName="cleanup" Jul 17 19:25:00.274540 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.274453 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad37f147-5374-4050-8d46-77ec4e3a2821" containerName="cleanup" Jul 17 19:25:00.274540 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.274517 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad37f147-5374-4050-8d46-77ec4e3a2821" containerName="cleanup" Jul 17 19:25:00.277545 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.277525 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" Jul 17 19:25:00.285273 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.285255 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-14077d\"/\"auth-test-model-14077d-kserve-self-signed-certs\"" Jul 17 19:25:00.285273 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.285272 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-14077d\"/\"default-dockercfg-fzqhn\"" Jul 17 19:25:00.285450 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.285274 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-14077d\"/\"openshift-service-ca.crt\"" Jul 17 19:25:00.286043 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.286026 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-14077d\"/\"kube-root-ca.crt\"" Jul 17 19:25:00.291394 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.291373 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv"] Jul 17 19:25:00.317098 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.317071 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:25:00.439266 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.439238 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3d15d7d-4298-4eee-974d-eec9af0543d0-tmp-dir\") pod \"auth-test-model-14077d-kserve-6b5b964ccf-bf9lv\" (UID: \"c3d15d7d-4298-4eee-974d-eec9af0543d0\") " pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" Jul 17 19:25:00.439478 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.439274 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3d15d7d-4298-4eee-974d-eec9af0543d0-tls-certs\") pod \"auth-test-model-14077d-kserve-6b5b964ccf-bf9lv\" (UID: \"c3d15d7d-4298-4eee-974d-eec9af0543d0\") " pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" Jul 17 19:25:00.439478 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.439303 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3d15d7d-4298-4eee-974d-eec9af0543d0-home\") pod \"auth-test-model-14077d-kserve-6b5b964ccf-bf9lv\" (UID: \"c3d15d7d-4298-4eee-974d-eec9af0543d0\") " pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" Jul 17 19:25:00.439478 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.439388 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3d15d7d-4298-4eee-974d-eec9af0543d0-model-cache\") pod \"auth-test-model-14077d-kserve-6b5b964ccf-bf9lv\" (UID: \"c3d15d7d-4298-4eee-974d-eec9af0543d0\") " pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" Jul 17 19:25:00.439478 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.439439 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bk46\" (UniqueName: \"kubernetes.io/projected/c3d15d7d-4298-4eee-974d-eec9af0543d0-kube-api-access-4bk46\") pod \"auth-test-model-14077d-kserve-6b5b964ccf-bf9lv\" (UID: \"c3d15d7d-4298-4eee-974d-eec9af0543d0\") " pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" Jul 17 19:25:00.439478 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.439463 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3d15d7d-4298-4eee-974d-eec9af0543d0-dshm\") pod \"auth-test-model-14077d-kserve-6b5b964ccf-bf9lv\" (UID: \"c3d15d7d-4298-4eee-974d-eec9af0543d0\") " pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" Jul 17 19:25:00.540237 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.540153 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bk46\" (UniqueName: \"kubernetes.io/projected/c3d15d7d-4298-4eee-974d-eec9af0543d0-kube-api-access-4bk46\") pod \"auth-test-model-14077d-kserve-6b5b964ccf-bf9lv\" (UID: \"c3d15d7d-4298-4eee-974d-eec9af0543d0\") " pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" Jul 17 19:25:00.540237 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.540196 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3d15d7d-4298-4eee-974d-eec9af0543d0-dshm\") pod \"auth-test-model-14077d-kserve-6b5b964ccf-bf9lv\" (UID: \"c3d15d7d-4298-4eee-974d-eec9af0543d0\") " pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" Jul 17 19:25:00.540237 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.540236 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3d15d7d-4298-4eee-974d-eec9af0543d0-tmp-dir\") pod \"auth-test-model-14077d-kserve-6b5b964ccf-bf9lv\" (UID: \"c3d15d7d-4298-4eee-974d-eec9af0543d0\") " pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" Jul 17 19:25:00.540545 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.540271 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3d15d7d-4298-4eee-974d-eec9af0543d0-tls-certs\") pod \"auth-test-model-14077d-kserve-6b5b964ccf-bf9lv\" (UID: \"c3d15d7d-4298-4eee-974d-eec9af0543d0\") " pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" Jul 17 19:25:00.540545 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.540363 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3d15d7d-4298-4eee-974d-eec9af0543d0-home\") pod \"auth-test-model-14077d-kserve-6b5b964ccf-bf9lv\" (UID: \"c3d15d7d-4298-4eee-974d-eec9af0543d0\") " pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" Jul 17 19:25:00.540545 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.540403 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3d15d7d-4298-4eee-974d-eec9af0543d0-model-cache\") pod \"auth-test-model-14077d-kserve-6b5b964ccf-bf9lv\" (UID: \"c3d15d7d-4298-4eee-974d-eec9af0543d0\") " pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" Jul 17 19:25:00.540688 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.540667 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3d15d7d-4298-4eee-974d-eec9af0543d0-tmp-dir\") pod \"auth-test-model-14077d-kserve-6b5b964ccf-bf9lv\" (UID: \"c3d15d7d-4298-4eee-974d-eec9af0543d0\") " pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" Jul 17 19:25:00.540763 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.540745 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3d15d7d-4298-4eee-974d-eec9af0543d0-model-cache\") pod \"auth-test-model-14077d-kserve-6b5b964ccf-bf9lv\" (UID: \"c3d15d7d-4298-4eee-974d-eec9af0543d0\") " pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" Jul 17 19:25:00.540843 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.540824 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3d15d7d-4298-4eee-974d-eec9af0543d0-home\") pod \"auth-test-model-14077d-kserve-6b5b964ccf-bf9lv\" (UID: \"c3d15d7d-4298-4eee-974d-eec9af0543d0\") " pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" Jul 17 19:25:00.542835 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.542808 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3d15d7d-4298-4eee-974d-eec9af0543d0-dshm\") pod \"auth-test-model-14077d-kserve-6b5b964ccf-bf9lv\" (UID: \"c3d15d7d-4298-4eee-974d-eec9af0543d0\") " pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" Jul 17 19:25:00.543004 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.542986 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3d15d7d-4298-4eee-974d-eec9af0543d0-tls-certs\") pod \"auth-test-model-14077d-kserve-6b5b964ccf-bf9lv\" (UID: \"c3d15d7d-4298-4eee-974d-eec9af0543d0\") " pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" Jul 17 19:25:00.550194 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.550170 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bk46\" (UniqueName: \"kubernetes.io/projected/c3d15d7d-4298-4eee-974d-eec9af0543d0-kube-api-access-4bk46\") pod \"auth-test-model-14077d-kserve-6b5b964ccf-bf9lv\" (UID: \"c3d15d7d-4298-4eee-974d-eec9af0543d0\") " pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" Jul 17 19:25:00.586753 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.586724 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" Jul 17 19:25:00.722177 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:00.722152 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv"] Jul 17 19:25:00.724555 ip-10-0-131-36 kubenswrapper[2559]: W0717 19:25:00.724525 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3d15d7d_4298_4eee_974d_eec9af0543d0.slice/crio-205e12b029868a6ac3d50a4ec2858944211a7e5f54bc58f2d6b0dce759f3e8f2 WatchSource:0}: Error finding container 205e12b029868a6ac3d50a4ec2858944211a7e5f54bc58f2d6b0dce759f3e8f2: Status 404 returned error can't find the container with id 205e12b029868a6ac3d50a4ec2858944211a7e5f54bc58f2d6b0dce759f3e8f2 Jul 17 19:25:01.329238 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:01.329204 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" event={"ID":"c3d15d7d-4298-4eee-974d-eec9af0543d0","Type":"ContainerStarted","Data":"6f724caf41b9ffd9ee8dfc604823773eb3eb32e7fa01753531eb14826f91b427"} Jul 17 19:25:01.329238 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:01.329243 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" event={"ID":"c3d15d7d-4298-4eee-974d-eec9af0543d0","Type":"ContainerStarted","Data":"205e12b029868a6ac3d50a4ec2858944211a7e5f54bc58f2d6b0dce759f3e8f2"} Jul 17 19:25:01.348993 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:01.348943 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" podStartSLOduration=1.348926044 podStartE2EDuration="1.348926044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:25:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:25:01.346576225 +0000 UTC m=+2410.378189097" watchObservedRunningTime="2026-07-17 19:25:01.348926044 +0000 UTC m=+2410.380538917" Jul 17 19:25:04.260940 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:04.260895 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:25:06.684219 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:06.684189 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:25:06.788117 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:06.788080 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:25:10.587638 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:10.587598 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" Jul 17 19:25:10.588091 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:10.587680 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" Jul 17 19:25:10.600169 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:10.600147 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" Jul 17 19:25:11.396879 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:11.396850 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" Jul 17 19:25:27.568505 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:27.568442 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:25:27.669067 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:27.669026 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:25:35.839698 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:35.839653 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:25:39.808255 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:25:39.808220 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:26:01.863424 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:26:01.863384 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:26:20.420005 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:26:20.419970 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:26:38.688278 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:26:38.688245 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:26:57.073325 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:26:57.069905 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:27:10.367769 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:27:10.367730 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:27:29.593154 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:27:29.593116 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:27:49.436260 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:27:49.436222 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:27:54.051852 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:27:54.051810 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv"] Jul 17 19:27:54.150991 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:27:54.150956 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:27:55.278781 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:27:55.278745 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:28:07.475051 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:07.475014 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:28:09.072461 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.072418 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" podUID="c3d15d7d-4298-4eee-974d-eec9af0543d0" containerName="main" containerID="cri-o://6f724caf41b9ffd9ee8dfc604823773eb3eb32e7fa01753531eb14826f91b427" gracePeriod=45 Jul 17 19:28:09.325180 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.325114 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" Jul 17 19:28:09.364328 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.364289 2559 generic.go:356] "Generic (PLEG): container finished" podID="c3d15d7d-4298-4eee-974d-eec9af0543d0" containerID="6f724caf41b9ffd9ee8dfc604823773eb3eb32e7fa01753531eb14826f91b427" exitCode=0 Jul 17 19:28:09.364480 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.364354 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" Jul 17 19:28:09.364480 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.364353 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" event={"ID":"c3d15d7d-4298-4eee-974d-eec9af0543d0","Type":"ContainerDied","Data":"6f724caf41b9ffd9ee8dfc604823773eb3eb32e7fa01753531eb14826f91b427"} Jul 17 19:28:09.364845 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.364477 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv" event={"ID":"c3d15d7d-4298-4eee-974d-eec9af0543d0","Type":"ContainerDied","Data":"205e12b029868a6ac3d50a4ec2858944211a7e5f54bc58f2d6b0dce759f3e8f2"} Jul 17 19:28:09.364845 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.364503 2559 scope.go:117] "RemoveContainer" containerID="6f724caf41b9ffd9ee8dfc604823773eb3eb32e7fa01753531eb14826f91b427" Jul 17 19:28:09.373424 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.373404 2559 scope.go:117] "RemoveContainer" containerID="6f724caf41b9ffd9ee8dfc604823773eb3eb32e7fa01753531eb14826f91b427" Jul 17 19:28:09.373683 ip-10-0-131-36 kubenswrapper[2559]: E0717 19:28:09.373665 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f724caf41b9ffd9ee8dfc604823773eb3eb32e7fa01753531eb14826f91b427\": container with ID starting with 6f724caf41b9ffd9ee8dfc604823773eb3eb32e7fa01753531eb14826f91b427 not found: ID does not exist" containerID="6f724caf41b9ffd9ee8dfc604823773eb3eb32e7fa01753531eb14826f91b427" Jul 17 19:28:09.373745 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.373694 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f724caf41b9ffd9ee8dfc604823773eb3eb32e7fa01753531eb14826f91b427"} err="failed to get container status \"6f724caf41b9ffd9ee8dfc604823773eb3eb32e7fa01753531eb14826f91b427\": rpc error: code = NotFound desc = could not find container \"6f724caf41b9ffd9ee8dfc604823773eb3eb32e7fa01753531eb14826f91b427\": container with ID starting with 6f724caf41b9ffd9ee8dfc604823773eb3eb32e7fa01753531eb14826f91b427 not found: ID does not exist" Jul 17 19:28:09.394136 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.394112 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3d15d7d-4298-4eee-974d-eec9af0543d0-tls-certs\") pod \"c3d15d7d-4298-4eee-974d-eec9af0543d0\" (UID: \"c3d15d7d-4298-4eee-974d-eec9af0543d0\") " Jul 17 19:28:09.394230 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.394170 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3d15d7d-4298-4eee-974d-eec9af0543d0-model-cache\") pod \"c3d15d7d-4298-4eee-974d-eec9af0543d0\" (UID: \"c3d15d7d-4298-4eee-974d-eec9af0543d0\") " Jul 17 19:28:09.394230 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.394203 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3d15d7d-4298-4eee-974d-eec9af0543d0-dshm\") pod \"c3d15d7d-4298-4eee-974d-eec9af0543d0\" (UID: \"c3d15d7d-4298-4eee-974d-eec9af0543d0\") " Jul 17 19:28:09.394357 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.394266 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3d15d7d-4298-4eee-974d-eec9af0543d0-home\") pod \"c3d15d7d-4298-4eee-974d-eec9af0543d0\" (UID: \"c3d15d7d-4298-4eee-974d-eec9af0543d0\") " Jul 17 19:28:09.394357 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.394299 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3d15d7d-4298-4eee-974d-eec9af0543d0-tmp-dir\") pod \"c3d15d7d-4298-4eee-974d-eec9af0543d0\" (UID: \"c3d15d7d-4298-4eee-974d-eec9af0543d0\") " Jul 17 19:28:09.394357 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.394344 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bk46\" (UniqueName: \"kubernetes.io/projected/c3d15d7d-4298-4eee-974d-eec9af0543d0-kube-api-access-4bk46\") pod \"c3d15d7d-4298-4eee-974d-eec9af0543d0\" (UID: \"c3d15d7d-4298-4eee-974d-eec9af0543d0\") " Jul 17 19:28:09.394521 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.394470 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3d15d7d-4298-4eee-974d-eec9af0543d0-model-cache" (OuterVolumeSpecName: "model-cache") pod "c3d15d7d-4298-4eee-974d-eec9af0543d0" (UID: "c3d15d7d-4298-4eee-974d-eec9af0543d0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 19:28:09.394649 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.394608 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3d15d7d-4298-4eee-974d-eec9af0543d0-home" (OuterVolumeSpecName: "home") pod "c3d15d7d-4298-4eee-974d-eec9af0543d0" (UID: "c3d15d7d-4298-4eee-974d-eec9af0543d0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 19:28:09.394725 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.394652 2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3d15d7d-4298-4eee-974d-eec9af0543d0-model-cache\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 19:28:09.394725 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.394651 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3d15d7d-4298-4eee-974d-eec9af0543d0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c3d15d7d-4298-4eee-974d-eec9af0543d0" (UID: "c3d15d7d-4298-4eee-974d-eec9af0543d0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 19:28:09.396419 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.396395 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3d15d7d-4298-4eee-974d-eec9af0543d0-dshm" (OuterVolumeSpecName: "dshm") pod "c3d15d7d-4298-4eee-974d-eec9af0543d0" (UID: "c3d15d7d-4298-4eee-974d-eec9af0543d0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 19:28:09.396523 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.396459 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3d15d7d-4298-4eee-974d-eec9af0543d0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c3d15d7d-4298-4eee-974d-eec9af0543d0" (UID: "c3d15d7d-4298-4eee-974d-eec9af0543d0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 19:28:09.396610 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.396581 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3d15d7d-4298-4eee-974d-eec9af0543d0-kube-api-access-4bk46" (OuterVolumeSpecName: "kube-api-access-4bk46") pod "c3d15d7d-4298-4eee-974d-eec9af0543d0" (UID: "c3d15d7d-4298-4eee-974d-eec9af0543d0"). InnerVolumeSpecName "kube-api-access-4bk46". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 19:28:09.495250 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.495217 2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3d15d7d-4298-4eee-974d-eec9af0543d0-home\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 19:28:09.495378 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.495263 2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3d15d7d-4298-4eee-974d-eec9af0543d0-tmp-dir\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 19:28:09.495378 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.495279 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bk46\" (UniqueName: \"kubernetes.io/projected/c3d15d7d-4298-4eee-974d-eec9af0543d0-kube-api-access-4bk46\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 19:28:09.495378 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.495293 2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3d15d7d-4298-4eee-974d-eec9af0543d0-tls-certs\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 19:28:09.495378 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.495306 2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3d15d7d-4298-4eee-974d-eec9af0543d0-dshm\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 19:28:09.690546 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.690513 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv"] Jul 17 19:28:09.700628 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:09.700598 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-14077d/auth-test-model-14077d-kserve-6b5b964ccf-bf9lv"] Jul 17 19:28:10.760041 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:10.760001 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:28:11.489386 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:11.489353 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3d15d7d-4298-4eee-974d-eec9af0543d0" path="/var/lib/kubelet/pods/c3d15d7d-4298-4eee-974d-eec9af0543d0/volumes" Jul 17 19:28:14.873650 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:14.873607 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:28:41.856167 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:41.856124 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq"] Jul 17 19:28:41.856763 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:41.856707 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3d15d7d-4298-4eee-974d-eec9af0543d0" containerName="main" Jul 17 19:28:41.856763 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:41.856721 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3d15d7d-4298-4eee-974d-eec9af0543d0" containerName="main" Jul 17 19:28:41.856875 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:41.856792 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3d15d7d-4298-4eee-974d-eec9af0543d0" containerName="main" Jul 17 19:28:41.859844 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:41.859825 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" Jul 17 19:28:41.862202 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:41.862183 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2dc31c\"/\"kube-root-ca.crt\"" Jul 17 19:28:41.863119 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:41.863097 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2dc31c\"/\"sub-test-model-2dc31c-kserve-self-signed-certs\"" Jul 17 19:28:41.863240 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:41.863136 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2dc31c\"/\"default-dockercfg-wj7qc\"" Jul 17 19:28:41.863240 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:41.863136 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2dc31c\"/\"openshift-service-ca.crt\"" Jul 17 19:28:41.870097 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:41.870070 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq"] Jul 17 19:28:41.896324 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:41.896290 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:28:41.996799 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:41.996768 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-home\") pod \"sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq\" (UID: \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\") " pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" Jul 17 19:28:41.996996 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:41.996828 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-dshm\") pod \"sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq\" (UID: \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\") " pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" Jul 17 19:28:41.996996 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:41.996893 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6nqd\" (UniqueName: \"kubernetes.io/projected/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-kube-api-access-m6nqd\") pod \"sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq\" (UID: \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\") " pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" Jul 17 19:28:41.996996 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:41.996953 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-model-cache\") pod \"sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq\" (UID: \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\") " pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" Jul 17 19:28:41.996996 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:41.996977 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-tmp-dir\") pod \"sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq\" (UID: \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\") " pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" Jul 17 19:28:41.997156 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:41.997014 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-tls-certs\") pod \"sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq\" (UID: \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\") " pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" Jul 17 19:28:42.097713 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:42.097675 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-home\") pod \"sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq\" (UID: \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\") " pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" Jul 17 19:28:42.097891 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:42.097731 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-dshm\") pod \"sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq\" (UID: \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\") " pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" Jul 17 19:28:42.097891 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:42.097765 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6nqd\" (UniqueName: \"kubernetes.io/projected/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-kube-api-access-m6nqd\") pod \"sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq\" (UID: \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\") " pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" Jul 17 19:28:42.097891 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:42.097791 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-model-cache\") pod \"sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq\" (UID: \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\") " pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" Jul 17 19:28:42.097891 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:42.097816 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-tmp-dir\") pod \"sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq\" (UID: \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\") " pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" Jul 17 19:28:42.097891 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:42.097840 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-tls-certs\") pod \"sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq\" (UID: \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\") " pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" Jul 17 19:28:42.098147 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:42.098124 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-home\") pod \"sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq\" (UID: \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\") " pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" Jul 17 19:28:42.098192 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:42.098152 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-model-cache\") pod \"sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq\" (UID: \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\") " pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" Jul 17 19:28:42.098227 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:42.098202 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-tmp-dir\") pod \"sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq\" (UID: \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\") " pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" Jul 17 19:28:42.100281 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:42.100261 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-dshm\") pod \"sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq\" (UID: \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\") " pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" Jul 17 19:28:42.100449 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:42.100431 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-tls-certs\") pod \"sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq\" (UID: \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\") " pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" Jul 17 19:28:42.107777 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:42.107714 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6nqd\" (UniqueName: \"kubernetes.io/projected/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-kube-api-access-m6nqd\") pod \"sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq\" (UID: \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\") " pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" Jul 17 19:28:42.171329 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:42.171279 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" Jul 17 19:28:42.318461 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:42.318436 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq"] Jul 17 19:28:42.319510 ip-10-0-131-36 kubenswrapper[2559]: W0717 19:28:42.319472 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podefb6c7c5_8eae_401d_9f73_9ee467a62fa3.slice/crio-97be2d9e891f432397fa8ed4cfc448ddfe8c891e55f3071ef525334c2b50026b WatchSource:0}: Error finding container 97be2d9e891f432397fa8ed4cfc448ddfe8c891e55f3071ef525334c2b50026b: Status 404 returned error can't find the container with id 97be2d9e891f432397fa8ed4cfc448ddfe8c891e55f3071ef525334c2b50026b Jul 17 19:28:42.543584 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:42.543548 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" event={"ID":"efb6c7c5-8eae-401d-9f73-9ee467a62fa3","Type":"ContainerStarted","Data":"0f539b485b8e765bcc2a0d00e5c332cd335b8addb5ae3dd9841528132eefb145"} Jul 17 19:28:42.543584 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:42.543585 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" event={"ID":"efb6c7c5-8eae-401d-9f73-9ee467a62fa3","Type":"ContainerStarted","Data":"97be2d9e891f432397fa8ed4cfc448ddfe8c891e55f3071ef525334c2b50026b"} Jul 17 19:28:42.582381 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:42.582334 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" podStartSLOduration=1.582298573 podStartE2EDuration="1.582298573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:28:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:28:42.579754173 +0000 UTC m=+2631.611367048" watchObservedRunningTime="2026-07-17 19:28:42.582298573 +0000 UTC m=+2631.613911447" Jul 17 19:28:45.659197 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:45.659159 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:28:52.171870 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:52.171836 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" Jul 17 19:28:52.172338 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:52.171917 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" Jul 17 19:28:52.184909 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:52.184885 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" Jul 17 19:28:52.609082 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:52.609047 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" Jul 17 19:28:59.367206 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:28:59.367168 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:29:17.698597 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:17.698557 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:29:25.491467 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:25.491432 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:29:26.332292 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:26.332260 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq"] Jul 17 19:29:26.360062 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:26.360032 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:29:34.177570 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:34.177536 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:29:37.470794 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:37.470760 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:29:39.605172 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:39.605130 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:29:41.353412 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.353365 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" podUID="efb6c7c5-8eae-401d-9f73-9ee467a62fa3" containerName="main" containerID="cri-o://0f539b485b8e765bcc2a0d00e5c332cd335b8addb5ae3dd9841528132eefb145" gracePeriod=45 Jul 17 19:29:41.608734 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.608667 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" Jul 17 19:29:41.723050 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.722966 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-dshm\") pod \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\" (UID: \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\") " Jul 17 19:29:41.723050 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.723005 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-tmp-dir\") pod \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\" (UID: \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\") " Jul 17 19:29:41.723050 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.723025 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-tls-certs\") pod \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\" (UID: \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\") " Jul 17 19:29:41.723380 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.723079 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-model-cache\") pod \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\" (UID: \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\") " Jul 17 19:29:41.723380 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.723105 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6nqd\" (UniqueName: \"kubernetes.io/projected/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-kube-api-access-m6nqd\") pod \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\" (UID: \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\") " Jul 17 19:29:41.723380 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.723168 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-home\") pod \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\" (UID: \"efb6c7c5-8eae-401d-9f73-9ee467a62fa3\") " Jul 17 19:29:41.723380 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.723281 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "efb6c7c5-8eae-401d-9f73-9ee467a62fa3" (UID: "efb6c7c5-8eae-401d-9f73-9ee467a62fa3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 19:29:41.723598 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.723389 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-model-cache" (OuterVolumeSpecName: "model-cache") pod "efb6c7c5-8eae-401d-9f73-9ee467a62fa3" (UID: "efb6c7c5-8eae-401d-9f73-9ee467a62fa3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 19:29:41.723598 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.723492 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-home" (OuterVolumeSpecName: "home") pod "efb6c7c5-8eae-401d-9f73-9ee467a62fa3" (UID: "efb6c7c5-8eae-401d-9f73-9ee467a62fa3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 19:29:41.723598 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.723547 2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-tmp-dir\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 19:29:41.723598 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.723566 2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-model-cache\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 19:29:41.725470 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.725441 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "efb6c7c5-8eae-401d-9f73-9ee467a62fa3" (UID: "efb6c7c5-8eae-401d-9f73-9ee467a62fa3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 19:29:41.725470 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.725440 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-kube-api-access-m6nqd" (OuterVolumeSpecName: "kube-api-access-m6nqd") pod "efb6c7c5-8eae-401d-9f73-9ee467a62fa3" (UID: "efb6c7c5-8eae-401d-9f73-9ee467a62fa3"). InnerVolumeSpecName "kube-api-access-m6nqd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 19:29:41.725470 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.725463 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-dshm" (OuterVolumeSpecName: "dshm") pod "efb6c7c5-8eae-401d-9f73-9ee467a62fa3" (UID: "efb6c7c5-8eae-401d-9f73-9ee467a62fa3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 19:29:41.824300 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.824258 2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-home\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 19:29:41.824300 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.824291 2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-dshm\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 19:29:41.824300 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.824299 2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-tls-certs\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 19:29:41.824568 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.824342 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6nqd\" (UniqueName: \"kubernetes.io/projected/efb6c7c5-8eae-401d-9f73-9ee467a62fa3-kube-api-access-m6nqd\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 19:29:41.879452 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.879369 2559 generic.go:356] "Generic (PLEG): container finished" podID="efb6c7c5-8eae-401d-9f73-9ee467a62fa3" containerID="0f539b485b8e765bcc2a0d00e5c332cd335b8addb5ae3dd9841528132eefb145" exitCode=0 Jul 17 19:29:41.879452 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.879416 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" Jul 17 19:29:41.879636 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.879453 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" event={"ID":"efb6c7c5-8eae-401d-9f73-9ee467a62fa3","Type":"ContainerDied","Data":"0f539b485b8e765bcc2a0d00e5c332cd335b8addb5ae3dd9841528132eefb145"} Jul 17 19:29:41.879636 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.879494 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq" event={"ID":"efb6c7c5-8eae-401d-9f73-9ee467a62fa3","Type":"ContainerDied","Data":"97be2d9e891f432397fa8ed4cfc448ddfe8c891e55f3071ef525334c2b50026b"} Jul 17 19:29:41.879636 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.879515 2559 scope.go:117] "RemoveContainer" containerID="0f539b485b8e765bcc2a0d00e5c332cd335b8addb5ae3dd9841528132eefb145" Jul 17 19:29:41.889080 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.889062 2559 scope.go:117] "RemoveContainer" containerID="0f539b485b8e765bcc2a0d00e5c332cd335b8addb5ae3dd9841528132eefb145" Jul 17 19:29:41.889340 ip-10-0-131-36 kubenswrapper[2559]: E0717 19:29:41.889295 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f539b485b8e765bcc2a0d00e5c332cd335b8addb5ae3dd9841528132eefb145\": container with ID starting with 0f539b485b8e765bcc2a0d00e5c332cd335b8addb5ae3dd9841528132eefb145 not found: ID does not exist" containerID="0f539b485b8e765bcc2a0d00e5c332cd335b8addb5ae3dd9841528132eefb145" Jul 17 19:29:41.889389 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.889356 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f539b485b8e765bcc2a0d00e5c332cd335b8addb5ae3dd9841528132eefb145"} err="failed to get container status \"0f539b485b8e765bcc2a0d00e5c332cd335b8addb5ae3dd9841528132eefb145\": rpc error: code = NotFound desc = could not find container \"0f539b485b8e765bcc2a0d00e5c332cd335b8addb5ae3dd9841528132eefb145\": container with ID starting with 0f539b485b8e765bcc2a0d00e5c332cd335b8addb5ae3dd9841528132eefb145 not found: ID does not exist" Jul 17 19:29:41.922872 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.922846 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq"] Jul 17 19:29:41.927386 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:41.927363 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-2dc31c/sub-test-model-2dc31c-kserve-579f6bf7b7-xxjtq"] Jul 17 19:29:43.488158 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:43.488119 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efb6c7c5-8eae-401d-9f73-9ee467a62fa3" path="/var/lib/kubelet/pods/efb6c7c5-8eae-401d-9f73-9ee467a62fa3/volumes" Jul 17 19:29:50.702884 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.702847 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm"] Jul 17 19:29:50.703277 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.703221 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efb6c7c5-8eae-401d-9f73-9ee467a62fa3" containerName="main" Jul 17 19:29:50.703277 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.703231 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="efb6c7c5-8eae-401d-9f73-9ee467a62fa3" containerName="main" Jul 17 19:29:50.703375 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.703291 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="efb6c7c5-8eae-401d-9f73-9ee467a62fa3" containerName="main" Jul 17 19:29:50.707929 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.707907 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" Jul 17 19:29:50.714983 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.714959 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2dc31c\"/\"kube-root-ca.crt\"" Jul 17 19:29:50.715112 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.715083 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2dc31c\"/\"default-dockercfg-wj7qc\"" Jul 17 19:29:50.715195 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.715125 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2dc31c\"/\"openshift-service-ca.crt\"" Jul 17 19:29:50.715257 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.715226 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2dc31c\"/\"rate-test-model-2dc31c-kserve-self-signed-certs\"" Jul 17 19:29:50.725067 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.725043 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm"] Jul 17 19:29:50.735808 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.735778 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:29:50.803722 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.803695 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0635da18-37bb-4371-a7a4-c95bed5efeef-dshm\") pod \"rate-test-model-2dc31c-kserve-664f7cc599-lznwm\" (UID: \"0635da18-37bb-4371-a7a4-c95bed5efeef\") " pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" Jul 17 19:29:50.803877 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.803731 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0635da18-37bb-4371-a7a4-c95bed5efeef-tmp-dir\") pod \"rate-test-model-2dc31c-kserve-664f7cc599-lznwm\" (UID: \"0635da18-37bb-4371-a7a4-c95bed5efeef\") " pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" Jul 17 19:29:50.803877 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.803751 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0635da18-37bb-4371-a7a4-c95bed5efeef-model-cache\") pod \"rate-test-model-2dc31c-kserve-664f7cc599-lznwm\" (UID: \"0635da18-37bb-4371-a7a4-c95bed5efeef\") " pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" Jul 17 19:29:50.803877 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.803828 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0635da18-37bb-4371-a7a4-c95bed5efeef-home\") pod \"rate-test-model-2dc31c-kserve-664f7cc599-lznwm\" (UID: \"0635da18-37bb-4371-a7a4-c95bed5efeef\") " pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" Jul 17 19:29:50.803877 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.803853 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7gdc\" (UniqueName: \"kubernetes.io/projected/0635da18-37bb-4371-a7a4-c95bed5efeef-kube-api-access-k7gdc\") pod \"rate-test-model-2dc31c-kserve-664f7cc599-lznwm\" (UID: \"0635da18-37bb-4371-a7a4-c95bed5efeef\") " pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" Jul 17 19:29:50.804038 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.803889 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0635da18-37bb-4371-a7a4-c95bed5efeef-tls-certs\") pod \"rate-test-model-2dc31c-kserve-664f7cc599-lznwm\" (UID: \"0635da18-37bb-4371-a7a4-c95bed5efeef\") " pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" Jul 17 19:29:50.904858 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.904824 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0635da18-37bb-4371-a7a4-c95bed5efeef-tls-certs\") pod \"rate-test-model-2dc31c-kserve-664f7cc599-lznwm\" (UID: \"0635da18-37bb-4371-a7a4-c95bed5efeef\") " pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" Jul 17 19:29:50.905060 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.904885 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0635da18-37bb-4371-a7a4-c95bed5efeef-dshm\") pod \"rate-test-model-2dc31c-kserve-664f7cc599-lznwm\" (UID: \"0635da18-37bb-4371-a7a4-c95bed5efeef\") " pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" Jul 17 19:29:50.905060 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.904911 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0635da18-37bb-4371-a7a4-c95bed5efeef-tmp-dir\") pod \"rate-test-model-2dc31c-kserve-664f7cc599-lznwm\" (UID: \"0635da18-37bb-4371-a7a4-c95bed5efeef\") " pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" Jul 17 19:29:50.905060 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.904930 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0635da18-37bb-4371-a7a4-c95bed5efeef-model-cache\") pod \"rate-test-model-2dc31c-kserve-664f7cc599-lznwm\" (UID: \"0635da18-37bb-4371-a7a4-c95bed5efeef\") " pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" Jul 17 19:29:50.905060 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.904978 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0635da18-37bb-4371-a7a4-c95bed5efeef-home\") pod \"rate-test-model-2dc31c-kserve-664f7cc599-lznwm\" (UID: \"0635da18-37bb-4371-a7a4-c95bed5efeef\") " pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" Jul 17 19:29:50.905060 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.905003 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7gdc\" (UniqueName: \"kubernetes.io/projected/0635da18-37bb-4371-a7a4-c95bed5efeef-kube-api-access-k7gdc\") pod \"rate-test-model-2dc31c-kserve-664f7cc599-lznwm\" (UID: \"0635da18-37bb-4371-a7a4-c95bed5efeef\") " pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" Jul 17 19:29:50.905500 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.905460 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0635da18-37bb-4371-a7a4-c95bed5efeef-tmp-dir\") pod \"rate-test-model-2dc31c-kserve-664f7cc599-lznwm\" (UID: \"0635da18-37bb-4371-a7a4-c95bed5efeef\") " pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" Jul 17 19:29:50.905640 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.905505 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0635da18-37bb-4371-a7a4-c95bed5efeef-model-cache\") pod \"rate-test-model-2dc31c-kserve-664f7cc599-lznwm\" (UID: \"0635da18-37bb-4371-a7a4-c95bed5efeef\") " pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" Jul 17 19:29:50.905640 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.905474 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0635da18-37bb-4371-a7a4-c95bed5efeef-home\") pod \"rate-test-model-2dc31c-kserve-664f7cc599-lznwm\" (UID: \"0635da18-37bb-4371-a7a4-c95bed5efeef\") " pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" Jul 17 19:29:50.907436 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.907409 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0635da18-37bb-4371-a7a4-c95bed5efeef-dshm\") pod \"rate-test-model-2dc31c-kserve-664f7cc599-lznwm\" (UID: \"0635da18-37bb-4371-a7a4-c95bed5efeef\") " pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" Jul 17 19:29:50.907765 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.907749 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0635da18-37bb-4371-a7a4-c95bed5efeef-tls-certs\") pod \"rate-test-model-2dc31c-kserve-664f7cc599-lznwm\" (UID: \"0635da18-37bb-4371-a7a4-c95bed5efeef\") " pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" Jul 17 19:29:50.917427 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:50.917404 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7gdc\" (UniqueName: \"kubernetes.io/projected/0635da18-37bb-4371-a7a4-c95bed5efeef-kube-api-access-k7gdc\") pod \"rate-test-model-2dc31c-kserve-664f7cc599-lznwm\" (UID: \"0635da18-37bb-4371-a7a4-c95bed5efeef\") " pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" Jul 17 19:29:51.017185 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:51.017083 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" Jul 17 19:29:51.174366 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:51.174341 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm"] Jul 17 19:29:51.176481 ip-10-0-131-36 kubenswrapper[2559]: W0717 19:29:51.176448 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0635da18_37bb_4371_a7a4_c95bed5efeef.slice/crio-18418fce79385c9b480d77a14fba9d9fd18d5cd572749b1a3741904be2d15c78 WatchSource:0}: Error finding container 18418fce79385c9b480d77a14fba9d9fd18d5cd572749b1a3741904be2d15c78: Status 404 returned error can't find the container with id 18418fce79385c9b480d77a14fba9d9fd18d5cd572749b1a3741904be2d15c78 Jul 17 19:29:51.673371 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:51.673340 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jpl4k_d9bb01d7-7fed-4275-9a94-df46852eeb39/ovn-acl-logging/0.log" Jul 17 19:29:51.682575 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:51.682548 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jpl4k_d9bb01d7-7fed-4275-9a94-df46852eeb39/ovn-acl-logging/0.log" Jul 17 19:29:51.947025 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:51.946927 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" event={"ID":"0635da18-37bb-4371-a7a4-c95bed5efeef","Type":"ContainerStarted","Data":"48f377f97fefbc7afbe780fc519f0ead0ec1148d8248817031afcd4f3ea86258"} Jul 17 19:29:51.947025 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:51.946967 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" event={"ID":"0635da18-37bb-4371-a7a4-c95bed5efeef","Type":"ContainerStarted","Data":"18418fce79385c9b480d77a14fba9d9fd18d5cd572749b1a3741904be2d15c78"} Jul 17 19:29:51.975993 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:51.975926 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" podStartSLOduration=1.975908718 podStartE2EDuration="1.975908718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:29:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:29:51.973613933 +0000 UTC m=+2701.005226806" watchObservedRunningTime="2026-07-17 19:29:51.975908718 +0000 UTC m=+2701.007521594" Jul 17 19:29:54.366208 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:54.366175 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:29:59.550232 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:59.550194 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:29:59.704845 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:29:59.704805 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:30:00.199050 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:00.199019 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-14077d-29738610-lqdkv"] Jul 17 19:30:00.202477 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:00.202461 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-14077d-29738610-lqdkv" Jul 17 19:30:00.209114 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:00.209094 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bwjqx\"" Jul 17 19:30:00.212738 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:00.212723 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-14077d-29738610-lqdkv" Jul 17 19:30:00.223360 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:00.223336 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-14077d-29738610-lqdkv"] Jul 17 19:30:00.568167 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:00.568142 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-14077d-29738610-lqdkv"] Jul 17 19:30:00.570975 ip-10-0-131-36 kubenswrapper[2559]: W0717 19:30:00.570946 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod038937c5_9a10_440e_9226_47cfe2643b0c.slice/crio-8cea683d1023b98d7cf79629b7e570c1bb735a65b9003d3a6de3ceead2b1ea0a WatchSource:0}: Error finding container 8cea683d1023b98d7cf79629b7e570c1bb735a65b9003d3a6de3ceead2b1ea0a: Status 404 returned error can't find the container with id 8cea683d1023b98d7cf79629b7e570c1bb735a65b9003d3a6de3ceead2b1ea0a Jul 17 19:30:01.003623 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:01.003594 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-14077d-29738610-lqdkv" event={"ID":"038937c5-9a10-440e-9226-47cfe2643b0c","Type":"ContainerStarted","Data":"dbd349c89fe5705f4718e155abc4f8f788c0cda07df207b6d852bda5260817a5"} Jul 17 19:30:01.003793 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:01.003655 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-14077d-29738610-lqdkv" event={"ID":"038937c5-9a10-440e-9226-47cfe2643b0c","Type":"ContainerStarted","Data":"8cea683d1023b98d7cf79629b7e570c1bb735a65b9003d3a6de3ceead2b1ea0a"} Jul 17 19:30:01.017568 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:01.017545 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" Jul 17 19:30:01.017659 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:01.017578 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" Jul 17 19:30:01.030063 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:01.030035 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" Jul 17 19:30:01.039038 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:01.038996 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-14077d-29738610-lqdkv" podStartSLOduration=1.038982425 podStartE2EDuration="1.038982425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:30:01.037918079 +0000 UTC m=+2710.069530951" watchObservedRunningTime="2026-07-17 19:30:01.038982425 +0000 UTC m=+2710.070595342" Jul 17 19:30:02.010354 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:02.010302 2559 generic.go:356] "Generic (PLEG): container finished" podID="038937c5-9a10-440e-9226-47cfe2643b0c" containerID="dbd349c89fe5705f4718e155abc4f8f788c0cda07df207b6d852bda5260817a5" exitCode=0 Jul 17 19:30:02.010835 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:02.010373 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-14077d-29738610-lqdkv" event={"ID":"038937c5-9a10-440e-9226-47cfe2643b0c","Type":"ContainerDied","Data":"dbd349c89fe5705f4718e155abc4f8f788c0cda07df207b6d852bda5260817a5"} Jul 17 19:30:02.021779 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:02.021752 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" Jul 17 19:30:03.147534 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:03.147510 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-14077d-29738610-lqdkv" Jul 17 19:30:04.022199 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:04.022173 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-14077d-29738610-lqdkv" Jul 17 19:30:04.022394 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:04.022219 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-14077d-29738610-lqdkv" event={"ID":"038937c5-9a10-440e-9226-47cfe2643b0c","Type":"ContainerDied","Data":"8cea683d1023b98d7cf79629b7e570c1bb735a65b9003d3a6de3ceead2b1ea0a"} Jul 17 19:30:04.022394 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:04.022269 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8cea683d1023b98d7cf79629b7e570c1bb735a65b9003d3a6de3ceead2b1ea0a" Jul 17 19:30:07.616082 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:07.616042 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:30:07.722832 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:07.722796 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:30:11.617003 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:11.616969 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:30:17.896977 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:17.896943 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:30:28.623464 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:28.623411 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:30:28.741783 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:28.741744 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:30:32.974041 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:32.973998 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:30:38.767401 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:38.767363 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:30:39.556438 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:39.556407 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm"] Jul 17 19:30:39.576620 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:39.576593 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:30:40.601244 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:40.601203 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7628-140044050996272"] Jul 17 19:30:40.601636 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:40.601615 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="038937c5-9a10-440e-9226-47cfe2643b0c" containerName="cleanup" Jul 17 19:30:40.601636 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:40.601628 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="038937c5-9a10-440e-9226-47cfe2643b0c" containerName="cleanup" Jul 17 19:30:40.601711 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:40.601696 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="038937c5-9a10-440e-9226-47cfe2643b0c" containerName="cleanup" Jul 17 19:30:40.604849 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:40.604831 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7628-140044050996272" Jul 17 19:30:40.611226 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:40.610961 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7xczj\"" Jul 17 19:30:40.622700 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:40.622680 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7628-140044050996272"] Jul 17 19:30:40.662229 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:40.662202 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw26m\" (UniqueName: \"kubernetes.io/projected/513f0fa9-9b7b-4852-b395-eac704bf7950-kube-api-access-xw26m\") pod \"test-curl-7628-140044050996272\" (UID: \"513f0fa9-9b7b-4852-b395-eac704bf7950\") " pod="opendatahub/test-curl-7628-140044050996272" Jul 17 19:30:40.763296 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:40.763260 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw26m\" (UniqueName: \"kubernetes.io/projected/513f0fa9-9b7b-4852-b395-eac704bf7950-kube-api-access-xw26m\") pod \"test-curl-7628-140044050996272\" (UID: \"513f0fa9-9b7b-4852-b395-eac704bf7950\") " pod="opendatahub/test-curl-7628-140044050996272" Jul 17 19:30:40.776189 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:40.776156 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw26m\" (UniqueName: \"kubernetes.io/projected/513f0fa9-9b7b-4852-b395-eac704bf7950-kube-api-access-xw26m\") pod \"test-curl-7628-140044050996272\" (UID: \"513f0fa9-9b7b-4852-b395-eac704bf7950\") " pod="opendatahub/test-curl-7628-140044050996272" Jul 17 19:30:40.914209 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:40.914111 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7628-140044050996272" Jul 17 19:30:41.253884 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:41.253860 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7628-140044050996272"] Jul 17 19:30:41.255660 ip-10-0-131-36 kubenswrapper[2559]: W0717 19:30:41.255623 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod513f0fa9_9b7b_4852_b395_eac704bf7950.slice/crio-3aa2025f60c98ef4e05cd3af9ef7aa4b56119b975f0f8a0dd44774ab70bb3e75 WatchSource:0}: Error finding container 3aa2025f60c98ef4e05cd3af9ef7aa4b56119b975f0f8a0dd44774ab70bb3e75: Status 404 returned error can't find the container with id 3aa2025f60c98ef4e05cd3af9ef7aa4b56119b975f0f8a0dd44774ab70bb3e75 Jul 17 19:30:41.256842 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:41.256828 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 19:30:42.246174 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:42.246080 2559 generic.go:356] "Generic (PLEG): container finished" podID="513f0fa9-9b7b-4852-b395-eac704bf7950" containerID="7425b3cd1d5a0bf457ba644e30e86cda287e2102fcbe144777433fd7ae09d9af" exitCode=0 Jul 17 19:30:42.246174 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:42.246148 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7628-140044050996272" event={"ID":"513f0fa9-9b7b-4852-b395-eac704bf7950","Type":"ContainerDied","Data":"7425b3cd1d5a0bf457ba644e30e86cda287e2102fcbe144777433fd7ae09d9af"} Jul 17 19:30:42.246644 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:42.246177 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7628-140044050996272" event={"ID":"513f0fa9-9b7b-4852-b395-eac704bf7950","Type":"ContainerStarted","Data":"3aa2025f60c98ef4e05cd3af9ef7aa4b56119b975f0f8a0dd44774ab70bb3e75"} Jul 17 19:30:43.386429 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:43.386405 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7628-140044050996272" Jul 17 19:30:43.409591 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:43.409544 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7628-140044050996272_513f0fa9-9b7b-4852-b395-eac704bf7950/test-curl-7628-140044050996272/0.log" Jul 17 19:30:43.435909 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:43.435878 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7628-140044050996272"] Jul 17 19:30:43.439521 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:43.439491 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7628-140044050996272"] Jul 17 19:30:43.491102 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:43.491083 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xw26m\" (UniqueName: \"kubernetes.io/projected/513f0fa9-9b7b-4852-b395-eac704bf7950-kube-api-access-xw26m\") pod \"513f0fa9-9b7b-4852-b395-eac704bf7950\" (UID: \"513f0fa9-9b7b-4852-b395-eac704bf7950\") " Jul 17 19:30:43.493425 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:43.493399 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/513f0fa9-9b7b-4852-b395-eac704bf7950-kube-api-access-xw26m" (OuterVolumeSpecName: "kube-api-access-xw26m") pod "513f0fa9-9b7b-4852-b395-eac704bf7950" (UID: "513f0fa9-9b7b-4852-b395-eac704bf7950"). InnerVolumeSpecName "kube-api-access-xw26m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 19:30:43.562941 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:43.562860 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7628-140044050994096"] Jul 17 19:30:43.563281 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:43.563268 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="513f0fa9-9b7b-4852-b395-eac704bf7950" containerName="test-curl-7628-140044050996272" Jul 17 19:30:43.563367 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:43.563284 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="513f0fa9-9b7b-4852-b395-eac704bf7950" containerName="test-curl-7628-140044050996272" Jul 17 19:30:43.563367 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:43.563364 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="513f0fa9-9b7b-4852-b395-eac704bf7950" containerName="test-curl-7628-140044050996272" Jul 17 19:30:43.566488 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:43.566472 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7628-140044050994096" Jul 17 19:30:43.574353 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:43.574325 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7628-140044050994096"] Jul 17 19:30:43.591798 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:43.591762 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xw26m\" (UniqueName: \"kubernetes.io/projected/513f0fa9-9b7b-4852-b395-eac704bf7950-kube-api-access-xw26m\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 19:30:43.692680 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:43.692650 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9bd5\" (UniqueName: \"kubernetes.io/projected/c9cf4187-e207-4e66-90ed-450148e6268d-kube-api-access-r9bd5\") pod \"test-curl-7628-140044050994096\" (UID: \"c9cf4187-e207-4e66-90ed-450148e6268d\") " pod="opendatahub/test-curl-7628-140044050994096" Jul 17 19:30:43.793785 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:43.793745 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9bd5\" (UniqueName: \"kubernetes.io/projected/c9cf4187-e207-4e66-90ed-450148e6268d-kube-api-access-r9bd5\") pod \"test-curl-7628-140044050994096\" (UID: \"c9cf4187-e207-4e66-90ed-450148e6268d\") " pod="opendatahub/test-curl-7628-140044050994096" Jul 17 19:30:43.802374 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:43.802350 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9bd5\" (UniqueName: \"kubernetes.io/projected/c9cf4187-e207-4e66-90ed-450148e6268d-kube-api-access-r9bd5\") pod \"test-curl-7628-140044050994096\" (UID: \"c9cf4187-e207-4e66-90ed-450148e6268d\") " pod="opendatahub/test-curl-7628-140044050994096" Jul 17 19:30:43.876669 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:43.876643 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7628-140044050994096" Jul 17 19:30:43.921128 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:43.921094 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:30:44.020726 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:44.020705 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7628-140044050994096"] Jul 17 19:30:44.022916 ip-10-0-131-36 kubenswrapper[2559]: W0717 19:30:44.022891 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9cf4187_e207_4e66_90ed_450148e6268d.slice/crio-348b9de884d3c84bf4017c61fa63ab37a6840f734b3ec66fe31c049449693a17 WatchSource:0}: Error finding container 348b9de884d3c84bf4017c61fa63ab37a6840f734b3ec66fe31c049449693a17: Status 404 returned error can't find the container with id 348b9de884d3c84bf4017c61fa63ab37a6840f734b3ec66fe31c049449693a17 Jul 17 19:30:44.029080 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:44.029056 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:30:44.258215 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:44.258135 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7628-140044050996272" Jul 17 19:30:44.258215 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:44.258143 2559 scope.go:117] "RemoveContainer" containerID="7425b3cd1d5a0bf457ba644e30e86cda287e2102fcbe144777433fd7ae09d9af" Jul 17 19:30:44.259529 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:44.259503 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7628-140044050994096" event={"ID":"c9cf4187-e207-4e66-90ed-450148e6268d","Type":"ContainerStarted","Data":"348b9de884d3c84bf4017c61fa63ab37a6840f734b3ec66fe31c049449693a17"} Jul 17 19:30:45.267273 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:45.267240 2559 generic.go:356] "Generic (PLEG): container finished" podID="c9cf4187-e207-4e66-90ed-450148e6268d" containerID="99787f41d93aa2f91e00affee7773ded38800a1a4c8b2f6c7cb9ff1f65e54918" exitCode=0 Jul 17 19:30:45.267691 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:45.267341 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7628-140044050994096" event={"ID":"c9cf4187-e207-4e66-90ed-450148e6268d","Type":"ContainerDied","Data":"99787f41d93aa2f91e00affee7773ded38800a1a4c8b2f6c7cb9ff1f65e54918"} Jul 17 19:30:45.487751 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:45.487716 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="513f0fa9-9b7b-4852-b395-eac704bf7950" path="/var/lib/kubelet/pods/513f0fa9-9b7b-4852-b395-eac704bf7950/volumes" Jul 17 19:30:46.407267 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:46.407242 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7628-140044050994096" Jul 17 19:30:46.431213 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:46.431191 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7628-140044050994096_c9cf4187-e207-4e66-90ed-450148e6268d/test-curl-7628-140044050994096/0.log" Jul 17 19:30:46.458373 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:46.458344 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7628-140044050994096"] Jul 17 19:30:46.460570 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:46.460549 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7628-140044050994096"] Jul 17 19:30:46.518983 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:46.518951 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9bd5\" (UniqueName: \"kubernetes.io/projected/c9cf4187-e207-4e66-90ed-450148e6268d-kube-api-access-r9bd5\") pod \"c9cf4187-e207-4e66-90ed-450148e6268d\" (UID: \"c9cf4187-e207-4e66-90ed-450148e6268d\") " Jul 17 19:30:46.521215 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:46.521184 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9cf4187-e207-4e66-90ed-450148e6268d-kube-api-access-r9bd5" (OuterVolumeSpecName: "kube-api-access-r9bd5") pod "c9cf4187-e207-4e66-90ed-450148e6268d" (UID: "c9cf4187-e207-4e66-90ed-450148e6268d"). InnerVolumeSpecName "kube-api-access-r9bd5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 19:30:46.620193 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:46.620154 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9bd5\" (UniqueName: \"kubernetes.io/projected/c9cf4187-e207-4e66-90ed-450148e6268d-kube-api-access-r9bd5\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 19:30:46.623703 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:46.623675 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7628-140044051133328"] Jul 17 19:30:46.624083 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:46.624071 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9cf4187-e207-4e66-90ed-450148e6268d" containerName="test-curl-7628-140044050994096" Jul 17 19:30:46.624130 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:46.624085 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9cf4187-e207-4e66-90ed-450148e6268d" containerName="test-curl-7628-140044050994096" Jul 17 19:30:46.624171 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:46.624161 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9cf4187-e207-4e66-90ed-450148e6268d" containerName="test-curl-7628-140044050994096" Jul 17 19:30:46.627248 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:46.627231 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7628-140044051133328" Jul 17 19:30:46.635088 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:46.635060 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7628-140044051133328"] Jul 17 19:30:46.721666 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:46.721633 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v85v8\" (UniqueName: \"kubernetes.io/projected/196fc834-7f4c-4843-8ebf-3ba6bd19ef92-kube-api-access-v85v8\") pod \"test-curl-7628-140044051133328\" (UID: \"196fc834-7f4c-4843-8ebf-3ba6bd19ef92\") " pod="opendatahub/test-curl-7628-140044051133328" Jul 17 19:30:46.823064 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:46.822982 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v85v8\" (UniqueName: \"kubernetes.io/projected/196fc834-7f4c-4843-8ebf-3ba6bd19ef92-kube-api-access-v85v8\") pod \"test-curl-7628-140044051133328\" (UID: \"196fc834-7f4c-4843-8ebf-3ba6bd19ef92\") " pod="opendatahub/test-curl-7628-140044051133328" Jul 17 19:30:46.832677 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:46.832643 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v85v8\" (UniqueName: \"kubernetes.io/projected/196fc834-7f4c-4843-8ebf-3ba6bd19ef92-kube-api-access-v85v8\") pod \"test-curl-7628-140044051133328\" (UID: \"196fc834-7f4c-4843-8ebf-3ba6bd19ef92\") " pod="opendatahub/test-curl-7628-140044051133328" Jul 17 19:30:46.937393 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:46.937354 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7628-140044051133328" Jul 17 19:30:47.076851 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:47.076827 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7628-140044051133328"] Jul 17 19:30:47.080561 ip-10-0-131-36 kubenswrapper[2559]: W0717 19:30:47.080531 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod196fc834_7f4c_4843_8ebf_3ba6bd19ef92.slice/crio-86c7fa574d6e43efa8d6a5ec67adcf63134269ed4dc397964f8416b03f077e40 WatchSource:0}: Error finding container 86c7fa574d6e43efa8d6a5ec67adcf63134269ed4dc397964f8416b03f077e40: Status 404 returned error can't find the container with id 86c7fa574d6e43efa8d6a5ec67adcf63134269ed4dc397964f8416b03f077e40 Jul 17 19:30:47.279366 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:47.279339 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7628-140044050994096" Jul 17 19:30:47.279366 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:47.279348 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="348b9de884d3c84bf4017c61fa63ab37a6840f734b3ec66fe31c049449693a17" Jul 17 19:30:47.280715 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:47.280689 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7628-140044051133328" event={"ID":"196fc834-7f4c-4843-8ebf-3ba6bd19ef92","Type":"ContainerStarted","Data":"86c7fa574d6e43efa8d6a5ec67adcf63134269ed4dc397964f8416b03f077e40"} Jul 17 19:30:47.289584 ip-10-0-131-36 kubenswrapper[2559]: E0717 19:30:47.289557 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7628-140044050994096\" is forbidden: User \"system:node:ip-10-0-131-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-36.ec2.internal' and this object" podUID="c9cf4187-e207-4e66-90ed-450148e6268d" pod="opendatahub/test-curl-7628-140044050994096" Jul 17 19:30:47.488606 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:47.488577 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9cf4187-e207-4e66-90ed-450148e6268d" path="/var/lib/kubelet/pods/c9cf4187-e207-4e66-90ed-450148e6268d/volumes" Jul 17 19:30:48.287844 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:48.287811 2559 generic.go:356] "Generic (PLEG): container finished" podID="196fc834-7f4c-4843-8ebf-3ba6bd19ef92" containerID="5d727b5624f0caca99c85f9662370d794d3d48d3b9212d67a9672927467caf34" exitCode=0 Jul 17 19:30:48.287998 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:48.287893 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7628-140044051133328" event={"ID":"196fc834-7f4c-4843-8ebf-3ba6bd19ef92","Type":"ContainerDied","Data":"5d727b5624f0caca99c85f9662370d794d3d48d3b9212d67a9672927467caf34"} Jul 17 19:30:49.432171 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:49.432149 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7628-140044051133328" Jul 17 19:30:49.464563 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:49.464535 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7628-140044051133328_196fc834-7f4c-4843-8ebf-3ba6bd19ef92/test-curl-7628-140044051133328/0.log" Jul 17 19:30:49.496823 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:49.496796 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7628-140044051133328"] Jul 17 19:30:49.498950 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:49.498930 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7628-140044051133328"] Jul 17 19:30:49.547284 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:49.547194 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v85v8\" (UniqueName: \"kubernetes.io/projected/196fc834-7f4c-4843-8ebf-3ba6bd19ef92-kube-api-access-v85v8\") pod \"196fc834-7f4c-4843-8ebf-3ba6bd19ef92\" (UID: \"196fc834-7f4c-4843-8ebf-3ba6bd19ef92\") " Jul 17 19:30:49.549471 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:49.549447 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/196fc834-7f4c-4843-8ebf-3ba6bd19ef92-kube-api-access-v85v8" (OuterVolumeSpecName: "kube-api-access-v85v8") pod "196fc834-7f4c-4843-8ebf-3ba6bd19ef92" (UID: "196fc834-7f4c-4843-8ebf-3ba6bd19ef92"). InnerVolumeSpecName "kube-api-access-v85v8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 19:30:49.621422 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:49.621394 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7628-140044051133328"] Jul 17 19:30:49.621778 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:49.621766 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="196fc834-7f4c-4843-8ebf-3ba6bd19ef92" containerName="test-curl-7628-140044051133328" Jul 17 19:30:49.621821 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:49.621781 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="196fc834-7f4c-4843-8ebf-3ba6bd19ef92" containerName="test-curl-7628-140044051133328" Jul 17 19:30:49.621858 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:49.621843 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="196fc834-7f4c-4843-8ebf-3ba6bd19ef92" containerName="test-curl-7628-140044051133328" Jul 17 19:30:49.625016 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:49.625001 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7628-140044051133328" Jul 17 19:30:49.632741 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:49.632719 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7628-140044051133328"] Jul 17 19:30:49.648080 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:49.648049 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v85v8\" (UniqueName: \"kubernetes.io/projected/196fc834-7f4c-4843-8ebf-3ba6bd19ef92-kube-api-access-v85v8\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 19:30:49.748755 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:49.748721 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjsdq\" (UniqueName: \"kubernetes.io/projected/be7865f4-a14b-4b23-b7ad-6db6690c4f79-kube-api-access-hjsdq\") pod \"test-curl-7628-140044051133328\" (UID: \"be7865f4-a14b-4b23-b7ad-6db6690c4f79\") " pod="opendatahub/test-curl-7628-140044051133328" Jul 17 19:30:49.849264 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:49.849230 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjsdq\" (UniqueName: \"kubernetes.io/projected/be7865f4-a14b-4b23-b7ad-6db6690c4f79-kube-api-access-hjsdq\") pod \"test-curl-7628-140044051133328\" (UID: \"be7865f4-a14b-4b23-b7ad-6db6690c4f79\") " pod="opendatahub/test-curl-7628-140044051133328" Jul 17 19:30:49.857952 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:49.857917 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjsdq\" (UniqueName: \"kubernetes.io/projected/be7865f4-a14b-4b23-b7ad-6db6690c4f79-kube-api-access-hjsdq\") pod \"test-curl-7628-140044051133328\" (UID: \"be7865f4-a14b-4b23-b7ad-6db6690c4f79\") " pod="opendatahub/test-curl-7628-140044051133328" Jul 17 19:30:49.935405 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:49.935367 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7628-140044051133328" Jul 17 19:30:50.072955 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:50.072876 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7628-140044051133328"] Jul 17 19:30:50.075522 ip-10-0-131-36 kubenswrapper[2559]: W0717 19:30:50.075498 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe7865f4_a14b_4b23_b7ad_6db6690c4f79.slice/crio-454e715bc3468a26f9ed7247702ef18d44224f873639b102daa0e8f2466299ef WatchSource:0}: Error finding container 454e715bc3468a26f9ed7247702ef18d44224f873639b102daa0e8f2466299ef: Status 404 returned error can't find the container with id 454e715bc3468a26f9ed7247702ef18d44224f873639b102daa0e8f2466299ef Jul 17 19:30:50.299452 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:50.299418 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7628-140044051133328" event={"ID":"be7865f4-a14b-4b23-b7ad-6db6690c4f79","Type":"ContainerStarted","Data":"454e715bc3468a26f9ed7247702ef18d44224f873639b102daa0e8f2466299ef"} Jul 17 19:30:50.300811 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:50.300784 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7628-140044051133328" Jul 17 19:30:50.300811 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:50.300812 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="86c7fa574d6e43efa8d6a5ec67adcf63134269ed4dc397964f8416b03f077e40" Jul 17 19:30:50.316157 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:50.316118 2559 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7628-140044051133328" oldPodUID="196fc834-7f4c-4843-8ebf-3ba6bd19ef92" podUID="be7865f4-a14b-4b23-b7ad-6db6690c4f79" Jul 17 19:30:50.398964 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:50.398942 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:30:51.308602 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:51.308571 2559 generic.go:356] "Generic (PLEG): container finished" podID="be7865f4-a14b-4b23-b7ad-6db6690c4f79" containerID="73339177b847baad0a673d94dce63ebab464dfdeb2606d5a7e89637db5e98df5" exitCode=0 Jul 17 19:30:51.309053 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:51.308664 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7628-140044051133328" event={"ID":"be7865f4-a14b-4b23-b7ad-6db6690c4f79","Type":"ContainerDied","Data":"73339177b847baad0a673d94dce63ebab464dfdeb2606d5a7e89637db5e98df5"} Jul 17 19:30:51.489141 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:51.489110 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="196fc834-7f4c-4843-8ebf-3ba6bd19ef92" path="/var/lib/kubelet/pods/196fc834-7f4c-4843-8ebf-3ba6bd19ef92/volumes" Jul 17 19:30:52.441815 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:52.441792 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7628-140044051133328" Jul 17 19:30:52.465500 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:52.465468 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7628-140044051133328_be7865f4-a14b-4b23-b7ad-6db6690c4f79/test-curl-7628-140044051133328/0.log" Jul 17 19:30:52.493065 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:52.493036 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7628-140044051133328"] Jul 17 19:30:52.498755 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:52.498728 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7628-140044051133328"] Jul 17 19:30:52.571455 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:52.571375 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjsdq\" (UniqueName: \"kubernetes.io/projected/be7865f4-a14b-4b23-b7ad-6db6690c4f79-kube-api-access-hjsdq\") pod \"be7865f4-a14b-4b23-b7ad-6db6690c4f79\" (UID: \"be7865f4-a14b-4b23-b7ad-6db6690c4f79\") " Jul 17 19:30:52.573607 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:52.573585 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be7865f4-a14b-4b23-b7ad-6db6690c4f79-kube-api-access-hjsdq" (OuterVolumeSpecName: "kube-api-access-hjsdq") pod "be7865f4-a14b-4b23-b7ad-6db6690c4f79" (UID: "be7865f4-a14b-4b23-b7ad-6db6690c4f79"). InnerVolumeSpecName "kube-api-access-hjsdq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 19:30:52.629389 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:52.629346 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7628-140044051134336"] Jul 17 19:30:52.629732 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:52.629714 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be7865f4-a14b-4b23-b7ad-6db6690c4f79" containerName="test-curl-7628-140044051133328" Jul 17 19:30:52.629732 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:52.629730 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="be7865f4-a14b-4b23-b7ad-6db6690c4f79" containerName="test-curl-7628-140044051133328" Jul 17 19:30:52.629900 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:52.629799 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="be7865f4-a14b-4b23-b7ad-6db6690c4f79" containerName="test-curl-7628-140044051133328" Jul 17 19:30:52.632993 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:52.632976 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7628-140044051134336" Jul 17 19:30:52.641667 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:52.641644 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7628-140044051134336"] Jul 17 19:30:52.672939 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:52.672907 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjsdq\" (UniqueName: \"kubernetes.io/projected/be7865f4-a14b-4b23-b7ad-6db6690c4f79-kube-api-access-hjsdq\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 19:30:52.774217 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:52.774171 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cczrq\" (UniqueName: \"kubernetes.io/projected/d147ba09-5e88-4a6a-9941-82f508c69e5a-kube-api-access-cczrq\") pod \"test-curl-7628-140044051134336\" (UID: \"d147ba09-5e88-4a6a-9941-82f508c69e5a\") " pod="opendatahub/test-curl-7628-140044051134336" Jul 17 19:30:52.875352 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:52.875283 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cczrq\" (UniqueName: \"kubernetes.io/projected/d147ba09-5e88-4a6a-9941-82f508c69e5a-kube-api-access-cczrq\") pod \"test-curl-7628-140044051134336\" (UID: \"d147ba09-5e88-4a6a-9941-82f508c69e5a\") " pod="opendatahub/test-curl-7628-140044051134336" Jul 17 19:30:52.884695 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:52.884660 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cczrq\" (UniqueName: \"kubernetes.io/projected/d147ba09-5e88-4a6a-9941-82f508c69e5a-kube-api-access-cczrq\") pod \"test-curl-7628-140044051134336\" (UID: \"d147ba09-5e88-4a6a-9941-82f508c69e5a\") " pod="opendatahub/test-curl-7628-140044051134336" Jul 17 19:30:52.943226 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:52.943201 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7628-140044051134336" Jul 17 19:30:53.081702 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:53.081673 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7628-140044051134336"] Jul 17 19:30:53.083465 ip-10-0-131-36 kubenswrapper[2559]: W0717 19:30:53.083441 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd147ba09_5e88_4a6a_9941_82f508c69e5a.slice/crio-6dc3fe9decb44110953fde6d8b15ea1602254cf4ed5d84237a98a9fd17aa3fa3 WatchSource:0}: Error finding container 6dc3fe9decb44110953fde6d8b15ea1602254cf4ed5d84237a98a9fd17aa3fa3: Status 404 returned error can't find the container with id 6dc3fe9decb44110953fde6d8b15ea1602254cf4ed5d84237a98a9fd17aa3fa3 Jul 17 19:30:53.320503 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:53.320420 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7628-140044051134336" event={"ID":"d147ba09-5e88-4a6a-9941-82f508c69e5a","Type":"ContainerStarted","Data":"6dc3fe9decb44110953fde6d8b15ea1602254cf4ed5d84237a98a9fd17aa3fa3"} Jul 17 19:30:53.321645 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:53.321623 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7628-140044051133328" Jul 17 19:30:53.321788 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:53.321657 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="454e715bc3468a26f9ed7247702ef18d44224f873639b102daa0e8f2466299ef" Jul 17 19:30:53.331787 ip-10-0-131-36 kubenswrapper[2559]: E0717 19:30:53.331765 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7628-140044051133328\" is forbidden: User \"system:node:ip-10-0-131-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-36.ec2.internal' and this object" podUID="be7865f4-a14b-4b23-b7ad-6db6690c4f79" pod="opendatahub/test-curl-7628-140044051133328" Jul 17 19:30:53.489810 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:53.489772 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be7865f4-a14b-4b23-b7ad-6db6690c4f79" path="/var/lib/kubelet/pods/be7865f4-a14b-4b23-b7ad-6db6690c4f79/volumes" Jul 17 19:30:54.329690 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:54.329648 2559 generic.go:356] "Generic (PLEG): container finished" podID="d147ba09-5e88-4a6a-9941-82f508c69e5a" containerID="6bd6ae9e556b15f4c5a5c6d0ed9eff418df07669f664d5cd5ffcba59ff351fc0" exitCode=0 Jul 17 19:30:54.329872 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:54.329733 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7628-140044051134336" event={"ID":"d147ba09-5e88-4a6a-9941-82f508c69e5a","Type":"ContainerDied","Data":"6bd6ae9e556b15f4c5a5c6d0ed9eff418df07669f664d5cd5ffcba59ff351fc0"} Jul 17 19:30:54.577203 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:54.577155 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" podUID="0635da18-37bb-4371-a7a4-c95bed5efeef" containerName="main" containerID="cri-o://48f377f97fefbc7afbe780fc519f0ead0ec1148d8248817031afcd4f3ea86258" gracePeriod=45 Jul 17 19:30:54.844841 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:54.844822 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" Jul 17 19:30:54.995089 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:54.995057 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0635da18-37bb-4371-a7a4-c95bed5efeef-home\") pod \"0635da18-37bb-4371-a7a4-c95bed5efeef\" (UID: \"0635da18-37bb-4371-a7a4-c95bed5efeef\") " Jul 17 19:30:54.995262 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:54.995100 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0635da18-37bb-4371-a7a4-c95bed5efeef-dshm\") pod \"0635da18-37bb-4371-a7a4-c95bed5efeef\" (UID: \"0635da18-37bb-4371-a7a4-c95bed5efeef\") " Jul 17 19:30:54.995262 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:54.995135 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0635da18-37bb-4371-a7a4-c95bed5efeef-tls-certs\") pod \"0635da18-37bb-4371-a7a4-c95bed5efeef\" (UID: \"0635da18-37bb-4371-a7a4-c95bed5efeef\") " Jul 17 19:30:54.995262 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:54.995169 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0635da18-37bb-4371-a7a4-c95bed5efeef-model-cache\") pod \"0635da18-37bb-4371-a7a4-c95bed5efeef\" (UID: \"0635da18-37bb-4371-a7a4-c95bed5efeef\") " Jul 17 19:30:54.995262 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:54.995211 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7gdc\" (UniqueName: \"kubernetes.io/projected/0635da18-37bb-4371-a7a4-c95bed5efeef-kube-api-access-k7gdc\") pod \"0635da18-37bb-4371-a7a4-c95bed5efeef\" (UID: \"0635da18-37bb-4371-a7a4-c95bed5efeef\") " Jul 17 19:30:54.995262 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:54.995235 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0635da18-37bb-4371-a7a4-c95bed5efeef-tmp-dir\") pod \"0635da18-37bb-4371-a7a4-c95bed5efeef\" (UID: \"0635da18-37bb-4371-a7a4-c95bed5efeef\") " Jul 17 19:30:54.995559 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:54.995395 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0635da18-37bb-4371-a7a4-c95bed5efeef-home" (OuterVolumeSpecName: "home") pod "0635da18-37bb-4371-a7a4-c95bed5efeef" (UID: "0635da18-37bb-4371-a7a4-c95bed5efeef"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 19:30:54.995559 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:54.995493 2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0635da18-37bb-4371-a7a4-c95bed5efeef-home\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 19:30:54.995559 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:54.995526 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0635da18-37bb-4371-a7a4-c95bed5efeef-model-cache" (OuterVolumeSpecName: "model-cache") pod "0635da18-37bb-4371-a7a4-c95bed5efeef" (UID: "0635da18-37bb-4371-a7a4-c95bed5efeef"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 19:30:54.995669 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:54.995562 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0635da18-37bb-4371-a7a4-c95bed5efeef-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0635da18-37bb-4371-a7a4-c95bed5efeef" (UID: "0635da18-37bb-4371-a7a4-c95bed5efeef"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 19:30:54.997372 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:54.997346 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0635da18-37bb-4371-a7a4-c95bed5efeef-dshm" (OuterVolumeSpecName: "dshm") pod "0635da18-37bb-4371-a7a4-c95bed5efeef" (UID: "0635da18-37bb-4371-a7a4-c95bed5efeef"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 19:30:54.997482 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:54.997426 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0635da18-37bb-4371-a7a4-c95bed5efeef-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0635da18-37bb-4371-a7a4-c95bed5efeef" (UID: "0635da18-37bb-4371-a7a4-c95bed5efeef"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 19:30:54.997616 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:54.997594 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0635da18-37bb-4371-a7a4-c95bed5efeef-kube-api-access-k7gdc" (OuterVolumeSpecName: "kube-api-access-k7gdc") pod "0635da18-37bb-4371-a7a4-c95bed5efeef" (UID: "0635da18-37bb-4371-a7a4-c95bed5efeef"). InnerVolumeSpecName "kube-api-access-k7gdc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 19:30:55.097021 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.096911 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7gdc\" (UniqueName: \"kubernetes.io/projected/0635da18-37bb-4371-a7a4-c95bed5efeef-kube-api-access-k7gdc\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 19:30:55.097021 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.096983 2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0635da18-37bb-4371-a7a4-c95bed5efeef-tmp-dir\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 19:30:55.097021 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.096998 2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0635da18-37bb-4371-a7a4-c95bed5efeef-dshm\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 19:30:55.097021 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.097010 2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0635da18-37bb-4371-a7a4-c95bed5efeef-tls-certs\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 19:30:55.097021 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.097023 2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0635da18-37bb-4371-a7a4-c95bed5efeef-model-cache\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 19:30:55.337111 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.337079 2559 generic.go:356] "Generic (PLEG): container finished" podID="0635da18-37bb-4371-a7a4-c95bed5efeef" containerID="48f377f97fefbc7afbe780fc519f0ead0ec1148d8248817031afcd4f3ea86258" exitCode=0 Jul 17 19:30:55.337344 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.337122 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" Jul 17 19:30:55.337344 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.337169 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" event={"ID":"0635da18-37bb-4371-a7a4-c95bed5efeef","Type":"ContainerDied","Data":"48f377f97fefbc7afbe780fc519f0ead0ec1148d8248817031afcd4f3ea86258"} Jul 17 19:30:55.337344 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.337211 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm" event={"ID":"0635da18-37bb-4371-a7a4-c95bed5efeef","Type":"ContainerDied","Data":"18418fce79385c9b480d77a14fba9d9fd18d5cd572749b1a3741904be2d15c78"} Jul 17 19:30:55.337344 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.337230 2559 scope.go:117] "RemoveContainer" containerID="48f377f97fefbc7afbe780fc519f0ead0ec1148d8248817031afcd4f3ea86258" Jul 17 19:30:55.347471 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.347330 2559 scope.go:117] "RemoveContainer" containerID="48f377f97fefbc7afbe780fc519f0ead0ec1148d8248817031afcd4f3ea86258" Jul 17 19:30:55.347601 ip-10-0-131-36 kubenswrapper[2559]: E0717 19:30:55.347583 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48f377f97fefbc7afbe780fc519f0ead0ec1148d8248817031afcd4f3ea86258\": container with ID starting with 48f377f97fefbc7afbe780fc519f0ead0ec1148d8248817031afcd4f3ea86258 not found: ID does not exist" containerID="48f377f97fefbc7afbe780fc519f0ead0ec1148d8248817031afcd4f3ea86258" Jul 17 19:30:55.347677 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.347610 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48f377f97fefbc7afbe780fc519f0ead0ec1148d8248817031afcd4f3ea86258"} err="failed to get container status \"48f377f97fefbc7afbe780fc519f0ead0ec1148d8248817031afcd4f3ea86258\": rpc error: code = NotFound desc = could not find container \"48f377f97fefbc7afbe780fc519f0ead0ec1148d8248817031afcd4f3ea86258\": container with ID starting with 48f377f97fefbc7afbe780fc519f0ead0ec1148d8248817031afcd4f3ea86258 not found: ID does not exist" Jul 17 19:30:55.360601 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.360577 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm"] Jul 17 19:30:55.364620 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.364598 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-2dc31c/rate-test-model-2dc31c-kserve-664f7cc599-lznwm"] Jul 17 19:30:55.463736 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.463714 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7628-140044051134336" Jul 17 19:30:55.485959 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.485929 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7628-140044051134336_d147ba09-5e88-4a6a-9941-82f508c69e5a/test-curl-7628-140044051134336/0.log" Jul 17 19:30:55.489210 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.489182 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0635da18-37bb-4371-a7a4-c95bed5efeef" path="/var/lib/kubelet/pods/0635da18-37bb-4371-a7a4-c95bed5efeef/volumes" Jul 17 19:30:55.510411 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.510367 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7628-140044051134336"] Jul 17 19:30:55.512753 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.512733 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7628-140044051134336"] Jul 17 19:30:55.602136 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.602074 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cczrq\" (UniqueName: \"kubernetes.io/projected/d147ba09-5e88-4a6a-9941-82f508c69e5a-kube-api-access-cczrq\") pod \"d147ba09-5e88-4a6a-9941-82f508c69e5a\" (UID: \"d147ba09-5e88-4a6a-9941-82f508c69e5a\") " Jul 17 19:30:55.604295 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.604271 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d147ba09-5e88-4a6a-9941-82f508c69e5a-kube-api-access-cczrq" (OuterVolumeSpecName: "kube-api-access-cczrq") pod "d147ba09-5e88-4a6a-9941-82f508c69e5a" (UID: "d147ba09-5e88-4a6a-9941-82f508c69e5a"). InnerVolumeSpecName "kube-api-access-cczrq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 19:30:55.644871 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.644842 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7628-140044051134336"] Jul 17 19:30:55.645222 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.645212 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0635da18-37bb-4371-a7a4-c95bed5efeef" containerName="main" Jul 17 19:30:55.645274 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.645225 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0635da18-37bb-4371-a7a4-c95bed5efeef" containerName="main" Jul 17 19:30:55.645274 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.645235 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d147ba09-5e88-4a6a-9941-82f508c69e5a" containerName="test-curl-7628-140044051134336" Jul 17 19:30:55.645274 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.645240 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d147ba09-5e88-4a6a-9941-82f508c69e5a" containerName="test-curl-7628-140044051134336" Jul 17 19:30:55.645396 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.645301 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d147ba09-5e88-4a6a-9941-82f508c69e5a" containerName="test-curl-7628-140044051134336" Jul 17 19:30:55.645396 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.645324 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0635da18-37bb-4371-a7a4-c95bed5efeef" containerName="main" Jul 17 19:30:55.648555 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.648540 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7628-140044051134336" Jul 17 19:30:55.653287 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.653263 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7628-140044051134336"] Jul 17 19:30:55.703720 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.703693 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cczrq\" (UniqueName: \"kubernetes.io/projected/d147ba09-5e88-4a6a-9941-82f508c69e5a-kube-api-access-cczrq\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 19:30:55.804739 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.804689 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkhwh\" (UniqueName: \"kubernetes.io/projected/b053534f-6e97-49ca-a094-4c7f8309c683-kube-api-access-lkhwh\") pod \"test-curl-7628-140044051134336\" (UID: \"b053534f-6e97-49ca-a094-4c7f8309c683\") " pod="opendatahub/test-curl-7628-140044051134336" Jul 17 19:30:55.905199 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.905123 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkhwh\" (UniqueName: \"kubernetes.io/projected/b053534f-6e97-49ca-a094-4c7f8309c683-kube-api-access-lkhwh\") pod \"test-curl-7628-140044051134336\" (UID: \"b053534f-6e97-49ca-a094-4c7f8309c683\") " pod="opendatahub/test-curl-7628-140044051134336" Jul 17 19:30:55.913500 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.913477 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkhwh\" (UniqueName: \"kubernetes.io/projected/b053534f-6e97-49ca-a094-4c7f8309c683-kube-api-access-lkhwh\") pod \"test-curl-7628-140044051134336\" (UID: \"b053534f-6e97-49ca-a094-4c7f8309c683\") " pod="opendatahub/test-curl-7628-140044051134336" Jul 17 19:30:55.959102 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:55.959068 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7628-140044051134336" Jul 17 19:30:56.101769 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:56.101746 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7628-140044051134336"] Jul 17 19:30:56.104077 ip-10-0-131-36 kubenswrapper[2559]: W0717 19:30:56.104050 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb053534f_6e97_49ca_a094_4c7f8309c683.slice/crio-8e1fabdef8ee49fadf73c7b202599c0c951858782ea1d8a9d0bb6f223c60937d WatchSource:0}: Error finding container 8e1fabdef8ee49fadf73c7b202599c0c951858782ea1d8a9d0bb6f223c60937d: Status 404 returned error can't find the container with id 8e1fabdef8ee49fadf73c7b202599c0c951858782ea1d8a9d0bb6f223c60937d Jul 17 19:30:56.344867 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:56.344840 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7628-140044051134336" Jul 17 19:30:56.344867 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:56.344852 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6dc3fe9decb44110953fde6d8b15ea1602254cf4ed5d84237a98a9fd17aa3fa3" Jul 17 19:30:56.346088 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:56.346061 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7628-140044051134336" event={"ID":"b053534f-6e97-49ca-a094-4c7f8309c683","Type":"ContainerStarted","Data":"8e1fabdef8ee49fadf73c7b202599c0c951858782ea1d8a9d0bb6f223c60937d"} Jul 17 19:30:56.356684 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:56.356655 2559 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7628-140044051134336" oldPodUID="d147ba09-5e88-4a6a-9941-82f508c69e5a" podUID="b053534f-6e97-49ca-a094-4c7f8309c683" Jul 17 19:30:57.353178 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:57.353148 2559 generic.go:356] "Generic (PLEG): container finished" podID="b053534f-6e97-49ca-a094-4c7f8309c683" containerID="5414132a4c01360aff0928427b65c733237e272dc52d2392ca30a1852e4b3878" exitCode=0 Jul 17 19:30:57.353553 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:57.353207 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7628-140044051134336" event={"ID":"b053534f-6e97-49ca-a094-4c7f8309c683","Type":"ContainerDied","Data":"5414132a4c01360aff0928427b65c733237e272dc52d2392ca30a1852e4b3878"} Jul 17 19:30:57.487765 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:57.487736 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d147ba09-5e88-4a6a-9941-82f508c69e5a" path="/var/lib/kubelet/pods/d147ba09-5e88-4a6a-9941-82f508c69e5a/volumes" Jul 17 19:30:58.492979 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:58.492956 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7628-140044051134336" Jul 17 19:30:58.534193 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:58.534167 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7628-140044051134336_b053534f-6e97-49ca-a094-4c7f8309c683/test-curl-7628-140044051134336/0.log" Jul 17 19:30:58.566559 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:58.566528 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7628-140044051134336"] Jul 17 19:30:58.570398 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:58.570370 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7628-140044051134336"] Jul 17 19:30:58.628506 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:58.628441 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkhwh\" (UniqueName: \"kubernetes.io/projected/b053534f-6e97-49ca-a094-4c7f8309c683-kube-api-access-lkhwh\") pod \"b053534f-6e97-49ca-a094-4c7f8309c683\" (UID: \"b053534f-6e97-49ca-a094-4c7f8309c683\") " Jul 17 19:30:58.630747 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:58.630719 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b053534f-6e97-49ca-a094-4c7f8309c683-kube-api-access-lkhwh" (OuterVolumeSpecName: "kube-api-access-lkhwh") pod "b053534f-6e97-49ca-a094-4c7f8309c683" (UID: "b053534f-6e97-49ca-a094-4c7f8309c683"). InnerVolumeSpecName "kube-api-access-lkhwh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 19:30:58.730030 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:58.729989 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkhwh\" (UniqueName: \"kubernetes.io/projected/b053534f-6e97-49ca-a094-4c7f8309c683-kube-api-access-lkhwh\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 19:30:58.784720 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:58.784680 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-14077d-9wtpf"] Jul 17 19:30:58.785146 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:58.785117 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b053534f-6e97-49ca-a094-4c7f8309c683" containerName="test-curl-7628-140044051134336" Jul 17 19:30:58.785146 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:58.785144 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b053534f-6e97-49ca-a094-4c7f8309c683" containerName="test-curl-7628-140044051134336" Jul 17 19:30:58.785356 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:58.785262 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b053534f-6e97-49ca-a094-4c7f8309c683" containerName="test-curl-7628-140044051134336" Jul 17 19:30:58.788198 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:58.788183 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-14077d-9wtpf" Jul 17 19:30:58.791015 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:58.790995 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bwjqx\"" Jul 17 19:30:58.791144 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:58.791125 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 17 19:30:58.801211 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:58.801192 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-14077d-9wtpf"] Jul 17 19:30:58.931571 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:58.931477 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc00ced3-e473-4542-8ee7-638b8503803e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-14077d-9wtpf\" (UID: \"dc00ced3-e473-4542-8ee7-638b8503803e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-14077d-9wtpf" Jul 17 19:30:59.032237 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:59.032201 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc00ced3-e473-4542-8ee7-638b8503803e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-14077d-9wtpf\" (UID: \"dc00ced3-e473-4542-8ee7-638b8503803e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-14077d-9wtpf" Jul 17 19:30:59.032921 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:59.032901 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc00ced3-e473-4542-8ee7-638b8503803e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-14077d-9wtpf\" (UID: \"dc00ced3-e473-4542-8ee7-638b8503803e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-14077d-9wtpf" Jul 17 19:30:59.098386 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:59.098362 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-14077d-9wtpf" Jul 17 19:30:59.246460 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:59.246427 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-14077d-9wtpf"] Jul 17 19:30:59.248065 ip-10-0-131-36 kubenswrapper[2559]: W0717 19:30:59.248036 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc00ced3_e473_4542_8ee7_638b8503803e.slice/crio-403b0a0e948c1d368ab1eec36fe39826d49240fe8884586ae6899a2606529a7e WatchSource:0}: Error finding container 403b0a0e948c1d368ab1eec36fe39826d49240fe8884586ae6899a2606529a7e: Status 404 returned error can't find the container with id 403b0a0e948c1d368ab1eec36fe39826d49240fe8884586ae6899a2606529a7e Jul 17 19:30:59.364737 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:59.364702 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-14077d-9wtpf" event={"ID":"dc00ced3-e473-4542-8ee7-638b8503803e","Type":"ContainerStarted","Data":"403b0a0e948c1d368ab1eec36fe39826d49240fe8884586ae6899a2606529a7e"} Jul 17 19:30:59.366022 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:59.366000 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7628-140044051134336" Jul 17 19:30:59.366151 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:59.366047 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e1fabdef8ee49fadf73c7b202599c0c951858782ea1d8a9d0bb6f223c60937d" Jul 17 19:30:59.380267 ip-10-0-131-36 kubenswrapper[2559]: E0717 19:30:59.380239 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7628-140044051134336\" is forbidden: User \"system:node:ip-10-0-131-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-36.ec2.internal' and this object" podUID="b053534f-6e97-49ca-a094-4c7f8309c683" pod="opendatahub/test-curl-7628-140044051134336" Jul 17 19:30:59.487740 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:59.487661 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b053534f-6e97-49ca-a094-4c7f8309c683" path="/var/lib/kubelet/pods/b053534f-6e97-49ca-a094-4c7f8309c683/volumes" Jul 17 19:30:59.550017 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:59.549987 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:30:59.672701 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:30:59.672668 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:31:00.372911 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:00.372883 2559 generic.go:356] "Generic (PLEG): container finished" podID="dc00ced3-e473-4542-8ee7-638b8503803e" containerID="bb10a81d72fabda28496a800bc022dab9b46d91d9084a458ee0e205511554ee6" exitCode=0 Jul 17 19:31:00.373097 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:00.372971 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-14077d-9wtpf" event={"ID":"dc00ced3-e473-4542-8ee7-638b8503803e","Type":"ContainerDied","Data":"bb10a81d72fabda28496a800bc022dab9b46d91d9084a458ee0e205511554ee6"} Jul 17 19:31:01.515875 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:01.515855 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-14077d-9wtpf" Jul 17 19:31:01.658626 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:01.658533 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc00ced3-e473-4542-8ee7-638b8503803e-maas-api-service-ca\") pod \"dc00ced3-e473-4542-8ee7-638b8503803e\" (UID: \"dc00ced3-e473-4542-8ee7-638b8503803e\") " Jul 17 19:31:01.658883 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:01.658850 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc00ced3-e473-4542-8ee7-638b8503803e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dc00ced3-e473-4542-8ee7-638b8503803e" (UID: "dc00ced3-e473-4542-8ee7-638b8503803e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 19:31:01.659363 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:01.659300 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc00ced3-e473-4542-8ee7-638b8503803e-maas-api-service-ca\") on node \"ip-10-0-131-36.ec2.internal\" DevicePath \"\"" Jul 17 19:31:02.385648 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:02.385618 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-14077d-9wtpf" Jul 17 19:31:02.385816 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:02.385612 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-14077d-9wtpf" event={"ID":"dc00ced3-e473-4542-8ee7-638b8503803e","Type":"ContainerDied","Data":"403b0a0e948c1d368ab1eec36fe39826d49240fe8884586ae6899a2606529a7e"} Jul 17 19:31:02.385816 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:02.385748 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="403b0a0e948c1d368ab1eec36fe39826d49240fe8884586ae6899a2606529a7e" Jul 17 19:31:09.245473 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:09.245442 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-14077d-29738610-lqdkv"] Jul 17 19:31:09.248620 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:09.248592 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-14077d-29738610-lqdkv"] Jul 17 19:31:09.250920 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:09.250896 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:31:09.488277 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:09.488243 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="038937c5-9a10-440e-9226-47cfe2643b0c" path="/var/lib/kubelet/pods/038937c5-9a10-440e-9226-47cfe2643b0c/volumes" Jul 17 19:31:12.469638 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:12.469559 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:31:13.858533 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:13.858499 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:31:13.866675 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:13.866641 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-14077d-9wtpf"] Jul 17 19:31:13.868833 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:13.868812 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-14077d-9wtpf"] Jul 17 19:31:14.314153 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:14.314037 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:31:15.488427 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:15.488399 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc00ced3-e473-4542-8ee7-638b8503803e" path="/var/lib/kubelet/pods/dc00ced3-e473-4542-8ee7-638b8503803e/volumes" Jul 17 19:31:19.848691 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:19.848653 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:31:21.189356 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:21.189288 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:31:21.258199 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:21.258165 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:31:21.497216 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:21.497131 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:31:21.734571 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:21.734537 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:31:22.551579 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:22.551530 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:31:22.652412 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:22.652363 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:31:32.526542 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:32.526510 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:31:35.553956 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:35.553914 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-czv4z"] Jul 17 19:31:36.947028 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:36.946991 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:31:37.366270 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:37.366232 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:31:44.160026 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:44.159990 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:31:44.262078 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:44.262036 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:31:44.578799 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:44.578704 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:31:44.761613 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:44.761580 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:31:45.192879 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:45.192848 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-649fb68f7-z94zg_a5c0ae18-b74c-440d-820e-7d3b12c0c92e/authorino/0.log" Jul 17 19:31:51.579884 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:51.579859 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68969b7c46-4rq7x_12de2f06-576d-4a05-aaea-08ad563c385a/copy-manifests/0.log" Jul 17 19:31:51.588230 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:51.588204 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68969b7c46-4rq7x_12de2f06-576d-4a05-aaea-08ad563c385a/manager/0.log" Jul 17 19:31:52.563043 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:52.563011 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29738595-x6hgt_ad37f147-5374-4050-8d46-77ec4e3a2821/cleanup/0.log" Jul 17 19:31:53.671277 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:53.671247 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr_8b375b40-62a3-4690-8952-46158b78cb18/util/0.log" Jul 17 19:31:53.680628 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:53.680600 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr_8b375b40-62a3-4690-8952-46158b78cb18/pull/0.log" Jul 17 19:31:53.692038 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:53.692008 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr_8b375b40-62a3-4690-8952-46158b78cb18/extract/0.log" Jul 17 19:31:53.815699 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:53.815651 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g_26f47351-05c6-4b42-a109-d8f09aa1e62a/util/0.log" Jul 17 19:31:53.823784 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:53.823760 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g_26f47351-05c6-4b42-a109-d8f09aa1e62a/pull/0.log" Jul 17 19:31:53.831274 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:53.831245 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g_26f47351-05c6-4b42-a109-d8f09aa1e62a/extract/0.log" Jul 17 19:31:53.964841 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:53.964750 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds_9965128e-d2f7-407d-b8b6-a4da7f05e847/pull/0.log" Jul 17 19:31:53.973001 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:53.972974 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds_9965128e-d2f7-407d-b8b6-a4da7f05e847/extract/0.log" Jul 17 19:31:53.983467 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:53.983447 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds_9965128e-d2f7-407d-b8b6-a4da7f05e847/util/0.log" Jul 17 19:31:54.107274 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:54.107249 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56_b7dc9672-f1c3-4c40-b1de-87ce09e14aa1/util/0.log" Jul 17 19:31:54.114467 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:54.114443 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56_b7dc9672-f1c3-4c40-b1de-87ce09e14aa1/pull/0.log" Jul 17 19:31:54.121620 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:54.121601 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56_b7dc9672-f1c3-4c40-b1de-87ce09e14aa1/extract/0.log" Jul 17 19:31:54.249422 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:54.249340 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-649fb68f7-z94zg_a5c0ae18-b74c-440d-820e-7d3b12c0c92e/authorino/0.log" Jul 17 19:31:55.044022 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:55.043990 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-czv4z_5cb0721c-64cd-4e5b-8791-b7d30f3ab7ba/limitador/0.log" Jul 17 19:31:55.781526 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:55.781496 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58f857f879-2z9jp_818c7209-3066-43d4-ac2d-6d401754d07c/kube-auth-proxy/0.log" Jul 17 19:31:57.021716 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:31:57.021684 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-2cgqk_285bf799-8464-4ea6-a7db-1e61d4c70ff5/main/0.log" Jul 17 19:32:03.438733 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:03.438687 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sqxlf/must-gather-h2x67"] Jul 17 19:32:03.440230 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:03.440200 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc00ced3-e473-4542-8ee7-638b8503803e" containerName="revoke-keys" Jul 17 19:32:03.440428 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:03.440415 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc00ced3-e473-4542-8ee7-638b8503803e" containerName="revoke-keys" Jul 17 19:32:03.440978 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:03.440774 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc00ced3-e473-4542-8ee7-638b8503803e" containerName="revoke-keys" Jul 17 19:32:03.444734 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:03.444715 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sqxlf/must-gather-h2x67" Jul 17 19:32:03.447930 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:03.447909 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sqxlf\"/\"openshift-service-ca.crt\"" Jul 17 19:32:03.448026 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:03.447910 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sqxlf\"/\"kube-root-ca.crt\"" Jul 17 19:32:03.448641 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:03.448624 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sqxlf\"/\"default-dockercfg-r7slb\"" Jul 17 19:32:03.459203 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:03.459180 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sqxlf/must-gather-h2x67"] Jul 17 19:32:03.465732 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:03.465705 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:32:03.515329 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:03.515273 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84gk7\" (UniqueName: \"kubernetes.io/projected/7c80c678-33b6-479b-96e1-cd609bac3134-kube-api-access-84gk7\") pod \"must-gather-h2x67\" (UID: \"7c80c678-33b6-479b-96e1-cd609bac3134\") " pod="openshift-must-gather-sqxlf/must-gather-h2x67" Jul 17 19:32:03.515329 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:03.515323 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7c80c678-33b6-479b-96e1-cd609bac3134-must-gather-output\") pod \"must-gather-h2x67\" (UID: \"7c80c678-33b6-479b-96e1-cd609bac3134\") " pod="openshift-must-gather-sqxlf/must-gather-h2x67" Jul 17 19:32:03.589738 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:03.589704 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:32:03.615938 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:03.615915 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84gk7\" (UniqueName: \"kubernetes.io/projected/7c80c678-33b6-479b-96e1-cd609bac3134-kube-api-access-84gk7\") pod \"must-gather-h2x67\" (UID: \"7c80c678-33b6-479b-96e1-cd609bac3134\") " pod="openshift-must-gather-sqxlf/must-gather-h2x67" Jul 17 19:32:03.616067 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:03.615949 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7c80c678-33b6-479b-96e1-cd609bac3134-must-gather-output\") pod \"must-gather-h2x67\" (UID: \"7c80c678-33b6-479b-96e1-cd609bac3134\") " pod="openshift-must-gather-sqxlf/must-gather-h2x67" Jul 17 19:32:03.616386 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:03.616369 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7c80c678-33b6-479b-96e1-cd609bac3134-must-gather-output\") pod \"must-gather-h2x67\" (UID: \"7c80c678-33b6-479b-96e1-cd609bac3134\") " pod="openshift-must-gather-sqxlf/must-gather-h2x67" Jul 17 19:32:03.627141 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:03.627122 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84gk7\" (UniqueName: \"kubernetes.io/projected/7c80c678-33b6-479b-96e1-cd609bac3134-kube-api-access-84gk7\") pod \"must-gather-h2x67\" (UID: \"7c80c678-33b6-479b-96e1-cd609bac3134\") " pod="openshift-must-gather-sqxlf/must-gather-h2x67" Jul 17 19:32:03.753755 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:03.753681 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sqxlf/must-gather-h2x67" Jul 17 19:32:03.892464 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:03.892442 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sqxlf/must-gather-h2x67"] Jul 17 19:32:03.894298 ip-10-0-131-36 kubenswrapper[2559]: W0717 19:32:03.894271 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c80c678_33b6_479b_96e1_cd609bac3134.slice/crio-402c8518192d6e237114fe019c2039daa981271c6791e3df00672e3f26c2663e WatchSource:0}: Error finding container 402c8518192d6e237114fe019c2039daa981271c6791e3df00672e3f26c2663e: Status 404 returned error can't find the container with id 402c8518192d6e237114fe019c2039daa981271c6791e3df00672e3f26c2663e Jul 17 19:32:04.747510 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:04.747479 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sqxlf/must-gather-h2x67" event={"ID":"7c80c678-33b6-479b-96e1-cd609bac3134","Type":"ContainerStarted","Data":"402c8518192d6e237114fe019c2039daa981271c6791e3df00672e3f26c2663e"} Jul 17 19:32:05.758289 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:05.758240 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sqxlf/must-gather-h2x67" event={"ID":"7c80c678-33b6-479b-96e1-cd609bac3134","Type":"ContainerStarted","Data":"0d75534b7369a6cc3c941b4623585d11a28d3c506bf3ff8fa4b11303c5eb41b6"} Jul 17 19:32:05.758794 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:05.758301 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sqxlf/must-gather-h2x67" event={"ID":"7c80c678-33b6-479b-96e1-cd609bac3134","Type":"ContainerStarted","Data":"2774910ea2e1d9dc0065d264b908745f294ab7f7335eaa1efd7da21c27fa7080"} Jul 17 19:32:05.776863 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:05.776791 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sqxlf/must-gather-h2x67" podStartSLOduration=1.865628954 podStartE2EDuration="2.776771631s" totalImagesPullingTime="911.142677ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:32:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:32:05.774590429 +0000 UTC m=+2834.806203300" watchObservedRunningTime="2026-07-17 19:32:05.776771631 +0000 UTC m=+2834.808384504" Jul 17 19:32:06.501183 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:06.501141 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fwzx9_e17f75b8-ee10-4328-bb53-f83b188ad149/global-pull-secret-syncer/0.log" Jul 17 19:32:06.645700 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:06.645655 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" Jul 17 19:32:06.767718 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:06.767588 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-36.ec2.internal_17cbee2f05534142fef47f5b2283ef20/haproxy/0.log" Jul 17 19:32:11.246237 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:11.246199 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr_8b375b40-62a3-4690-8952-46158b78cb18/extract/0.log" Jul 17 19:32:11.281812 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:11.281780 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr_8b375b40-62a3-4690-8952-46158b78cb18/util/0.log" Jul 17 19:32:11.317874 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:11.317837 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rnhjr_8b375b40-62a3-4690-8952-46158b78cb18/pull/0.log" Jul 17 19:32:11.369068 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:11.369038 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g_26f47351-05c6-4b42-a109-d8f09aa1e62a/extract/0.log" Jul 17 19:32:11.425218 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:11.425192 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g_26f47351-05c6-4b42-a109-d8f09aa1e62a/util/0.log" Jul 17 19:32:11.474387 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:11.474359 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08zf8g_26f47351-05c6-4b42-a109-d8f09aa1e62a/pull/0.log" Jul 17 19:32:11.527044 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:11.526966 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds_9965128e-d2f7-407d-b8b6-a4da7f05e847/extract/0.log" Jul 17 19:32:11.569762 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:11.569727 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds_9965128e-d2f7-407d-b8b6-a4da7f05e847/util/0.log" Jul 17 19:32:11.621115 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:11.621079 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wchds_9965128e-d2f7-407d-b8b6-a4da7f05e847/pull/0.log" Jul 17 19:32:11.727586 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:11.727509 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56_b7dc9672-f1c3-4c40-b1de-87ce09e14aa1/extract/0.log" Jul 17 19:32:11.781642 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:11.781572 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56_b7dc9672-f1c3-4c40-b1de-87ce09e14aa1/util/0.log" Jul 17 19:32:11.859813 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:11.859784 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gj56_b7dc9672-f1c3-4c40-b1de-87ce09e14aa1/pull/0.log" Jul 17 19:32:12.595666 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:12.595612 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-649fb68f7-z94zg_a5c0ae18-b74c-440d-820e-7d3b12c0c92e/authorino/0.log" Jul 17 19:32:13.626407 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:13.626380 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-czv4z_5cb0721c-64cd-4e5b-8791-b7d30f3ab7ba/limitador/0.log" Jul 17 19:32:15.148045 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.148012 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_81767809-0a22-40b4-b37a-b850b91eba29/alertmanager/0.log" Jul 17 19:32:15.173350 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.173292 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_81767809-0a22-40b4-b37a-b850b91eba29/config-reloader/0.log" Jul 17 19:32:15.196697 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.196666 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_81767809-0a22-40b4-b37a-b850b91eba29/kube-rbac-proxy-web/0.log" Jul 17 19:32:15.221034 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.221005 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_81767809-0a22-40b4-b37a-b850b91eba29/kube-rbac-proxy/0.log" Jul 17 19:32:15.245176 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.245147 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_81767809-0a22-40b4-b37a-b850b91eba29/kube-rbac-proxy-metric/0.log" Jul 17 19:32:15.272113 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.272082 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_81767809-0a22-40b4-b37a-b850b91eba29/prom-label-proxy/0.log" Jul 17 19:32:15.296903 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.296871 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_81767809-0a22-40b4-b37a-b850b91eba29/init-config-reloader/0.log" Jul 17 19:32:15.376857 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.376832 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-k4lcr_061c236d-715c-42b4-b445-2e8a81315677/kube-state-metrics/0.log" Jul 17 19:32:15.396143 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.396055 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-k4lcr_061c236d-715c-42b4-b445-2e8a81315677/kube-rbac-proxy-main/0.log" Jul 17 19:32:15.421378 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.421300 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-k4lcr_061c236d-715c-42b4-b445-2e8a81315677/kube-rbac-proxy-self/0.log" Jul 17 19:32:15.451576 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.451548 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-594b5cf56d-x5gsm_eb2605f4-45b5-4e77-ad61-9b6224166897/metrics-server/0.log" Jul 17 19:32:15.480339 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.480293 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-4c6b9_032dd9c6-69f1-4c46-badd-1a7394e5fd05/monitoring-plugin/0.log" Jul 17 19:32:15.518691 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.518662 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f6rlq_84b8416d-b2ea-4511-aed6-79f917dcf41b/node-exporter/0.log" Jul 17 19:32:15.551298 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.551272 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f6rlq_84b8416d-b2ea-4511-aed6-79f917dcf41b/kube-rbac-proxy/0.log" Jul 17 19:32:15.583542 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.583516 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f6rlq_84b8416d-b2ea-4511-aed6-79f917dcf41b/init-textfile/0.log" Jul 17 19:32:15.784585 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.784493 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sqxlf/perf-node-gather-daemonset-2m2mk"] Jul 17 19:32:15.788710 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.788682 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-2m2mk" Jul 17 19:32:15.802038 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.802013 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sqxlf/perf-node-gather-daemonset-2m2mk"] Jul 17 19:32:15.835071 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.835046 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-bs5cb_564ab632-9517-4a85-be6d-2b4720ba30f2/kube-rbac-proxy-main/0.log" Jul 17 19:32:15.859933 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.859901 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-bs5cb_564ab632-9517-4a85-be6d-2b4720ba30f2/kube-rbac-proxy-self/0.log" Jul 17 19:32:15.865175 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.865139 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e467459f-a864-4262-b6f4-62983a34d291-lib-modules\") pod \"perf-node-gather-daemonset-2m2mk\" (UID: \"e467459f-a864-4262-b6f4-62983a34d291\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-2m2mk" Jul 17 19:32:15.865423 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.865407 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e467459f-a864-4262-b6f4-62983a34d291-podres\") pod \"perf-node-gather-daemonset-2m2mk\" (UID: \"e467459f-a864-4262-b6f4-62983a34d291\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-2m2mk" Jul 17 19:32:15.865567 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.865555 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e467459f-a864-4262-b6f4-62983a34d291-proc\") pod \"perf-node-gather-daemonset-2m2mk\" (UID: \"e467459f-a864-4262-b6f4-62983a34d291\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-2m2mk" Jul 17 19:32:15.865724 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.865699 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bm7c\" (UniqueName: \"kubernetes.io/projected/e467459f-a864-4262-b6f4-62983a34d291-kube-api-access-5bm7c\") pod \"perf-node-gather-daemonset-2m2mk\" (UID: \"e467459f-a864-4262-b6f4-62983a34d291\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-2m2mk" Jul 17 19:32:15.865804 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.865778 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e467459f-a864-4262-b6f4-62983a34d291-sys\") pod \"perf-node-gather-daemonset-2m2mk\" (UID: \"e467459f-a864-4262-b6f4-62983a34d291\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-2m2mk" Jul 17 19:32:15.887150 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.887111 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-bs5cb_564ab632-9517-4a85-be6d-2b4720ba30f2/openshift-state-metrics/0.log" Jul 17 19:32:15.966605 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.966554 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e467459f-a864-4262-b6f4-62983a34d291-lib-modules\") pod \"perf-node-gather-daemonset-2m2mk\" (UID: \"e467459f-a864-4262-b6f4-62983a34d291\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-2m2mk" Jul 17 19:32:15.966605 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.966604 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e467459f-a864-4262-b6f4-62983a34d291-podres\") pod \"perf-node-gather-daemonset-2m2mk\" (UID: \"e467459f-a864-4262-b6f4-62983a34d291\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-2m2mk" Jul 17 19:32:15.966850 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.966670 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e467459f-a864-4262-b6f4-62983a34d291-proc\") pod \"perf-node-gather-daemonset-2m2mk\" (UID: \"e467459f-a864-4262-b6f4-62983a34d291\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-2m2mk" Jul 17 19:32:15.966850 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.966701 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bm7c\" (UniqueName: \"kubernetes.io/projected/e467459f-a864-4262-b6f4-62983a34d291-kube-api-access-5bm7c\") pod \"perf-node-gather-daemonset-2m2mk\" (UID: \"e467459f-a864-4262-b6f4-62983a34d291\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-2m2mk" Jul 17 19:32:15.966850 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.966749 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e467459f-a864-4262-b6f4-62983a34d291-lib-modules\") pod \"perf-node-gather-daemonset-2m2mk\" (UID: \"e467459f-a864-4262-b6f4-62983a34d291\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-2m2mk" Jul 17 19:32:15.966850 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.966765 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e467459f-a864-4262-b6f4-62983a34d291-sys\") pod \"perf-node-gather-daemonset-2m2mk\" (UID: \"e467459f-a864-4262-b6f4-62983a34d291\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-2m2mk" Jul 17 19:32:15.966850 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.966780 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e467459f-a864-4262-b6f4-62983a34d291-proc\") pod \"perf-node-gather-daemonset-2m2mk\" (UID: \"e467459f-a864-4262-b6f4-62983a34d291\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-2m2mk" Jul 17 19:32:15.966850 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.966780 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e467459f-a864-4262-b6f4-62983a34d291-podres\") pod \"perf-node-gather-daemonset-2m2mk\" (UID: \"e467459f-a864-4262-b6f4-62983a34d291\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-2m2mk" Jul 17 19:32:15.967177 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.966862 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e467459f-a864-4262-b6f4-62983a34d291-sys\") pod \"perf-node-gather-daemonset-2m2mk\" (UID: \"e467459f-a864-4262-b6f4-62983a34d291\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-2m2mk" Jul 17 19:32:15.975338 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:15.975296 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bm7c\" (UniqueName: \"kubernetes.io/projected/e467459f-a864-4262-b6f4-62983a34d291-kube-api-access-5bm7c\") pod \"perf-node-gather-daemonset-2m2mk\" (UID: \"e467459f-a864-4262-b6f4-62983a34d291\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-2m2mk" Jul 17 19:32:16.102998 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:16.102961 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-2m2mk" Jul 17 19:32:16.123982 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:16.123950 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-lth9w_813e2e0b-8052-47b9-afc8-c976391596e8/prometheus-operator/0.log" Jul 17 19:32:16.147115 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:16.147080 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-lth9w_813e2e0b-8052-47b9-afc8-c976391596e8/kube-rbac-proxy/0.log" Jul 17 19:32:16.180291 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:16.180261 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-rkt6w_e3934200-271e-4e1f-ad8d-0227f2cf4217/prometheus-operator-admission-webhook/0.log" Jul 17 19:32:16.219084 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:16.219058 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-666d9d5c59-hqj5j_e432a75b-70dd-46ea-90c3-1538cb8e6097/telemeter-client/0.log" Jul 17 19:32:16.259341 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:16.259269 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-666d9d5c59-hqj5j_e432a75b-70dd-46ea-90c3-1538cb8e6097/reload/0.log" Jul 17 19:32:16.288264 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:16.287824 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-666d9d5c59-hqj5j_e432a75b-70dd-46ea-90c3-1538cb8e6097/kube-rbac-proxy/0.log" Jul 17 19:32:16.288875 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:16.288854 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sqxlf/perf-node-gather-daemonset-2m2mk"] Jul 17 19:32:16.291882 ip-10-0-131-36 kubenswrapper[2559]: W0717 19:32:16.291854 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode467459f_a864_4262_b6f4_62983a34d291.slice/crio-9add6be1abbe15fb5991d5e1a79a57613f940d962f4b79f6b1004d0acaaaa168 WatchSource:0}: Error finding container 9add6be1abbe15fb5991d5e1a79a57613f940d962f4b79f6b1004d0acaaaa168: Status 404 returned error can't find the container with id 9add6be1abbe15fb5991d5e1a79a57613f940d962f4b79f6b1004d0acaaaa168 Jul 17 19:32:16.322369 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:16.322288 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b896b5749-qzwwf_939fbff4-14a7-4143-a217-92ff90d33707/thanos-query/0.log" Jul 17 19:32:16.347075 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:16.347046 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b896b5749-qzwwf_939fbff4-14a7-4143-a217-92ff90d33707/kube-rbac-proxy-web/0.log" Jul 17 19:32:16.372778 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:16.372606 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b896b5749-qzwwf_939fbff4-14a7-4143-a217-92ff90d33707/kube-rbac-proxy/0.log" Jul 17 19:32:16.398485 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:16.398158 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b896b5749-qzwwf_939fbff4-14a7-4143-a217-92ff90d33707/prom-label-proxy/0.log" Jul 17 19:32:16.424993 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:16.424973 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b896b5749-qzwwf_939fbff4-14a7-4143-a217-92ff90d33707/kube-rbac-proxy-rules/0.log" Jul 17 19:32:16.447914 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:16.447866 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b896b5749-qzwwf_939fbff4-14a7-4143-a217-92ff90d33707/kube-rbac-proxy-metrics/0.log" Jul 17 19:32:16.850836 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:16.850800 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-2m2mk" event={"ID":"e467459f-a864-4262-b6f4-62983a34d291","Type":"ContainerStarted","Data":"683438a8c9bd5986477d4f5e5ab0ce3a32c6658129ffb799da0526274a0c1140"} Jul 17 19:32:16.851054 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:16.850873 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-2m2mk" event={"ID":"e467459f-a864-4262-b6f4-62983a34d291","Type":"ContainerStarted","Data":"9add6be1abbe15fb5991d5e1a79a57613f940d962f4b79f6b1004d0acaaaa168"} Jul 17 19:32:16.851054 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:16.850993 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-2m2mk" Jul 17 19:32:16.871738 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:16.871668 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-2m2mk" podStartSLOduration=1.871638778 podStartE2EDuration="1.871638778s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 19:32:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:32:16.867893576 +0000 UTC m=+2845.899506450" watchObservedRunningTime="2026-07-17 19:32:16.871638778 +0000 UTC m=+2845.903251655" Jul 17 19:32:18.726958 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:18.726921 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86749c6985-8rrz8_e6461c10-dad4-4d20-aee6-f7a0ed5d10f1/console/0.log" Jul 17 19:32:18.778420 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:18.778386 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-bw457_a7b96998-9941-4228-a3e9-249b6bb30165/download-server/0.log" Jul 17 19:32:20.003531 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:20.003478 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7shq8_917437f2-fc59-467c-a077-d0f905356f21/konnectivity-agent/0.log" limit=1024 Jul 17 19:32:20.587761 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:20.587731 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-79ppn_978f25c5-9384-430d-ae8a-17e45f13ad08/dns/0.log" Jul 17 19:32:20.623579 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:20.623546 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-79ppn_978f25c5-9384-430d-ae8a-17e45f13ad08/kube-rbac-proxy/0.log" Jul 17 19:32:20.891796 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:20.891720 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v6ttl_8b17e270-da8c-4293-b8e5-952a51cb976a/dns-node-resolver/0.log" Jul 17 19:32:21.755998 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:21.755966 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sps5m_071af57d-fffa-4c23-8505-329bba791a74/node-ca/0.log" Jul 17 19:32:22.870132 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:22.870104 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-2m2mk" Jul 17 19:32:23.167522 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:23.167438 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58f857f879-2z9jp_818c7209-3066-43d4-ac2d-6d401754d07c/kube-auth-proxy/0.log" Jul 17 19:32:24.372540 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:24.372499 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rf6rr_008e1c9d-8984-4a98-a046-e7876c88b88e/serve-healthcheck-canary/0.log" Jul 17 19:32:25.311346 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:25.311244 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dtxvx_76365ae7-632a-4639-84a0-f1bc2976a941/kube-rbac-proxy/0.log" Jul 17 19:32:25.338961 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:25.338934 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dtxvx_76365ae7-632a-4639-84a0-f1bc2976a941/exporter/0.log" Jul 17 19:32:25.365140 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:25.365106 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dtxvx_76365ae7-632a-4639-84a0-f1bc2976a941/extractor/0.log" Jul 17 19:32:27.361094 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:27.361067 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58f857f879-2z9jp_818c7209-3066-43d4-ac2d-6d401754d07c/kube-auth-proxy/0.log" Jul 17 19:32:28.458037 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:28.457944 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68969b7c46-4rq7x_12de2f06-576d-4a05-aaea-08ad563c385a/manager/0.log" Jul 17 19:32:28.481877 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:28.481849 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68969b7c46-4rq7x_12de2f06-576d-4a05-aaea-08ad563c385a/copy-manifests/0.log" Jul 17 19:32:28.953107 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:28.953077 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58f857f879-2z9jp_818c7209-3066-43d4-ac2d-6d401754d07c/kube-auth-proxy/0.log" Jul 17 19:32:30.012228 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:30.012160 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-76fdf749bb-6q72k_93ef279c-435d-42e3-8c91-5c6240eac1dd/manager/0.log" Jul 17 19:32:30.070245 ip-10-0-131-36 kubenswrapper[2559]: I0717 19:32:30.070208 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-8fcjt_1024ffdf-5004-4b88-b187-0547424e6242/openshift-lws-operator/0.log"