Jul 06 22:46:10.417508 ip-10-0-131-21 systemd[1]: Starting Kubernetes Kubelet... Jul 06 22:46:10.814174 ip-10-0-131-21 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 22:46:10.814174 ip-10-0-131-21 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 22:46:10.814174 ip-10-0-131-21 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 22:46:10.814174 ip-10-0-131-21 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 22:46:10.814174 ip-10-0-131-21 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 22:46:10.814174 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.811498 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 22:46:10.966197 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817789 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:46:10.966197 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817802 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:46:10.966197 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817806 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:46:10.966197 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817809 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:46:10.966197 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817812 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:46:10.966197 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817815 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:46:10.966197 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817818 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:46:10.966197 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817821 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:46:10.966197 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817824 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:46:10.966197 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817827 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:46:10.966197 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817830 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:46:10.966197 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817833 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:46:10.966197 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817837 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:46:10.966197 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817841 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:46:10.966197 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817843 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:46:10.966197 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817846 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:46:10.966197 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817849 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:46:10.966197 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817852 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:46:10.966197 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817855 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:46:10.966197 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817857 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:46:10.901661 ip-10-0-131-21 systemd[1]: Started Kubernetes Kubelet. Jul 06 22:46:10.966994 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817860 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:46:10.966994 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817863 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:46:10.966994 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817866 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:46:10.966994 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817868 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:46:10.966994 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817871 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:46:10.966994 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817874 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:46:10.966994 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817877 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:46:10.966994 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817894 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:46:10.966994 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817899 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:46:10.966994 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817908 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:46:10.966994 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817913 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:46:10.966994 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817916 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:46:10.966994 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817919 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:46:10.966994 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817922 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:46:10.966994 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817925 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:46:10.966994 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817928 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:46:10.966994 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817931 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:46:10.966994 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817934 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:46:10.966994 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817937 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:46:10.966994 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817940 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:46:10.967946 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817944 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:46:10.967946 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817948 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:46:10.967946 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817951 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:46:10.967946 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817954 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:46:10.967946 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817957 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:46:10.967946 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817960 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:46:10.967946 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817963 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:46:10.967946 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817966 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:46:10.967946 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817969 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:46:10.967946 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817972 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:46:10.967946 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817976 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:46:10.967946 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817978 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:46:10.967946 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817981 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:46:10.967946 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817984 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:46:10.967946 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817987 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:46:10.967946 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817989 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:46:10.967946 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817992 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:46:10.967946 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817995 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:46:10.967946 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.817998 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:46:10.967946 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818000 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:46:10.968677 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818004 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:46:10.968677 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818007 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:46:10.968677 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818010 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:46:10.968677 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818012 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:46:10.968677 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818015 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:46:10.968677 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818018 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:46:10.968677 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818021 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:46:10.968677 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818024 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:46:10.968677 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818026 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:46:10.968677 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818029 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:46:10.968677 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818032 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:46:10.968677 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818035 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:46:10.968677 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818037 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:46:10.968677 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818040 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:46:10.968677 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818043 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:46:10.968677 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818046 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:46:10.968677 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818050 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:46:10.968677 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818056 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:46:10.968677 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818060 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:46:10.969407 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818063 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:46:10.969407 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818068 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:46:10.969407 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818072 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:46:10.969407 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818076 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:46:10.969407 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818079 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:46:10.969407 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818082 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:46:10.969407 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818085 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:46:10.969407 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818088 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:46:10.969407 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818091 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:46:10.969407 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818093 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:46:10.969407 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818096 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:46:10.969407 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818099 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:46:10.969407 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818101 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:46:10.969407 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818104 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:46:10.969407 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818107 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:46:10.969407 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818110 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:46:10.969407 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818113 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:46:10.969407 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818117 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:46:10.969407 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818121 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:46:10.970086 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818124 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:46:10.970086 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818944 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:46:10.970086 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818953 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:46:10.970086 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818956 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:46:10.970086 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818960 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:46:10.970086 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818962 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:46:10.970086 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818965 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:46:10.970086 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818968 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:46:10.970086 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818971 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:46:10.970086 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818974 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:46:10.970086 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818978 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:46:10.970086 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818981 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:46:10.970086 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818984 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:46:10.970086 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818987 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:46:10.970086 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818990 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:46:10.970086 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818994 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:46:10.970086 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.818998 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:46:10.970086 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819001 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:46:10.970086 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819004 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:46:10.971282 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819007 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:46:10.971282 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819010 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:46:10.971282 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819013 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:46:10.971282 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819015 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:46:10.971282 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819019 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:46:10.971282 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819021 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:46:10.971282 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819024 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:46:10.971282 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819027 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:46:10.971282 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819030 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:46:10.971282 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819032 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:46:10.971282 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819036 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:46:10.971282 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819038 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:46:10.971282 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819041 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:46:10.971282 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819044 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:46:10.971282 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819047 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:46:10.971282 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819049 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:46:10.971282 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819054 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:46:10.971282 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819058 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:46:10.971282 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819062 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:46:10.972221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819065 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:46:10.972221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819068 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:46:10.972221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819071 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:46:10.972221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819075 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:46:10.972221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819078 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:46:10.972221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819081 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:46:10.972221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819084 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:46:10.972221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819087 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:46:10.972221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819090 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:46:10.972221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819093 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:46:10.972221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819097 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:46:10.972221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819100 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:46:10.972221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819103 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:46:10.972221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819105 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:46:10.972221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819108 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:46:10.972221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819111 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:46:10.972221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819113 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:46:10.972221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819116 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:46:10.972221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819119 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:46:10.972221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819123 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:46:10.973154 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819127 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:46:10.973154 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819130 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:46:10.973154 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819133 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:46:10.973154 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819136 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:46:10.973154 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819139 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:46:10.973154 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819142 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:46:10.973154 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819144 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:46:10.973154 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819147 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:46:10.973154 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819150 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:46:10.973154 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819153 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:46:10.973154 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819156 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:46:10.973154 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819158 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:46:10.973154 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819161 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:46:10.973154 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819164 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:46:10.973154 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819167 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:46:10.973154 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819171 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:46:10.973154 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819177 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:46:10.973154 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819180 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:46:10.973154 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819184 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:46:10.973850 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819187 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:46:10.973850 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819190 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:46:10.973850 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819193 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:46:10.973850 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819196 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:46:10.973850 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819200 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:46:10.973850 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819203 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:46:10.973850 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819206 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:46:10.973850 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819209 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:46:10.973850 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819211 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:46:10.973850 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819214 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:46:10.973850 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819217 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:46:10.973850 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819220 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:46:10.973850 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819223 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:46:10.973850 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819226 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:46:10.973850 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819228 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:46:10.973850 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819231 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:46:10.973850 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819234 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:46:10.973850 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819236 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:46:10.973850 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819239 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:46:10.973850 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819242 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:46:10.974790 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819245 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:46:10.974790 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819248 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:46:10.974790 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819252 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:46:10.974790 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819668 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:46:10.974790 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819673 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:46:10.974790 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819677 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:46:10.974790 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819680 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:46:10.974790 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819682 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:46:10.974790 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819685 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:46:10.974790 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819688 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:46:10.974790 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819691 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:46:10.974790 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819694 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:46:10.974790 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819697 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:46:10.974790 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819699 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:46:10.974790 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819702 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:46:10.974790 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819705 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:46:10.974790 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819709 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:46:10.974790 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819712 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:46:10.974790 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819715 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:46:10.974790 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819717 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:46:10.975743 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819720 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:46:10.975743 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819723 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:46:10.975743 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819726 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:46:10.975743 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819729 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:46:10.975743 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819732 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:46:10.975743 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819735 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:46:10.975743 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819739 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:46:10.975743 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819743 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:46:10.975743 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819746 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:46:10.975743 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819749 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:46:10.975743 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819753 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:46:10.975743 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819756 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:46:10.975743 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819760 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:46:10.975743 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819764 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:46:10.975743 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819767 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:46:10.975743 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819770 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:46:10.975743 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819773 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:46:10.975743 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819776 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:46:10.975743 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819780 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:46:10.975743 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819783 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:46:10.976692 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819792 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:46:10.976692 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819795 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:46:10.976692 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819799 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:46:10.976692 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819801 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:46:10.976692 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819804 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:46:10.976692 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819807 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:46:10.976692 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819810 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:46:10.976692 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819813 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:46:10.976692 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819816 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:46:10.976692 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819820 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:46:10.976692 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819823 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:46:10.976692 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819826 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:46:10.976692 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819829 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:46:10.976692 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819831 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:46:10.976692 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819834 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:46:10.976692 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819836 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:46:10.976692 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819839 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:46:10.976692 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819843 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:46:10.976692 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819846 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:46:10.976692 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819849 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:46:10.977352 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819852 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:46:10.977352 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819854 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:46:10.977352 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819857 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:46:10.977352 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819860 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:46:10.977352 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819863 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:46:10.977352 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819866 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:46:10.977352 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819868 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:46:10.977352 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819871 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:46:10.977352 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819874 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:46:10.977352 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819877 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:46:10.977352 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819899 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:46:10.977352 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819903 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:46:10.977352 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819909 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:46:10.977352 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819912 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:46:10.977352 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819915 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:46:10.977352 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819918 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:46:10.977352 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819921 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:46:10.977352 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819926 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:46:10.977352 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819930 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:46:10.978011 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819932 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:46:10.978011 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819935 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:46:10.978011 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819938 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:46:10.978011 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819942 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:46:10.978011 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819946 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:46:10.978011 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819950 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:46:10.978011 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819953 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:46:10.978011 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819957 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:46:10.978011 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819960 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:46:10.978011 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819963 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:46:10.978011 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819967 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:46:10.978011 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819970 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:46:10.978011 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819972 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:46:10.978011 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819975 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:46:10.978011 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819978 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:46:10.978011 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819980 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:46:10.978011 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819983 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:46:10.978011 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819986 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:46:10.978011 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819989 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:46:10.978661 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819992 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:46:10.978661 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819995 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:46:10.978661 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.819997 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:46:10.978661 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820000 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:46:10.978661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820081 2566 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 22:46:10.978661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820089 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 22:46:10.978661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820098 2566 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 22:46:10.978661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820103 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 22:46:10.978661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820108 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 22:46:10.978661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820111 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 22:46:10.978661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820116 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 22:46:10.978661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820121 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 22:46:10.978661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820124 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 22:46:10.978661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820127 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 22:46:10.978661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820131 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 22:46:10.978661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820135 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 22:46:10.978661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820138 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 22:46:10.978661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820143 2566 flags.go:64] FLAG: --cgroup-root="" Jul 06 22:46:10.978661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820146 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 22:46:10.978661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820149 2566 flags.go:64] FLAG: --client-ca-file="" Jul 06 22:46:10.978661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820152 2566 flags.go:64] FLAG: --cloud-provider="external" Jul 06 22:46:10.978661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820156 2566 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 22:46:10.978661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820161 2566 flags.go:64] FLAG: --cluster-domain="" Jul 06 22:46:10.979530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820166 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 22:46:10.979530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820170 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 22:46:10.979530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820173 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 22:46:10.979530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820177 2566 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 22:46:10.979530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820181 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 22:46:10.979530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820184 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 22:46:10.979530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820188 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 22:46:10.979530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820191 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 22:46:10.979530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820194 2566 flags.go:64] FLAG: --contention-profiling="false" Jul 06 22:46:10.979530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820197 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 22:46:10.979530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820201 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 22:46:10.979530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820204 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 22:46:10.979530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820207 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 22:46:10.979530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820212 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 22:46:10.979530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820215 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 22:46:10.979530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820220 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 22:46:10.979530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820223 2566 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 22:46:10.979530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820226 2566 flags.go:64] FLAG: --enable-server="true" Jul 06 22:46:10.979530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820230 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 22:46:10.979530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820234 2566 flags.go:64] FLAG: --event-burst="100" Jul 06 22:46:10.979530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820237 2566 flags.go:64] FLAG: --event-qps="50" Jul 06 22:46:10.979530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820241 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 22:46:10.979530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820245 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 22:46:10.979530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820248 2566 flags.go:64] FLAG: --eviction-hard="" Jul 06 22:46:10.980206 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820252 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 22:46:10.980206 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820255 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 22:46:10.980206 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820259 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 22:46:10.980206 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820267 2566 flags.go:64] FLAG: --eviction-soft="" Jul 06 22:46:10.980206 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820270 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 22:46:10.980206 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820274 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 22:46:10.980206 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820277 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 22:46:10.980206 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820280 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 22:46:10.980206 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820285 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 22:46:10.980206 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820288 2566 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 22:46:10.980206 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820291 2566 flags.go:64] FLAG: --feature-gates="" Jul 06 22:46:10.980206 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820295 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 22:46:10.980206 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820299 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 22:46:10.980206 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820302 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 22:46:10.980206 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820305 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 22:46:10.980206 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820308 2566 flags.go:64] FLAG: --healthz-port="10248" Jul 06 22:46:10.980206 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820312 2566 flags.go:64] FLAG: --help="false" Jul 06 22:46:10.980206 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820315 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-131-21.ec2.internal" Jul 06 22:46:10.980206 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820318 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 22:46:10.980206 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820321 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 22:46:10.980206 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820325 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 22:46:10.980206 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820328 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 22:46:10.980206 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820332 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 22:46:10.981073 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820337 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 22:46:10.981073 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820340 2566 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 22:46:10.981073 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820343 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 22:46:10.981073 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820346 2566 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 22:46:10.981073 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820349 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 22:46:10.981073 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820352 2566 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 22:46:10.981073 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820355 2566 flags.go:64] FLAG: --kube-reserved="" Jul 06 22:46:10.981073 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820358 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 22:46:10.981073 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820361 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 22:46:10.981073 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820364 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 22:46:10.981073 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820367 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 22:46:10.981073 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820370 2566 flags.go:64] FLAG: --lock-file="" Jul 06 22:46:10.981073 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820373 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 22:46:10.981073 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820377 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 22:46:10.981073 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820380 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 22:46:10.981073 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820387 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 22:46:10.981073 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820390 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 22:46:10.981073 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820395 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 22:46:10.981073 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820398 2566 flags.go:64] FLAG: --logging-format="text" Jul 06 22:46:10.981073 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820401 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 22:46:10.981073 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820405 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 22:46:10.981073 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820408 2566 flags.go:64] FLAG: --manifest-url="" Jul 06 22:46:10.981073 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820411 2566 flags.go:64] FLAG: --manifest-url-header="" Jul 06 22:46:10.981073 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820415 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 22:46:10.981073 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820418 2566 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 22:46:10.984356 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820423 2566 flags.go:64] FLAG: --max-pods="110" Jul 06 22:46:10.984356 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820426 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 22:46:10.984356 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820429 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 22:46:10.984356 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820433 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 22:46:10.984356 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820436 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 22:46:10.984356 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820440 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 22:46:10.984356 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820443 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 22:46:10.984356 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820448 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 22:46:10.984356 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820464 2566 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 22:46:10.984356 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820468 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 22:46:10.984356 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820471 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 22:46:10.984356 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820474 2566 flags.go:64] FLAG: --pod-cidr="" Jul 06 22:46:10.984356 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820478 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 22:46:10.984356 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820484 2566 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 22:46:10.984356 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820487 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 22:46:10.984356 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820490 2566 flags.go:64] FLAG: --pods-per-core="0" Jul 06 22:46:10.984356 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820493 2566 flags.go:64] FLAG: --port="10250" Jul 06 22:46:10.984356 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820497 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 22:46:10.984356 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820500 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-000c3533881392d29" Jul 06 22:46:10.984356 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820503 2566 flags.go:64] FLAG: --qos-reserved="" Jul 06 22:46:10.984356 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820507 2566 flags.go:64] FLAG: --read-only-port="10255" Jul 06 22:46:10.984356 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820511 2566 flags.go:64] FLAG: --register-node="true" Jul 06 22:46:10.984356 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820514 2566 flags.go:64] FLAG: --register-with-taints="" Jul 06 22:46:10.984356 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820518 2566 flags.go:64] FLAG: --registry-burst="10" Jul 06 22:46:10.985104 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820521 2566 flags.go:64] FLAG: --registry-qps="5" Jul 06 22:46:10.985104 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820528 2566 flags.go:64] FLAG: --reserved-cpus="" Jul 06 22:46:10.985104 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820531 2566 flags.go:64] FLAG: --reserved-memory="" Jul 06 22:46:10.985104 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820535 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 22:46:10.985104 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820538 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 22:46:10.985104 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820541 2566 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 22:46:10.985104 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820545 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 22:46:10.985104 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820548 2566 flags.go:64] FLAG: --runonce="false" Jul 06 22:46:10.985104 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820551 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 22:46:10.985104 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820554 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 22:46:10.985104 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820557 2566 flags.go:64] FLAG: --seccomp-default="false" Jul 06 22:46:10.985104 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820560 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 22:46:10.985104 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820564 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 22:46:10.985104 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820567 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 22:46:10.985104 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820571 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 22:46:10.985104 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820576 2566 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 22:46:10.985104 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820579 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 22:46:10.985104 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820582 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 22:46:10.985104 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820585 2566 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 22:46:10.985104 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820588 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 22:46:10.985104 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820592 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 22:46:10.985104 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820594 2566 flags.go:64] FLAG: --system-cgroups="" Jul 06 22:46:10.985104 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820598 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 22:46:10.985104 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820603 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 22:46:10.985104 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820606 2566 flags.go:64] FLAG: --tls-cert-file="" Jul 06 22:46:10.985929 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820609 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 22:46:10.985929 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820614 2566 flags.go:64] FLAG: --tls-min-version="" Jul 06 22:46:10.985929 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820618 2566 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 22:46:10.985929 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820621 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 22:46:10.985929 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820624 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 22:46:10.985929 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820627 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 22:46:10.985929 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820630 2566 flags.go:64] FLAG: --v="2" Jul 06 22:46:10.985929 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820634 2566 flags.go:64] FLAG: --version="false" Jul 06 22:46:10.985929 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820640 2566 flags.go:64] FLAG: --vmodule="" Jul 06 22:46:10.985929 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820649 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 22:46:10.985929 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.820652 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 22:46:10.985929 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820777 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:46:10.985929 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820781 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:46:10.985929 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820784 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:46:10.985929 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820787 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:46:10.985929 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820792 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:46:10.985929 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820796 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:46:10.985929 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820799 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:46:10.985929 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820802 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:46:10.985929 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820805 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:46:10.985929 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820807 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:46:10.985929 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820810 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:46:10.986549 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820815 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:46:10.986549 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820818 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:46:10.986549 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820821 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:46:10.986549 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820823 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:46:10.986549 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820826 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:46:10.986549 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820829 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:46:10.986549 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820832 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:46:10.986549 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820834 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:46:10.986549 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820837 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:46:10.986549 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820840 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:46:10.986549 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820842 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:46:10.986549 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820845 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:46:10.986549 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820848 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:46:10.986549 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820851 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:46:10.986549 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820854 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:46:10.986549 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820857 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:46:10.986549 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820860 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:46:10.986549 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820863 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:46:10.986549 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820867 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:46:10.986549 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820870 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:46:10.987230 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820873 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:46:10.987230 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820876 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:46:10.987230 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820895 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:46:10.987230 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820898 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:46:10.987230 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820901 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:46:10.987230 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820904 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:46:10.987230 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820907 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:46:10.987230 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820909 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:46:10.987230 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820912 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:46:10.987230 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820915 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:46:10.987230 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820920 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:46:10.987230 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820923 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:46:10.987230 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820928 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:46:10.987230 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820933 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:46:10.987230 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820936 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:46:10.987230 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820939 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:46:10.987230 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820943 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:46:10.987230 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820946 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:46:10.987230 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820949 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:46:10.987779 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820953 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:46:10.987779 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820956 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:46:10.987779 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820959 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:46:10.987779 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820962 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:46:10.987779 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820965 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:46:10.987779 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820968 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:46:10.987779 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820971 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:46:10.987779 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820975 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:46:10.987779 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820978 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:46:10.987779 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820981 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:46:10.987779 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820985 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:46:10.987779 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820989 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:46:10.987779 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820993 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:46:10.987779 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820996 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:46:10.987779 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.820998 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:46:10.987779 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821001 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:46:10.987779 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821004 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:46:10.987779 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821007 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:46:10.987779 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821010 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:46:10.987779 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821012 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:46:11.170509 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821015 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:46:11.170509 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821018 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:46:11.170509 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821021 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:46:11.170509 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821024 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:46:11.170509 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821027 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:46:11.170509 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821031 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:46:11.170509 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821034 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:46:11.170509 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821037 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:46:11.170509 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821039 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:46:11.170509 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821042 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:46:11.170509 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821045 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:46:11.170509 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821048 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:46:11.170509 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821051 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:46:11.170509 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821053 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:46:11.170509 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821056 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:46:11.170509 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821059 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:46:11.170509 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821062 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:46:11.170509 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821064 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:46:11.170509 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821067 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:46:11.170509 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821070 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:46:11.172530 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821073 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:46:11.172530 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821075 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:46:11.172530 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821078 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:46:11.172530 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821083 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:46:11.172530 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821086 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:46:11.172530 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821089 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:46:11.172530 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821091 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:46:11.172530 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821094 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:46:11.172530 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.821097 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:46:11.172530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.821106 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 22:46:11.172530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.828919 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 22:46:11.172530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.828937 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 22:46:11.172530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.828960 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 22:46:11.172530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.828969 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 22:46:11.172530 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829032 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:46:11.173117 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829037 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:46:11.173117 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829040 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:46:11.173117 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829044 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:46:11.173117 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829048 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:46:11.173117 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829051 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:46:11.173117 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829055 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:46:11.173117 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829058 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:46:11.173117 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829061 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:46:11.173117 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829064 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:46:11.173117 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829067 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:46:11.173117 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829070 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:46:11.173117 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829073 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:46:11.173117 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829076 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:46:11.173117 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829079 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:46:11.173117 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829082 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:46:11.173117 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829086 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:46:11.173117 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829088 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:46:11.173117 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829091 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:46:11.173117 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829094 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:46:11.173117 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829097 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:46:11.173706 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829099 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:46:11.173706 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829102 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:46:11.173706 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829105 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:46:11.173706 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829108 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:46:11.173706 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829111 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:46:11.173706 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829113 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:46:11.173706 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829116 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:46:11.173706 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829119 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:46:11.173706 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829171 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:46:11.173706 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829175 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:46:11.173706 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829178 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:46:11.173706 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829332 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:46:11.173706 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829368 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:46:11.173706 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829403 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:46:11.173706 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829407 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:46:11.173706 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829410 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:46:11.173706 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829413 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:46:11.173706 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829416 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:46:11.173706 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829565 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:46:11.173706 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829569 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:46:11.174404 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829606 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:46:11.174404 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829627 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:46:11.174404 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829631 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:46:11.174404 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829633 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:46:11.174404 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829636 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:46:11.174404 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829639 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:46:11.174404 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829850 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:46:11.174404 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829855 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:46:11.174404 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829859 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:46:11.174404 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.829862 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:46:11.174404 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.830037 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:46:11.174404 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.830072 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:46:11.174404 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.830076 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:46:11.174404 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.830079 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:46:11.174404 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.830082 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:46:11.174404 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.830085 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:46:11.174404 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.830196 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:46:11.174404 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.830200 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:46:11.174404 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.830236 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:46:11.175458 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.830296 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:46:11.175458 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.830300 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:46:11.175458 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.830304 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:46:11.175458 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.830307 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:46:11.175458 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.830310 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:46:11.175458 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.830511 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:46:11.175458 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.830525 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:46:11.175458 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.830528 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:46:11.175458 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.830531 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:46:11.175458 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.830534 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:46:11.175458 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.830743 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:46:11.175458 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.830746 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:46:11.175458 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.830749 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:46:11.175458 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.830752 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:46:11.175458 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.830968 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:46:11.175458 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.830974 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:46:11.175458 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.830977 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:46:11.175458 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.830980 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:46:11.175458 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831054 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:46:11.176056 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831091 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:46:11.176056 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831187 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:46:11.176056 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831191 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:46:11.176056 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831194 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:46:11.176056 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831197 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:46:11.176056 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831201 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:46:11.176056 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831411 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:46:11.176056 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831414 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:46:11.176056 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831417 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:46:11.176056 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831419 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:46:11.176056 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831422 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:46:11.176056 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831425 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:46:11.176056 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831461 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:46:11.176056 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831464 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:46:11.176056 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831471 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:46:11.176056 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831474 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:46:11.176056 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831477 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:46:11.176056 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831480 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:46:11.176056 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831483 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:46:11.176056 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831486 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:46:11.176649 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.831491 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 22:46:11.176649 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831621 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:46:11.176649 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831626 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:46:11.176649 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831630 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:46:11.176649 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831636 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:46:11.176649 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831640 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:46:11.176649 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831643 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:46:11.176649 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831646 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:46:11.176649 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831649 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:46:11.176649 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831652 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:46:11.176649 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831655 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:46:11.176649 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831658 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:46:11.176649 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831661 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:46:11.176649 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831664 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:46:11.176649 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831667 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:46:11.177221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831670 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:46:11.177221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831673 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:46:11.177221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831675 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:46:11.177221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831678 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:46:11.177221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831681 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:46:11.177221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831683 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:46:11.177221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831686 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:46:11.177221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831689 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:46:11.177221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831692 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:46:11.177221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831695 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:46:11.177221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831697 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:46:11.177221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831702 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:46:11.177221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831704 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:46:11.177221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831707 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:46:11.177221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831711 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:46:11.177221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831713 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:46:11.177221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831716 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:46:11.177221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831719 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:46:11.177221 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831722 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:46:11.177804 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831725 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:46:11.177804 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831728 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:46:11.177804 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831732 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:46:11.177804 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831735 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:46:11.177804 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831738 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:46:11.177804 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831740 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:46:11.177804 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831743 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:46:11.177804 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831746 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:46:11.177804 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831749 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:46:11.177804 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831751 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:46:11.177804 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831754 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:46:11.177804 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831757 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:46:11.177804 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831760 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:46:11.177804 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831763 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:46:11.177804 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831765 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:46:11.177804 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831768 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:46:11.177804 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831771 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:46:11.177804 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831774 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:46:11.177804 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831778 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:46:11.178397 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831782 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:46:11.178397 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831785 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:46:11.178397 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831788 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:46:11.178397 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831791 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:46:11.178397 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831794 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:46:11.178397 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831798 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:46:11.178397 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831801 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:46:11.178397 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831804 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:46:11.178397 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831807 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:46:11.178397 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831810 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:46:11.178397 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831814 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:46:11.178397 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831816 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:46:11.178397 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831819 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:46:11.178397 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831822 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:46:11.178397 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831825 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:46:11.178397 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831830 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:46:11.178397 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831834 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:46:11.178397 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831837 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:46:11.178397 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831840 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:46:11.179118 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831843 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:46:11.179118 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831846 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:46:11.179118 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831849 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:46:11.179118 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831852 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:46:11.179118 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831855 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:46:11.179118 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831858 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:46:11.179118 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831860 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:46:11.179118 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831864 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:46:11.179118 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831866 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:46:11.179118 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831869 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:46:11.179118 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831872 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:46:11.179118 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831887 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:46:11.179118 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831892 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:46:11.179118 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831897 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:46:11.179118 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831901 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:46:11.179118 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831905 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:46:11.179118 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831908 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:46:11.179118 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831912 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:46:11.179118 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831916 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:46:11.179118 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831919 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:46:11.337446 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831922 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:46:11.337446 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831925 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:46:11.337446 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831928 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:46:11.337446 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831932 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:46:11.337446 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831935 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:46:11.337446 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831938 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:46:11.337446 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831941 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:46:11.337446 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:10.831944 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:46:11.337446 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.831951 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 22:46:11.337446 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.832082 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 22:46:11.337446 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.834736 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 22:46:11.337446 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.836785 2566 server.go:1019] "Starting client certificate rotation" Jul 06 22:46:11.337446 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.836911 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 22:46:11.337446 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.837038 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 22:46:11.339360 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.840888 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 22:46:11.339360 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.845320 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 22:46:11.339360 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.854040 2566 log.go:25] "Validated CRI v1 runtime API" Jul 06 22:46:11.339360 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.857875 2566 log.go:25] "Validated CRI v1 image API" Jul 06 22:46:11.339360 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.858826 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 22:46:11.339360 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.865229 2566 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 f0fe8906-ad06-4e99-837f-b078bbd9aad0:/dev/nvme0n1p3 f802e1db-cbdb-41db-9d11-89112d1bd2c6:/dev/nvme0n1p4] Jul 06 22:46:11.339360 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.865246 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 22:46:11.339360 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.869308 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 22:46:11.340910 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.870830 2566 manager.go:216] Machine: {Timestamp:2026-07-06 22:46:10.869308757 +0000 UTC m=+0.334611033 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100634 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28d7a6cfb44f081d01f9aec626c577 SystemUUID:ec28d7a6-cfb4-4f08-1d01-f9aec626c577 BootID:e45fe968-cfcc-4714-a9a6-acd60d664558 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d8:7b:94:a3:7f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d8:7b:94:a3:7f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:f5:bf:85:d5:25 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 22:46:11.340910 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.870966 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 22:46:11.340910 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.871061 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 22:46:11.340910 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.874344 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 22:46:11.340910 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.874376 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-21.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 22:46:11.340910 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.875982 2566 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 22:46:11.340910 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.875994 2566 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 22:46:11.340910 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.876003 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 22:46:11.340910 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.876751 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 22:46:11.340910 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.878798 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 22:46:11.340910 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.882679 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 06 22:46:11.340910 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.882801 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 22:46:11.340910 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.882834 2566 kubelet.go:486] "Attempting to sync node with API server" Jul 06 22:46:11.340910 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.882845 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 22:46:11.340910 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.882861 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 22:46:11.340910 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.882872 2566 kubelet.go:398] "Adding apiserver pod source" Jul 06 22:46:11.340910 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.882896 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 22:46:11.340910 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.883292 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.883309 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.892461 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.895054 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.895085 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.896393 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.896409 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.896416 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.896422 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.896434 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.896441 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.896451 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.896456 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.896463 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.896469 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.896484 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.896491 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:10.896835 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-21.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:10.896933 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.897364 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.897373 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.900737 2566 server.go:1268] "Started kubelet" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.900806 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.900860 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.900935 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.908727 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:10.909579 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.910642 2566 server.go:310] "Adding debug handlers to kubelet server" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.914619 2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-21.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:10.914716 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-21.ec2.internal.18bfd4d0d7cb221c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-21.ec2.internal,UID:ip-10-0-131-21.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-21.ec2.internal,},FirstTimestamp:2026-07-06 22:46:10.90070582 +0000 UTC m=+0.366008096,LastTimestamp:2026-07-06 22:46:10.90070582 +0000 UTC m=+0.366008096,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-21.ec2.internal,}" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.919168 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.919177 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:10.919338 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-21.ec2.internal\" not found" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.920018 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.920032 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.920016 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.920112 2566 reconstruct.go:97] "Volume reconstruction finished" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.920130 2566 reconciler.go:29] "Reconciler: start to sync state" Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.920232 2566 factory.go:55] Registering systemd factory Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.920247 2566 factory.go:223] Registration of the systemd container factory successfully Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.920488 2566 factory.go:153] Registering CRI-O factory Jul 06 22:46:11.341508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.920512 2566 factory.go:223] Registration of the crio container factory successfully Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.920560 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.920579 2566 factory.go:103] Registering Raw factory Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.920592 2566 manager.go:1196] Started watching for new ooms in manager Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.921120 2566 manager.go:349] Starting recovery of all containers Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:10.929933 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:10.930018 2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-21.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.930308 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j89dg" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.931845 2566 manager.go:354] Recovery completed Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.937344 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.939356 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j89dg" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.939414 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-21.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.939442 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-21.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.939458 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-21.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.940105 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.940109 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.940117 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.940138 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.940971 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-21.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.940995 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-21.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.941009 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-21.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.941456 2566 policy_none.go:49] "None policy: Start" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.941476 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.941491 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:10.942200 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-21.ec2.internal.18bfd4d0da19ff9e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-21.ec2.internal,UID:ip-10-0-131-21.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-21.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-21.ec2.internal,},FirstTimestamp:2026-07-06 22:46:10.939428766 +0000 UTC m=+0.404731046,LastTimestamp:2026-07-06 22:46:10.939428766 +0000 UTC m=+0.404731046,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-21.ec2.internal,}" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.942775 2566 policy_none.go:47] "Start" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.994628 2566 manager.go:337] "Starting Device Plugin manager" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:10.994672 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.994687 2566 server.go:87] "Starting device plugin registration server" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.995002 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.995018 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.995190 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.995288 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:10.995297 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:10.995821 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:10.995914 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-21.ec2.internal\" not found" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.095093 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.096848 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 22:46:11.342651 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.097554 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-21.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.097584 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-21.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.097596 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-21.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.097627 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-21.ec2.internal" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.098315 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.098350 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.098370 2566 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:11.098406 2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.100766 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.107932 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-21.ec2.internal" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:11.107953 2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-21.ec2.internal\": node \"ip-10-0-131-21.ec2.internal\" not found" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:11.145968 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-21.ec2.internal\" not found" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.198523 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-21.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-21.ec2.internal"] Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.198625 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.200660 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-21.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.200690 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-21.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.200701 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-21.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.202439 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.202578 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-21.ec2.internal" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.202618 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.203390 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-21.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.203411 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-21.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.203421 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-21.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.203634 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-21.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.203645 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-21.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.203655 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-21.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.205058 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-21.ec2.internal" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.205088 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.206306 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-21.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.206325 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-21.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.206337 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-21.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.224691 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dbb144a944f238083eea932f5d6ef419-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-21.ec2.internal\" (UID: \"dbb144a944f238083eea932f5d6ef419\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-21.ec2.internal" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.224719 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbb144a944f238083eea932f5d6ef419-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-21.ec2.internal\" (UID: \"dbb144a944f238083eea932f5d6ef419\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-21.ec2.internal" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.224742 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/71bfcc916832c3d1846ee4d7572ec4f6-config\") pod \"kube-apiserver-proxy-ip-10-0-131-21.ec2.internal\" (UID: \"71bfcc916832c3d1846ee4d7572ec4f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-21.ec2.internal" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:11.237020 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-21.ec2.internal\" not found" node="ip-10-0-131-21.ec2.internal" Jul 06 22:46:11.343754 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:11.241999 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-21.ec2.internal\" not found" node="ip-10-0-131-21.ec2.internal" Jul 06 22:46:11.344774 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:11.246458 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-21.ec2.internal\" not found" Jul 06 22:46:11.344774 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.325035 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dbb144a944f238083eea932f5d6ef419-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-21.ec2.internal\" (UID: \"dbb144a944f238083eea932f5d6ef419\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-21.ec2.internal" Jul 06 22:46:11.344774 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.325066 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbb144a944f238083eea932f5d6ef419-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-21.ec2.internal\" (UID: \"dbb144a944f238083eea932f5d6ef419\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-21.ec2.internal" Jul 06 22:46:11.344774 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.325090 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/71bfcc916832c3d1846ee4d7572ec4f6-config\") pod \"kube-apiserver-proxy-ip-10-0-131-21.ec2.internal\" (UID: \"71bfcc916832c3d1846ee4d7572ec4f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-21.ec2.internal" Jul 06 22:46:11.344774 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.325150 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dbb144a944f238083eea932f5d6ef419-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-21.ec2.internal\" (UID: \"dbb144a944f238083eea932f5d6ef419\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-21.ec2.internal" Jul 06 22:46:11.344774 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.325172 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbb144a944f238083eea932f5d6ef419-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-21.ec2.internal\" (UID: \"dbb144a944f238083eea932f5d6ef419\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-21.ec2.internal" Jul 06 22:46:11.344774 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.325213 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/71bfcc916832c3d1846ee4d7572ec4f6-config\") pod \"kube-apiserver-proxy-ip-10-0-131-21.ec2.internal\" (UID: \"71bfcc916832c3d1846ee4d7572ec4f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-21.ec2.internal" Jul 06 22:46:11.495895 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:11.346940 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-21.ec2.internal\" not found" Jul 06 22:46:11.495895 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:11.448470 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-21.ec2.internal\" not found" Jul 06 22:46:11.652698 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.541501 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-21.ec2.internal" Jul 06 22:46:11.652698 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.547270 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-21.ec2.internal" Jul 06 22:46:11.652698 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:11.549443 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-21.ec2.internal\" not found" Jul 06 22:46:11.652698 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:11.650551 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-21.ec2.internal\" not found" Jul 06 22:46:11.805345 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.734677 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:46:11.805345 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.778617 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.820317 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-21.ec2.internal" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.833989 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.835117 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.835267 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.835277 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.836048 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-21.ec2.internal" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.868451 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.883699 2566 apiserver.go:52] "Watching apiserver" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.891682 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.892096 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-ls869","openshift-multus/multus-5frql","openshift-network-diagnostics/network-check-target-g7gjs","openshift-network-operator/iptables-alerter-nhdwm","openshift-ovn-kubernetes/ovnkube-node-jhdnr","kube-system/global-pull-secret-syncer-fc82v","kube-system/konnectivity-agent-5954w","openshift-cluster-node-tuning-operator/tuned-ckg82","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-21.ec2.internal","openshift-multus/multus-additional-cni-plugins-kcwnt","openshift-multus/network-metrics-daemon-s6867","kube-system/kube-apiserver-proxy-ip-10-0-131-21.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr","openshift-dns/node-resolver-dpsfc"] Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.893889 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5954w" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.901150 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.901171 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.901188 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.901149 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nhdwm" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:11.901219 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7gjs" podUID="c6f370f6-23e4-4c5f-927d-2b4528227518" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.901568 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.901702 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:11.901814 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc82v" podUID="6802a34f-0779-44b2-8c48-d3dadcc548ee" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.902032 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.902754 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dpsfc" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.903449 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-98l7t\"" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.904985 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.905147 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.905230 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ls869" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.905250 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.905364 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jhk4f\"" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.905670 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-d6skf\"" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.905722 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 22:46:11.938617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.905722 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.905780 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.906077 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-57t7q\"" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.906180 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.906250 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.906469 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.906508 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5frql" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.906529 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.906548 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bl746\"" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.906511 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.906770 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.906918 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.906954 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.908056 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kcwnt" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.908310 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.908391 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.908399 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zps9d\"" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.909652 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:11.909714 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s6867" podUID="420491ca-5a34-4390-900c-61bd11f56d77" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.911101 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.914379 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.914607 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qwg24\"" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.914688 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.914705 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.914793 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.914850 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ll6d9\"" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.914900 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.919506 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.919690 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.919709 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.919725 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.919781 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wzrbj\"" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.919841 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.920802 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 22:46:11.940081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.935572 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/17f510f7-764d-409b-ba17-b4c9761d5a83-device-dir\") pod \"aws-ebs-csi-driver-node-cmqkr\" (UID: \"17f510f7-764d-409b-ba17-b4c9761d5a83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr" Jul 06 22:46:11.943291 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.935597 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/afb97aaa-10b7-4dc2-94cd-f4b98b8b8912-serviceca\") pod \"node-ca-ls869\" (UID: \"afb97aaa-10b7-4dc2-94cd-f4b98b8b8912\") " pod="openshift-image-registry/node-ca-ls869" Jul 06 22:46:11.943291 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.935614 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-hostroot\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:11.943291 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.935630 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e1068e0c-7d61-469a-a508-dd97e6be6532-agent-certs\") pod \"konnectivity-agent-5954w\" (UID: \"e1068e0c-7d61-469a-a508-dd97e6be6532\") " pod="kube-system/konnectivity-agent-5954w" Jul 06 22:46:11.943291 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.935646 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxphr\" (UniqueName: \"kubernetes.io/projected/420491ca-5a34-4390-900c-61bd11f56d77-kube-api-access-fxphr\") pod \"network-metrics-daemon-s6867\" (UID: \"420491ca-5a34-4390-900c-61bd11f56d77\") " pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:11.943291 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.935686 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-etc-systemd\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:11.943291 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.935737 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8f0dfc20-fda6-49cb-a336-bf5fff3ef431-iptables-alerter-script\") pod \"iptables-alerter-nhdwm\" (UID: \"8f0dfc20-fda6-49cb-a336-bf5fff3ef431\") " pod="openshift-network-operator/iptables-alerter-nhdwm" Jul 06 22:46:11.943291 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.935779 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-host-run-netns\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:11.943291 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.935839 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/98470508-78de-405a-850c-4a3a20b09ca1-ovn-node-metrics-cert\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:11.943291 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.935867 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6802a34f-0779-44b2-8c48-d3dadcc548ee-dbus\") pod \"global-pull-secret-syncer-fc82v\" (UID: \"6802a34f-0779-44b2-8c48-d3dadcc548ee\") " pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:11.943291 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.935895 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fc501b7-3112-4f7e-b832-e14515946afa-tmp-dir\") pod \"node-resolver-dpsfc\" (UID: \"8fc501b7-3112-4f7e-b832-e14515946afa\") " pod="openshift-dns/node-resolver-dpsfc" Jul 06 22:46:11.943291 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.935919 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqv9b\" (UniqueName: \"kubernetes.io/projected/8fc501b7-3112-4f7e-b832-e14515946afa-kube-api-access-qqv9b\") pod \"node-resolver-dpsfc\" (UID: \"8fc501b7-3112-4f7e-b832-e14515946afa\") " pod="openshift-dns/node-resolver-dpsfc" Jul 06 22:46:11.943291 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.935953 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-sys\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:11.943291 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.935979 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6ec17726-3063-4e63-a872-20e1b4018b36-etc-tuned\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:11.943291 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936005 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/17f510f7-764d-409b-ba17-b4c9761d5a83-sys-fs\") pod \"aws-ebs-csi-driver-node-cmqkr\" (UID: \"17f510f7-764d-409b-ba17-b4c9761d5a83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr" Jul 06 22:46:11.943291 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936055 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-run-openvswitch\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:11.943291 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936096 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8fc501b7-3112-4f7e-b832-e14515946afa-hosts-file\") pod \"node-resolver-dpsfc\" (UID: \"8fc501b7-3112-4f7e-b832-e14515946afa\") " pod="openshift-dns/node-resolver-dpsfc" Jul 06 22:46:11.943291 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936129 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-system-cni-dir\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:11.944208 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936155 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-multus-socket-dir-parent\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:11.944208 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936181 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55227435-70da-4e08-af29-62da383155fc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kcwnt\" (UID: \"55227435-70da-4e08-af29-62da383155fc\") " pod="openshift-multus/multus-additional-cni-plugins-kcwnt" Jul 06 22:46:11.944208 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936207 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/17f510f7-764d-409b-ba17-b4c9761d5a83-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cmqkr\" (UID: \"17f510f7-764d-409b-ba17-b4c9761d5a83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr" Jul 06 22:46:11.944208 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936232 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-host-kubelet\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:11.944208 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936258 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-multus-cni-dir\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:11.944208 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936283 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-multus-conf-dir\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:11.944208 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936332 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-host-run-multus-certs\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:11.944208 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936359 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e1068e0c-7d61-469a-a508-dd97e6be6532-konnectivity-ca\") pod \"konnectivity-agent-5954w\" (UID: \"e1068e0c-7d61-469a-a508-dd97e6be6532\") " pod="kube-system/konnectivity-agent-5954w" Jul 06 22:46:11.944208 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936384 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shvr7\" (UniqueName: \"kubernetes.io/projected/8f0dfc20-fda6-49cb-a336-bf5fff3ef431-kube-api-access-shvr7\") pod \"iptables-alerter-nhdwm\" (UID: \"8f0dfc20-fda6-49cb-a336-bf5fff3ef431\") " pod="openshift-network-operator/iptables-alerter-nhdwm" Jul 06 22:46:11.944208 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936405 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-var-lib-openvswitch\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:11.944208 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936420 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-etc-openvswitch\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:11.944208 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936436 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-cnibin\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:11.944208 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936492 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-var-lib-kubelet\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:11.944208 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936523 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f0dfc20-fda6-49cb-a336-bf5fff3ef431-host-slash\") pod \"iptables-alerter-nhdwm\" (UID: \"8f0dfc20-fda6-49cb-a336-bf5fff3ef431\") " pod="openshift-network-operator/iptables-alerter-nhdwm" Jul 06 22:46:11.944208 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936551 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-host-var-lib-cni-bin\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:11.944208 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936578 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ec17726-3063-4e63-a872-20e1b4018b36-tmp\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:11.945139 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936606 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/17f510f7-764d-409b-ba17-b4c9761d5a83-socket-dir\") pod \"aws-ebs-csi-driver-node-cmqkr\" (UID: \"17f510f7-764d-409b-ba17-b4c9761d5a83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr" Jul 06 22:46:11.945139 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936637 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-host-cni-bin\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:11.945139 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936662 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2297dd87-145b-4fbf-95c3-7e235bbb35ba-cni-binary-copy\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:11.945139 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936691 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/55227435-70da-4e08-af29-62da383155fc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kcwnt\" (UID: \"55227435-70da-4e08-af29-62da383155fc\") " pod="openshift-multus/multus-additional-cni-plugins-kcwnt" Jul 06 22:46:11.945139 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936718 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-lib-modules\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:11.945139 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936744 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/17f510f7-764d-409b-ba17-b4c9761d5a83-etc-selinux\") pod \"aws-ebs-csi-driver-node-cmqkr\" (UID: \"17f510f7-764d-409b-ba17-b4c9761d5a83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr" Jul 06 22:46:11.945139 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936784 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-node-log\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:11.945139 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936823 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-log-socket\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:11.945139 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936864 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:11.945139 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936895 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/98470508-78de-405a-850c-4a3a20b09ca1-ovnkube-config\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:11.945139 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936919 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6802a34f-0779-44b2-8c48-d3dadcc548ee-kubelet-config\") pod \"global-pull-secret-syncer-fc82v\" (UID: \"6802a34f-0779-44b2-8c48-d3dadcc548ee\") " pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:11.945139 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936943 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-host-var-lib-kubelet\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:11.945139 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936967 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55227435-70da-4e08-af29-62da383155fc-cni-binary-copy\") pod \"multus-additional-cni-plugins-kcwnt\" (UID: \"55227435-70da-4e08-af29-62da383155fc\") " pod="openshift-multus/multus-additional-cni-plugins-kcwnt" Jul 06 22:46:11.945139 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.936990 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/98470508-78de-405a-850c-4a3a20b09ca1-env-overrides\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:11.945139 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937012 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvk6z\" (UniqueName: \"kubernetes.io/projected/98470508-78de-405a-850c-4a3a20b09ca1-kube-api-access-zvk6z\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:11.945139 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937034 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/afb97aaa-10b7-4dc2-94cd-f4b98b8b8912-host\") pod \"node-ca-ls869\" (UID: \"afb97aaa-10b7-4dc2-94cd-f4b98b8b8912\") " pod="openshift-image-registry/node-ca-ls869" Jul 06 22:46:11.945661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937055 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-host-run-k8s-cni-cncf-io\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:11.945661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937079 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55227435-70da-4e08-af29-62da383155fc-cnibin\") pod \"multus-additional-cni-plugins-kcwnt\" (UID: \"55227435-70da-4e08-af29-62da383155fc\") " pod="openshift-multus/multus-additional-cni-plugins-kcwnt" Jul 06 22:46:11.945661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937102 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/55227435-70da-4e08-af29-62da383155fc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kcwnt\" (UID: \"55227435-70da-4e08-af29-62da383155fc\") " pod="openshift-multus/multus-additional-cni-plugins-kcwnt" Jul 06 22:46:11.945661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937124 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-etc-modprobe-d\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:11.945661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937147 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-etc-sysctl-d\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:11.945661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937176 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td466\" (UniqueName: \"kubernetes.io/projected/17f510f7-764d-409b-ba17-b4c9761d5a83-kube-api-access-td466\") pod \"aws-ebs-csi-driver-node-cmqkr\" (UID: \"17f510f7-764d-409b-ba17-b4c9761d5a83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr" Jul 06 22:46:11.945661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937210 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5hz7\" (UniqueName: \"kubernetes.io/projected/c6f370f6-23e4-4c5f-927d-2b4528227518-kube-api-access-j5hz7\") pod \"network-check-target-g7gjs\" (UID: \"c6f370f6-23e4-4c5f-927d-2b4528227518\") " pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:46:11.945661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937238 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-etc-sysconfig\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:11.945661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937269 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/17f510f7-764d-409b-ba17-b4c9761d5a83-registration-dir\") pod \"aws-ebs-csi-driver-node-cmqkr\" (UID: \"17f510f7-764d-409b-ba17-b4c9761d5a83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr" Jul 06 22:46:11.945661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937291 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-run-systemd\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:11.945661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937327 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/98470508-78de-405a-850c-4a3a20b09ca1-ovnkube-script-lib\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:11.945661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937348 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9sn9\" (UniqueName: \"kubernetes.io/projected/afb97aaa-10b7-4dc2-94cd-f4b98b8b8912-kube-api-access-k9sn9\") pod \"node-ca-ls869\" (UID: \"afb97aaa-10b7-4dc2-94cd-f4b98b8b8912\") " pod="openshift-image-registry/node-ca-ls869" Jul 06 22:46:11.945661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937370 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-host-var-lib-cni-multus\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:11.945661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937390 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2297dd87-145b-4fbf-95c3-7e235bbb35ba-multus-daemon-config\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:11.945661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937414 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-etc-kubernetes\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:11.945661 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937440 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-host-run-ovn-kubernetes\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:11.946307 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937456 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6802a34f-0779-44b2-8c48-d3dadcc548ee-original-pull-secret\") pod \"global-pull-secret-syncer-fc82v\" (UID: \"6802a34f-0779-44b2-8c48-d3dadcc548ee\") " pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:11.946307 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937483 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp85h\" (UniqueName: \"kubernetes.io/projected/2297dd87-145b-4fbf-95c3-7e235bbb35ba-kube-api-access-qp85h\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:11.946307 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937500 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55227435-70da-4e08-af29-62da383155fc-os-release\") pod \"multus-additional-cni-plugins-kcwnt\" (UID: \"55227435-70da-4e08-af29-62da383155fc\") " pod="openshift-multus/multus-additional-cni-plugins-kcwnt" Jul 06 22:46:11.946307 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937525 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-etc-kubernetes\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:11.946307 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937563 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-systemd-units\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:11.946307 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937589 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-host-run-netns\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:11.946307 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937606 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqfsj\" (UniqueName: \"kubernetes.io/projected/55227435-70da-4e08-af29-62da383155fc-kube-api-access-cqfsj\") pod \"multus-additional-cni-plugins-kcwnt\" (UID: \"55227435-70da-4e08-af29-62da383155fc\") " pod="openshift-multus/multus-additional-cni-plugins-kcwnt" Jul 06 22:46:11.946307 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937624 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/420491ca-5a34-4390-900c-61bd11f56d77-metrics-certs\") pod \"network-metrics-daemon-s6867\" (UID: \"420491ca-5a34-4390-900c-61bd11f56d77\") " pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:11.946307 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937638 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-etc-sysctl-conf\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:11.946307 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937664 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-host\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:11.946307 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937686 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-host-slash\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:11.946307 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937707 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-run-ovn\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:11.946307 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937728 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-host-cni-netd\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:11.946307 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937749 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55227435-70da-4e08-af29-62da383155fc-system-cni-dir\") pod \"multus-additional-cni-plugins-kcwnt\" (UID: \"55227435-70da-4e08-af29-62da383155fc\") " pod="openshift-multus/multus-additional-cni-plugins-kcwnt" Jul 06 22:46:11.946307 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937776 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-run\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:11.946307 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937797 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9j6b\" (UniqueName: \"kubernetes.io/projected/6ec17726-3063-4e63-a872-20e1b4018b36-kube-api-access-c9j6b\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:11.947042 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.937851 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-os-release\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:11.947042 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.940848 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 22:46:11.947042 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.941366 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 22:41:11 +0000 UTC" deadline="2028-01-19 00:12:29.053373717 +0000 UTC" Jul 06 22:46:11.947042 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.941429 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13465h26m17.111948874s" Jul 06 22:46:12.089812 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.955751 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5cffj" Jul 06 22:46:12.089812 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:11.964220 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5cffj" Jul 06 22:46:12.089812 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.038505 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shvr7\" (UniqueName: \"kubernetes.io/projected/8f0dfc20-fda6-49cb-a336-bf5fff3ef431-kube-api-access-shvr7\") pod \"iptables-alerter-nhdwm\" (UID: \"8f0dfc20-fda6-49cb-a336-bf5fff3ef431\") " pod="openshift-network-operator/iptables-alerter-nhdwm" Jul 06 22:46:12.089812 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.038551 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-var-lib-openvswitch\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.089812 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.038576 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-etc-openvswitch\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.089812 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.038602 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-cnibin\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.089812 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.038628 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-var-lib-kubelet\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.089812 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.038645 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-var-lib-openvswitch\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.089812 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.038651 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f0dfc20-fda6-49cb-a336-bf5fff3ef431-host-slash\") pod \"iptables-alerter-nhdwm\" (UID: \"8f0dfc20-fda6-49cb-a336-bf5fff3ef431\") " pod="openshift-network-operator/iptables-alerter-nhdwm" Jul 06 22:46:12.089812 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.038686 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f0dfc20-fda6-49cb-a336-bf5fff3ef431-host-slash\") pod \"iptables-alerter-nhdwm\" (UID: \"8f0dfc20-fda6-49cb-a336-bf5fff3ef431\") " pod="openshift-network-operator/iptables-alerter-nhdwm" Jul 06 22:46:12.089812 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.038703 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-host-var-lib-cni-bin\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.089812 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.038669 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-etc-openvswitch\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.089812 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.038706 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-cnibin\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.089812 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.038723 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ec17726-3063-4e63-a872-20e1b4018b36-tmp\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.089812 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.038720 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-var-lib-kubelet\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.089812 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.038760 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-host-var-lib-cni-bin\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.089812 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.038774 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/17f510f7-764d-409b-ba17-b4c9761d5a83-socket-dir\") pod \"aws-ebs-csi-driver-node-cmqkr\" (UID: \"17f510f7-764d-409b-ba17-b4c9761d5a83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr" Jul 06 22:46:12.089812 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.038802 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-host-cni-bin\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.089812 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.038826 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2297dd87-145b-4fbf-95c3-7e235bbb35ba-cni-binary-copy\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.092459 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.038875 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-host-cni-bin\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.092459 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.038876 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/55227435-70da-4e08-af29-62da383155fc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kcwnt\" (UID: \"55227435-70da-4e08-af29-62da383155fc\") " pod="openshift-multus/multus-additional-cni-plugins-kcwnt" Jul 06 22:46:12.092459 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.038928 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-lib-modules\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.092459 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.038962 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/17f510f7-764d-409b-ba17-b4c9761d5a83-etc-selinux\") pod \"aws-ebs-csi-driver-node-cmqkr\" (UID: \"17f510f7-764d-409b-ba17-b4c9761d5a83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr" Jul 06 22:46:12.092459 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.038960 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/17f510f7-764d-409b-ba17-b4c9761d5a83-socket-dir\") pod \"aws-ebs-csi-driver-node-cmqkr\" (UID: \"17f510f7-764d-409b-ba17-b4c9761d5a83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr" Jul 06 22:46:12.092459 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039025 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-node-log\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.092459 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039078 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-lib-modules\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.092459 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039082 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/17f510f7-764d-409b-ba17-b4c9761d5a83-etc-selinux\") pod \"aws-ebs-csi-driver-node-cmqkr\" (UID: \"17f510f7-764d-409b-ba17-b4c9761d5a83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr" Jul 06 22:46:12.092459 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039101 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-log-socket\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.092459 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039119 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-node-log\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.092459 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039116 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 22:46:12.092459 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039136 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.092459 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039172 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-log-socket\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.092459 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039193 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/98470508-78de-405a-850c-4a3a20b09ca1-ovnkube-config\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.092459 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039224 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6802a34f-0779-44b2-8c48-d3dadcc548ee-kubelet-config\") pod \"global-pull-secret-syncer-fc82v\" (UID: \"6802a34f-0779-44b2-8c48-d3dadcc548ee\") " pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:12.092459 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039237 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.092459 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039267 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-host-var-lib-kubelet\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.093118 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039292 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55227435-70da-4e08-af29-62da383155fc-cni-binary-copy\") pod \"multus-additional-cni-plugins-kcwnt\" (UID: \"55227435-70da-4e08-af29-62da383155fc\") " pod="openshift-multus/multus-additional-cni-plugins-kcwnt" Jul 06 22:46:12.093118 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039321 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/98470508-78de-405a-850c-4a3a20b09ca1-env-overrides\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.093118 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039363 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvk6z\" (UniqueName: \"kubernetes.io/projected/98470508-78de-405a-850c-4a3a20b09ca1-kube-api-access-zvk6z\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.093118 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039387 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/afb97aaa-10b7-4dc2-94cd-f4b98b8b8912-host\") pod \"node-ca-ls869\" (UID: \"afb97aaa-10b7-4dc2-94cd-f4b98b8b8912\") " pod="openshift-image-registry/node-ca-ls869" Jul 06 22:46:12.093118 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039408 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-host-run-k8s-cni-cncf-io\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.093118 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039449 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55227435-70da-4e08-af29-62da383155fc-cnibin\") pod \"multus-additional-cni-plugins-kcwnt\" (UID: \"55227435-70da-4e08-af29-62da383155fc\") " pod="openshift-multus/multus-additional-cni-plugins-kcwnt" Jul 06 22:46:12.093118 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039479 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/55227435-70da-4e08-af29-62da383155fc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kcwnt\" (UID: \"55227435-70da-4e08-af29-62da383155fc\") " pod="openshift-multus/multus-additional-cni-plugins-kcwnt" Jul 06 22:46:12.093118 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039494 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2297dd87-145b-4fbf-95c3-7e235bbb35ba-cni-binary-copy\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.093118 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039555 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-etc-modprobe-d\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.093118 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039582 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-etc-sysctl-d\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.093118 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039586 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/55227435-70da-4e08-af29-62da383155fc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kcwnt\" (UID: \"55227435-70da-4e08-af29-62da383155fc\") " pod="openshift-multus/multus-additional-cni-plugins-kcwnt" Jul 06 22:46:12.093118 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039610 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td466\" (UniqueName: \"kubernetes.io/projected/17f510f7-764d-409b-ba17-b4c9761d5a83-kube-api-access-td466\") pod \"aws-ebs-csi-driver-node-cmqkr\" (UID: \"17f510f7-764d-409b-ba17-b4c9761d5a83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr" Jul 06 22:46:12.093118 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039638 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5hz7\" (UniqueName: \"kubernetes.io/projected/c6f370f6-23e4-4c5f-927d-2b4528227518-kube-api-access-j5hz7\") pod \"network-check-target-g7gjs\" (UID: \"c6f370f6-23e4-4c5f-927d-2b4528227518\") " pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:46:12.093118 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039664 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-etc-sysconfig\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.093118 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039694 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/17f510f7-764d-409b-ba17-b4c9761d5a83-registration-dir\") pod \"aws-ebs-csi-driver-node-cmqkr\" (UID: \"17f510f7-764d-409b-ba17-b4c9761d5a83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr" Jul 06 22:46:12.093118 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039720 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-run-systemd\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.093118 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039744 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/98470508-78de-405a-850c-4a3a20b09ca1-ovnkube-script-lib\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.094248 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039771 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9sn9\" (UniqueName: \"kubernetes.io/projected/afb97aaa-10b7-4dc2-94cd-f4b98b8b8912-kube-api-access-k9sn9\") pod \"node-ca-ls869\" (UID: \"afb97aaa-10b7-4dc2-94cd-f4b98b8b8912\") " pod="openshift-image-registry/node-ca-ls869" Jul 06 22:46:12.094248 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039796 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-host-var-lib-cni-multus\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.094248 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039823 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2297dd87-145b-4fbf-95c3-7e235bbb35ba-multus-daemon-config\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.094248 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039824 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/98470508-78de-405a-850c-4a3a20b09ca1-ovnkube-config\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.094248 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039883 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6802a34f-0779-44b2-8c48-d3dadcc548ee-kubelet-config\") pod \"global-pull-secret-syncer-fc82v\" (UID: \"6802a34f-0779-44b2-8c48-d3dadcc548ee\") " pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:12.094248 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039932 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-etc-modprobe-d\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.094248 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039944 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-etc-kubernetes\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.094248 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.039974 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-host-run-ovn-kubernetes\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.094248 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040003 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6802a34f-0779-44b2-8c48-d3dadcc548ee-original-pull-secret\") pod \"global-pull-secret-syncer-fc82v\" (UID: \"6802a34f-0779-44b2-8c48-d3dadcc548ee\") " pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:12.094248 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040029 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp85h\" (UniqueName: \"kubernetes.io/projected/2297dd87-145b-4fbf-95c3-7e235bbb35ba-kube-api-access-qp85h\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.094248 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040056 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55227435-70da-4e08-af29-62da383155fc-os-release\") pod \"multus-additional-cni-plugins-kcwnt\" (UID: \"55227435-70da-4e08-af29-62da383155fc\") " pod="openshift-multus/multus-additional-cni-plugins-kcwnt" Jul 06 22:46:12.094248 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040065 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55227435-70da-4e08-af29-62da383155fc-cni-binary-copy\") pod \"multus-additional-cni-plugins-kcwnt\" (UID: \"55227435-70da-4e08-af29-62da383155fc\") " pod="openshift-multus/multus-additional-cni-plugins-kcwnt" Jul 06 22:46:12.094248 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040081 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-etc-kubernetes\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.094248 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040109 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-systemd-units\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.094248 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040134 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-host-run-netns\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.094248 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040136 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-host-run-k8s-cni-cncf-io\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.094248 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040168 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqfsj\" (UniqueName: \"kubernetes.io/projected/55227435-70da-4e08-af29-62da383155fc-kube-api-access-cqfsj\") pod \"multus-additional-cni-plugins-kcwnt\" (UID: \"55227435-70da-4e08-af29-62da383155fc\") " pod="openshift-multus/multus-additional-cni-plugins-kcwnt" Jul 06 22:46:12.095223 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040201 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/420491ca-5a34-4390-900c-61bd11f56d77-metrics-certs\") pod \"network-metrics-daemon-s6867\" (UID: \"420491ca-5a34-4390-900c-61bd11f56d77\") " pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:12.095223 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040226 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-etc-sysctl-conf\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.095223 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040234 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-host-run-netns\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.095223 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040249 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-host\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.095223 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040258 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-etc-sysctl-d\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.095223 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040275 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-host-slash\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.095223 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040289 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2297dd87-145b-4fbf-95c3-7e235bbb35ba-multus-daemon-config\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.095223 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040303 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-run-ovn\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.095223 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040334 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55227435-70da-4e08-af29-62da383155fc-os-release\") pod \"multus-additional-cni-plugins-kcwnt\" (UID: \"55227435-70da-4e08-af29-62da383155fc\") " pod="openshift-multus/multus-additional-cni-plugins-kcwnt" Jul 06 22:46:12.095223 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040345 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-etc-kubernetes\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.095223 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040348 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-etc-sysconfig\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.095223 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040387 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-run-systemd\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.095223 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040397 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/17f510f7-764d-409b-ba17-b4c9761d5a83-registration-dir\") pod \"aws-ebs-csi-driver-node-cmqkr\" (UID: \"17f510f7-764d-409b-ba17-b4c9761d5a83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr" Jul 06 22:46:12.095223 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040355 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-host-cni-netd\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.095223 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040435 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55227435-70da-4e08-af29-62da383155fc-system-cni-dir\") pod \"multus-additional-cni-plugins-kcwnt\" (UID: \"55227435-70da-4e08-af29-62da383155fc\") " pod="openshift-multus/multus-additional-cni-plugins-kcwnt" Jul 06 22:46:12.095223 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040451 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-host-var-lib-cni-multus\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.095223 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040457 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-run\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.095223 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040465 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-etc-kubernetes\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.096514 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040481 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9j6b\" (UniqueName: \"kubernetes.io/projected/6ec17726-3063-4e63-a872-20e1b4018b36-kube-api-access-c9j6b\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.096514 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040494 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-host-run-ovn-kubernetes\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.096514 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040506 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-os-release\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.096514 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040531 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/17f510f7-764d-409b-ba17-b4c9761d5a83-device-dir\") pod \"aws-ebs-csi-driver-node-cmqkr\" (UID: \"17f510f7-764d-409b-ba17-b4c9761d5a83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr" Jul 06 22:46:12.096514 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040532 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-etc-sysctl-conf\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.096514 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040199 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-host-var-lib-kubelet\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.096514 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040555 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/afb97aaa-10b7-4dc2-94cd-f4b98b8b8912-serviceca\") pod \"node-ca-ls869\" (UID: \"afb97aaa-10b7-4dc2-94cd-f4b98b8b8912\") " pod="openshift-image-registry/node-ca-ls869" Jul 06 22:46:12.096514 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:12.040550 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:46:12.096514 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:12.040577 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:46:12.096514 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040581 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-hostroot\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.096514 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040606 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e1068e0c-7d61-469a-a508-dd97e6be6532-agent-certs\") pod \"konnectivity-agent-5954w\" (UID: \"e1068e0c-7d61-469a-a508-dd97e6be6532\") " pod="kube-system/konnectivity-agent-5954w" Jul 06 22:46:12.096514 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040609 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55227435-70da-4e08-af29-62da383155fc-cnibin\") pod \"multus-additional-cni-plugins-kcwnt\" (UID: \"55227435-70da-4e08-af29-62da383155fc\") " pod="openshift-multus/multus-additional-cni-plugins-kcwnt" Jul 06 22:46:12.096514 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:12.040635 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6802a34f-0779-44b2-8c48-d3dadcc548ee-original-pull-secret podName:6802a34f-0779-44b2-8c48-d3dadcc548ee nodeName:}" failed. No retries permitted until 2026-07-06 22:46:12.540613492 +0000 UTC m=+2.005915776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6802a34f-0779-44b2-8c48-d3dadcc548ee-original-pull-secret") pod "global-pull-secret-syncer-fc82v" (UID: "6802a34f-0779-44b2-8c48-d3dadcc548ee") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:46:12.096514 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040650 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-systemd-units\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.096514 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:12.040700 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/420491ca-5a34-4390-900c-61bd11f56d77-metrics-certs podName:420491ca-5a34-4390-900c-61bd11f56d77 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:12.540684179 +0000 UTC m=+2.005986445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/420491ca-5a34-4390-900c-61bd11f56d77-metrics-certs") pod "network-metrics-daemon-s6867" (UID: "420491ca-5a34-4390-900c-61bd11f56d77") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:46:12.096514 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040724 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxphr\" (UniqueName: \"kubernetes.io/projected/420491ca-5a34-4390-900c-61bd11f56d77-kube-api-access-fxphr\") pod \"network-metrics-daemon-s6867\" (UID: \"420491ca-5a34-4390-900c-61bd11f56d77\") " pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:12.096514 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040738 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/98470508-78de-405a-850c-4a3a20b09ca1-env-overrides\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.097425 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040752 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-etc-systemd\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.097425 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040783 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8f0dfc20-fda6-49cb-a336-bf5fff3ef431-iptables-alerter-script\") pod \"iptables-alerter-nhdwm\" (UID: \"8f0dfc20-fda6-49cb-a336-bf5fff3ef431\") " pod="openshift-network-operator/iptables-alerter-nhdwm" Jul 06 22:46:12.097425 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040815 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-host-run-netns\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.097425 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040840 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/98470508-78de-405a-850c-4a3a20b09ca1-ovn-node-metrics-cert\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.097425 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040870 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6802a34f-0779-44b2-8c48-d3dadcc548ee-dbus\") pod \"global-pull-secret-syncer-fc82v\" (UID: \"6802a34f-0779-44b2-8c48-d3dadcc548ee\") " pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:12.097425 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040922 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fc501b7-3112-4f7e-b832-e14515946afa-tmp-dir\") pod \"node-resolver-dpsfc\" (UID: \"8fc501b7-3112-4f7e-b832-e14515946afa\") " pod="openshift-dns/node-resolver-dpsfc" Jul 06 22:46:12.097425 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040950 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqv9b\" (UniqueName: \"kubernetes.io/projected/8fc501b7-3112-4f7e-b832-e14515946afa-kube-api-access-qqv9b\") pod \"node-resolver-dpsfc\" (UID: \"8fc501b7-3112-4f7e-b832-e14515946afa\") " pod="openshift-dns/node-resolver-dpsfc" Jul 06 22:46:12.097425 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.040978 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-sys\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.097425 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041007 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6ec17726-3063-4e63-a872-20e1b4018b36-etc-tuned\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.097425 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041028 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-etc-systemd\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.097425 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041035 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/17f510f7-764d-409b-ba17-b4c9761d5a83-sys-fs\") pod \"aws-ebs-csi-driver-node-cmqkr\" (UID: \"17f510f7-764d-409b-ba17-b4c9761d5a83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr" Jul 06 22:46:12.097425 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041064 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-run-openvswitch\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.097425 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041071 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/98470508-78de-405a-850c-4a3a20b09ca1-ovnkube-script-lib\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.097425 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041135 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-sys\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.097425 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041261 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-run-ovn\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.097425 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041393 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6802a34f-0779-44b2-8c48-d3dadcc548ee-dbus\") pod \"global-pull-secret-syncer-fc82v\" (UID: \"6802a34f-0779-44b2-8c48-d3dadcc548ee\") " pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:12.097425 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041417 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8f0dfc20-fda6-49cb-a336-bf5fff3ef431-iptables-alerter-script\") pod \"iptables-alerter-nhdwm\" (UID: \"8f0dfc20-fda6-49cb-a336-bf5fff3ef431\") " pod="openshift-network-operator/iptables-alerter-nhdwm" Jul 06 22:46:12.097425 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041430 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8fc501b7-3112-4f7e-b832-e14515946afa-hosts-file\") pod \"node-resolver-dpsfc\" (UID: \"8fc501b7-3112-4f7e-b832-e14515946afa\") " pod="openshift-dns/node-resolver-dpsfc" Jul 06 22:46:12.098496 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041431 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/55227435-70da-4e08-af29-62da383155fc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kcwnt\" (UID: \"55227435-70da-4e08-af29-62da383155fc\") " pod="openshift-multus/multus-additional-cni-plugins-kcwnt" Jul 06 22:46:12.098496 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041459 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-system-cni-dir\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.098496 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041476 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-run-openvswitch\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.098496 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041489 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-multus-socket-dir-parent\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.098496 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041501 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-host-slash\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.098496 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041517 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55227435-70da-4e08-af29-62da383155fc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kcwnt\" (UID: \"55227435-70da-4e08-af29-62da383155fc\") " pod="openshift-multus/multus-additional-cni-plugins-kcwnt" Jul 06 22:46:12.098496 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041520 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-host-cni-netd\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.098496 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041572 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55227435-70da-4e08-af29-62da383155fc-system-cni-dir\") pod \"multus-additional-cni-plugins-kcwnt\" (UID: \"55227435-70da-4e08-af29-62da383155fc\") " pod="openshift-multus/multus-additional-cni-plugins-kcwnt" Jul 06 22:46:12.098496 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041590 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-run\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.098496 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041633 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ec17726-3063-4e63-a872-20e1b4018b36-host\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.098496 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041675 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/17f510f7-764d-409b-ba17-b4c9761d5a83-device-dir\") pod \"aws-ebs-csi-driver-node-cmqkr\" (UID: \"17f510f7-764d-409b-ba17-b4c9761d5a83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr" Jul 06 22:46:12.098496 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041728 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55227435-70da-4e08-af29-62da383155fc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kcwnt\" (UID: \"55227435-70da-4e08-af29-62da383155fc\") " pod="openshift-multus/multus-additional-cni-plugins-kcwnt" Jul 06 22:46:12.098496 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041778 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-hostroot\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.098496 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041840 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-os-release\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.098496 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041901 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/17f510f7-764d-409b-ba17-b4c9761d5a83-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cmqkr\" (UID: \"17f510f7-764d-409b-ba17-b4c9761d5a83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr" Jul 06 22:46:12.098496 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041933 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/17f510f7-764d-409b-ba17-b4c9761d5a83-sys-fs\") pod \"aws-ebs-csi-driver-node-cmqkr\" (UID: \"17f510f7-764d-409b-ba17-b4c9761d5a83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr" Jul 06 22:46:12.098496 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041932 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-host-kubelet\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.098496 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041973 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/afb97aaa-10b7-4dc2-94cd-f4b98b8b8912-serviceca\") pod \"node-ca-ls869\" (UID: \"afb97aaa-10b7-4dc2-94cd-f4b98b8b8912\") " pod="openshift-image-registry/node-ca-ls869" Jul 06 22:46:12.099288 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041995 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-host-kubelet\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.099288 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.041998 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-multus-cni-dir\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.099288 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.042030 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-multus-conf-dir\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.099288 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.042049 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8fc501b7-3112-4f7e-b832-e14515946afa-hosts-file\") pod \"node-resolver-dpsfc\" (UID: \"8fc501b7-3112-4f7e-b832-e14515946afa\") " pod="openshift-dns/node-resolver-dpsfc" Jul 06 22:46:12.099288 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.042099 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-system-cni-dir\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.099288 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.042156 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98470508-78de-405a-850c-4a3a20b09ca1-host-run-netns\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.099288 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.042254 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fc501b7-3112-4f7e-b832-e14515946afa-tmp-dir\") pod \"node-resolver-dpsfc\" (UID: \"8fc501b7-3112-4f7e-b832-e14515946afa\") " pod="openshift-dns/node-resolver-dpsfc" Jul 06 22:46:12.099288 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.042044 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-multus-socket-dir-parent\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.099288 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.042387 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/17f510f7-764d-409b-ba17-b4c9761d5a83-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cmqkr\" (UID: \"17f510f7-764d-409b-ba17-b4c9761d5a83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr" Jul 06 22:46:12.099288 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.042403 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-host-run-multus-certs\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.099288 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.042432 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-multus-conf-dir\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.099288 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.042432 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-multus-cni-dir\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.099288 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.042444 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e1068e0c-7d61-469a-a508-dd97e6be6532-konnectivity-ca\") pod \"konnectivity-agent-5954w\" (UID: \"e1068e0c-7d61-469a-a508-dd97e6be6532\") " pod="kube-system/konnectivity-agent-5954w" Jul 06 22:46:12.099288 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.042500 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2297dd87-145b-4fbf-95c3-7e235bbb35ba-host-run-multus-certs\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.099288 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.042559 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/afb97aaa-10b7-4dc2-94cd-f4b98b8b8912-host\") pod \"node-ca-ls869\" (UID: \"afb97aaa-10b7-4dc2-94cd-f4b98b8b8912\") " pod="openshift-image-registry/node-ca-ls869" Jul 06 22:46:12.099288 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.043044 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e1068e0c-7d61-469a-a508-dd97e6be6532-konnectivity-ca\") pod \"konnectivity-agent-5954w\" (UID: \"e1068e0c-7d61-469a-a508-dd97e6be6532\") " pod="kube-system/konnectivity-agent-5954w" Jul 06 22:46:12.099288 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.043078 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ec17726-3063-4e63-a872-20e1b4018b36-tmp\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.099288 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.043586 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/98470508-78de-405a-850c-4a3a20b09ca1-ovn-node-metrics-cert\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.100141 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.043625 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e1068e0c-7d61-469a-a508-dd97e6be6532-agent-certs\") pod \"konnectivity-agent-5954w\" (UID: \"e1068e0c-7d61-469a-a508-dd97e6be6532\") " pod="kube-system/konnectivity-agent-5954w" Jul 06 22:46:12.100141 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.043719 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6ec17726-3063-4e63-a872-20e1b4018b36-etc-tuned\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.100141 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:12.049333 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:46:12.100141 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:12.049368 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:46:12.100141 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:12.049400 2566 projected.go:196] Error preparing data for projected volume kube-api-access-j5hz7 for pod openshift-network-diagnostics/network-check-target-g7gjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:46:12.100141 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:12.049498 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6f370f6-23e4-4c5f-927d-2b4528227518-kube-api-access-j5hz7 podName:c6f370f6-23e4-4c5f-927d-2b4528227518 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:12.549475272 +0000 UTC m=+2.014777549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-j5hz7" (UniqueName: "kubernetes.io/projected/c6f370f6-23e4-4c5f-927d-2b4528227518-kube-api-access-j5hz7") pod "network-check-target-g7gjs" (UID: "c6f370f6-23e4-4c5f-927d-2b4528227518") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:46:12.100141 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.050573 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp85h\" (UniqueName: \"kubernetes.io/projected/2297dd87-145b-4fbf-95c3-7e235bbb35ba-kube-api-access-qp85h\") pod \"multus-5frql\" (UID: \"2297dd87-145b-4fbf-95c3-7e235bbb35ba\") " pod="openshift-multus/multus-5frql" Jul 06 22:46:12.100141 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.050713 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9sn9\" (UniqueName: \"kubernetes.io/projected/afb97aaa-10b7-4dc2-94cd-f4b98b8b8912-kube-api-access-k9sn9\") pod \"node-ca-ls869\" (UID: \"afb97aaa-10b7-4dc2-94cd-f4b98b8b8912\") " pod="openshift-image-registry/node-ca-ls869" Jul 06 22:46:12.100141 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.053463 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9j6b\" (UniqueName: \"kubernetes.io/projected/6ec17726-3063-4e63-a872-20e1b4018b36-kube-api-access-c9j6b\") pod \"tuned-ckg82\" (UID: \"6ec17726-3063-4e63-a872-20e1b4018b36\") " pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.100141 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.054844 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvk6z\" (UniqueName: \"kubernetes.io/projected/98470508-78de-405a-850c-4a3a20b09ca1-kube-api-access-zvk6z\") pod \"ovnkube-node-jhdnr\" (UID: \"98470508-78de-405a-850c-4a3a20b09ca1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.100141 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.054842 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-td466\" (UniqueName: \"kubernetes.io/projected/17f510f7-764d-409b-ba17-b4c9761d5a83-kube-api-access-td466\") pod \"aws-ebs-csi-driver-node-cmqkr\" (UID: \"17f510f7-764d-409b-ba17-b4c9761d5a83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr" Jul 06 22:46:12.100141 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.055631 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxphr\" (UniqueName: \"kubernetes.io/projected/420491ca-5a34-4390-900c-61bd11f56d77-kube-api-access-fxphr\") pod \"network-metrics-daemon-s6867\" (UID: \"420491ca-5a34-4390-900c-61bd11f56d77\") " pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:12.100141 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.071499 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ckg82" Jul 06 22:46:12.100141 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.074221 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqfsj\" (UniqueName: \"kubernetes.io/projected/55227435-70da-4e08-af29-62da383155fc-kube-api-access-cqfsj\") pod \"multus-additional-cni-plugins-kcwnt\" (UID: \"55227435-70da-4e08-af29-62da383155fc\") " pod="openshift-multus/multus-additional-cni-plugins-kcwnt" Jul 06 22:46:12.100141 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.075812 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shvr7\" (UniqueName: \"kubernetes.io/projected/8f0dfc20-fda6-49cb-a336-bf5fff3ef431-kube-api-access-shvr7\") pod \"iptables-alerter-nhdwm\" (UID: \"8f0dfc20-fda6-49cb-a336-bf5fff3ef431\") " pod="openshift-network-operator/iptables-alerter-nhdwm" Jul 06 22:46:12.100141 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.077409 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqv9b\" (UniqueName: \"kubernetes.io/projected/8fc501b7-3112-4f7e-b832-e14515946afa-kube-api-access-qqv9b\") pod \"node-resolver-dpsfc\" (UID: \"8fc501b7-3112-4f7e-b832-e14515946afa\") " pod="openshift-dns/node-resolver-dpsfc" Jul 06 22:46:12.241085 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.229187 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5954w" Jul 06 22:46:12.241085 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.239942 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5frql" Jul 06 22:46:12.431179 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.249157 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr" Jul 06 22:46:12.431179 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:12.254655 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2297dd87_145b_4fbf_95c3_7e235bbb35ba.slice/crio-fca720715353d3ae95dc1e5d762b5e1ef9d3e22efe857fce4375ce4df2acc27f WatchSource:0}: Error finding container fca720715353d3ae95dc1e5d762b5e1ef9d3e22efe857fce4375ce4df2acc27f: Status 404 returned error can't find the container with id fca720715353d3ae95dc1e5d762b5e1ef9d3e22efe857fce4375ce4df2acc27f Jul 06 22:46:12.431179 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.263833 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 22:46:12.431179 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:12.265908 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f510f7_764d_409b_ba17_b4c9761d5a83.slice/crio-67e32713bbeb4f6d312f34ae61a005234b93c8f87271ae2b07c5d35e7c199d6c WatchSource:0}: Error finding container 67e32713bbeb4f6d312f34ae61a005234b93c8f87271ae2b07c5d35e7c199d6c: Status 404 returned error can't find the container with id 67e32713bbeb4f6d312f34ae61a005234b93c8f87271ae2b07c5d35e7c199d6c Jul 06 22:46:12.431179 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.270545 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:12.431179 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:12.283426 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98470508_78de_405a_850c_4a3a20b09ca1.slice/crio-78f58b1ee7905557a60b988c00d657e30816abb3d9039c28eaa5061f938ca027 WatchSource:0}: Error finding container 78f58b1ee7905557a60b988c00d657e30816abb3d9039c28eaa5061f938ca027: Status 404 returned error can't find the container with id 78f58b1ee7905557a60b988c00d657e30816abb3d9039c28eaa5061f938ca027 Jul 06 22:46:12.431179 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.294523 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nhdwm" Jul 06 22:46:12.431179 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.299927 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dpsfc" Jul 06 22:46:12.431179 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:12.301763 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f0dfc20_fda6_49cb_a336_bf5fff3ef431.slice/crio-bd30f3782d012ee62a933ec69030883c48e13760984f08f340f0641e83f6663d WatchSource:0}: Error finding container bd30f3782d012ee62a933ec69030883c48e13760984f08f340f0641e83f6663d: Status 404 returned error can't find the container with id bd30f3782d012ee62a933ec69030883c48e13760984f08f340f0641e83f6663d Jul 06 22:46:12.431179 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:12.313132 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fc501b7_3112_4f7e_b832_e14515946afa.slice/crio-fbc0c8354201b95fad203365d4dbe9013204bcf26e4c7d5ba366a0ec0f892aac WatchSource:0}: Error finding container fbc0c8354201b95fad203365d4dbe9013204bcf26e4c7d5ba366a0ec0f892aac: Status 404 returned error can't find the container with id fbc0c8354201b95fad203365d4dbe9013204bcf26e4c7d5ba366a0ec0f892aac Jul 06 22:46:12.431179 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.314924 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ls869" Jul 06 22:46:12.431179 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:12.324108 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafb97aaa_10b7_4dc2_94cd_f4b98b8b8912.slice/crio-7dc36cc79cc21eeb62b3b60b58b205f73f528b08291bc4c026b0aca15c3f2dc5 WatchSource:0}: Error finding container 7dc36cc79cc21eeb62b3b60b58b205f73f528b08291bc4c026b0aca15c3f2dc5: Status 404 returned error can't find the container with id 7dc36cc79cc21eeb62b3b60b58b205f73f528b08291bc4c026b0aca15c3f2dc5 Jul 06 22:46:12.431179 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.329503 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:46:12.431179 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.343581 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kcwnt" Jul 06 22:46:12.431179 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:12.352897 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55227435_70da_4e08_af29_62da383155fc.slice/crio-612185bd21317389c3d6cf2257f9d62359b4640e2d0efa38893f0d6447541fcd WatchSource:0}: Error finding container 612185bd21317389c3d6cf2257f9d62359b4640e2d0efa38893f0d6447541fcd: Status 404 returned error can't find the container with id 612185bd21317389c3d6cf2257f9d62359b4640e2d0efa38893f0d6447541fcd Jul 06 22:46:12.626384 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:12.451997 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ec17726_3063_4e63_a872_20e1b4018b36.slice/crio-60f660cc3e63a3b05953ecad2770cab971bcb981a02538f9455586a0a08e3f84 WatchSource:0}: Error finding container 60f660cc3e63a3b05953ecad2770cab971bcb981a02538f9455586a0a08e3f84: Status 404 returned error can't find the container with id 60f660cc3e63a3b05953ecad2770cab971bcb981a02538f9455586a0a08e3f84 Jul 06 22:46:12.626384 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:12.453944 2566 kuberuntime_manager.go:1459] "Unhandled Error" err="container tuned start failed in pod tuned-ckg82_openshift-cluster-node-tuning-operator(6ec17726-3063-4e63-a872-20e1b4018b36): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Jul 06 22:46:12.626384 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:12.453981 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"tuned\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-cluster-node-tuning-operator/tuned-ckg82" podUID="6ec17726-3063-4e63-a872-20e1b4018b36" Jul 06 22:46:12.626384 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.549632 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5hz7\" (UniqueName: \"kubernetes.io/projected/c6f370f6-23e4-4c5f-927d-2b4528227518-kube-api-access-j5hz7\") pod \"network-check-target-g7gjs\" (UID: \"c6f370f6-23e4-4c5f-927d-2b4528227518\") " pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:46:12.626384 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.549677 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6802a34f-0779-44b2-8c48-d3dadcc548ee-original-pull-secret\") pod \"global-pull-secret-syncer-fc82v\" (UID: \"6802a34f-0779-44b2-8c48-d3dadcc548ee\") " pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:12.626384 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.549700 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/420491ca-5a34-4390-900c-61bd11f56d77-metrics-certs\") pod \"network-metrics-daemon-s6867\" (UID: \"420491ca-5a34-4390-900c-61bd11f56d77\") " pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:12.626384 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:12.549813 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:46:12.626384 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:12.549850 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:46:12.626384 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:12.549874 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:46:12.626384 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:12.549878 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:46:12.626384 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:12.549902 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6802a34f-0779-44b2-8c48-d3dadcc548ee-original-pull-secret podName:6802a34f-0779-44b2-8c48-d3dadcc548ee nodeName:}" failed. No retries permitted until 2026-07-06 22:46:13.549873888 +0000 UTC m=+3.015176160 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6802a34f-0779-44b2-8c48-d3dadcc548ee-original-pull-secret") pod "global-pull-secret-syncer-fc82v" (UID: "6802a34f-0779-44b2-8c48-d3dadcc548ee") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:46:12.626384 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:12.549943 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/420491ca-5a34-4390-900c-61bd11f56d77-metrics-certs podName:420491ca-5a34-4390-900c-61bd11f56d77 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:13.549931926 +0000 UTC m=+3.015234189 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/420491ca-5a34-4390-900c-61bd11f56d77-metrics-certs") pod "network-metrics-daemon-s6867" (UID: "420491ca-5a34-4390-900c-61bd11f56d77") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:46:12.626384 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:12.549923 2566 projected.go:196] Error preparing data for projected volume kube-api-access-j5hz7 for pod openshift-network-diagnostics/network-check-target-g7gjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:46:12.626384 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:12.549984 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6f370f6-23e4-4c5f-927d-2b4528227518-kube-api-access-j5hz7 podName:c6f370f6-23e4-4c5f-927d-2b4528227518 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:13.549975714 +0000 UTC m=+3.015277978 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-j5hz7" (UniqueName: "kubernetes.io/projected/c6f370f6-23e4-4c5f-927d-2b4528227518-kube-api-access-j5hz7") pod "network-check-target-g7gjs" (UID: "c6f370f6-23e4-4c5f-927d-2b4528227518") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:46:12.966828 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.966750 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 22:41:12 +0000 UTC" deadline="2028-04-12 03:08:12.92332471 +0000 UTC" Jul 06 22:46:12.967764 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:12.966835 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15484h21m59.956493154s" Jul 06 22:46:13.058060 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:13.057813 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:46:13.101686 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:13.101067 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:46:13.101686 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:13.101247 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7gjs" podUID="c6f370f6-23e4-4c5f-927d-2b4528227518" Jul 06 22:46:13.110416 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:13.110257 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" event={"ID":"98470508-78de-405a-850c-4a3a20b09ca1","Type":"ContainerStarted","Data":"78f58b1ee7905557a60b988c00d657e30816abb3d9039c28eaa5061f938ca027"} Jul 06 22:46:13.121535 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:13.121422 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-21.ec2.internal" event={"ID":"dbb144a944f238083eea932f5d6ef419","Type":"ContainerStarted","Data":"ba71bedb766c762dc2d61289dc53ef4502135c54aa7f0ea3500e15ef0f0394f1"} Jul 06 22:46:13.129074 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:13.129035 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5954w" event={"ID":"e1068e0c-7d61-469a-a508-dd97e6be6532","Type":"ContainerStarted","Data":"aaaa2ed826805ba0e2eab42b78c36dc827a4aa690ccc749bc817137786015cd7"} Jul 06 22:46:13.138081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:13.137995 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-21.ec2.internal" event={"ID":"71bfcc916832c3d1846ee4d7572ec4f6","Type":"ContainerStarted","Data":"ca96680cd48eccc477f76521a6a33202b8afa06724f67aac5cfc022dc4300bf4"} Jul 06 22:46:13.143955 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:13.143434 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ckg82" event={"ID":"6ec17726-3063-4e63-a872-20e1b4018b36","Type":"ContainerStarted","Data":"60f660cc3e63a3b05953ecad2770cab971bcb981a02538f9455586a0a08e3f84"} Jul 06 22:46:13.149336 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:13.147959 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"tuned\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5be8cdcf34f35a89a70b6bfa49e66897641871237570b3e09766f83a0a473e6a\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-cluster-node-tuning-operator/tuned-ckg82" podUID="6ec17726-3063-4e63-a872-20e1b4018b36" Jul 06 22:46:13.156377 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:13.156274 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcwnt" event={"ID":"55227435-70da-4e08-af29-62da383155fc","Type":"ContainerStarted","Data":"612185bd21317389c3d6cf2257f9d62359b4640e2d0efa38893f0d6447541fcd"} Jul 06 22:46:13.162999 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:13.162623 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dpsfc" event={"ID":"8fc501b7-3112-4f7e-b832-e14515946afa","Type":"ContainerStarted","Data":"fbc0c8354201b95fad203365d4dbe9013204bcf26e4c7d5ba366a0ec0f892aac"} Jul 06 22:46:13.180522 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:13.180477 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr" event={"ID":"17f510f7-764d-409b-ba17-b4c9761d5a83","Type":"ContainerStarted","Data":"67e32713bbeb4f6d312f34ae61a005234b93c8f87271ae2b07c5d35e7c199d6c"} Jul 06 22:46:13.198775 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:13.198733 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5frql" event={"ID":"2297dd87-145b-4fbf-95c3-7e235bbb35ba","Type":"ContainerStarted","Data":"fca720715353d3ae95dc1e5d762b5e1ef9d3e22efe857fce4375ce4df2acc27f"} Jul 06 22:46:13.207749 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:13.207657 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ls869" event={"ID":"afb97aaa-10b7-4dc2-94cd-f4b98b8b8912","Type":"ContainerStarted","Data":"7dc36cc79cc21eeb62b3b60b58b205f73f528b08291bc4c026b0aca15c3f2dc5"} Jul 06 22:46:13.229315 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:13.229159 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nhdwm" event={"ID":"8f0dfc20-fda6-49cb-a336-bf5fff3ef431","Type":"ContainerStarted","Data":"bd30f3782d012ee62a933ec69030883c48e13760984f08f340f0641e83f6663d"} Jul 06 22:46:13.559478 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:13.558411 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5hz7\" (UniqueName: \"kubernetes.io/projected/c6f370f6-23e4-4c5f-927d-2b4528227518-kube-api-access-j5hz7\") pod \"network-check-target-g7gjs\" (UID: \"c6f370f6-23e4-4c5f-927d-2b4528227518\") " pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:46:13.559478 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:13.558470 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6802a34f-0779-44b2-8c48-d3dadcc548ee-original-pull-secret\") pod \"global-pull-secret-syncer-fc82v\" (UID: \"6802a34f-0779-44b2-8c48-d3dadcc548ee\") " pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:13.559478 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:13.558504 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/420491ca-5a34-4390-900c-61bd11f56d77-metrics-certs\") pod \"network-metrics-daemon-s6867\" (UID: \"420491ca-5a34-4390-900c-61bd11f56d77\") " pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:13.559478 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:13.558668 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:46:13.559478 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:13.558736 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/420491ca-5a34-4390-900c-61bd11f56d77-metrics-certs podName:420491ca-5a34-4390-900c-61bd11f56d77 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:15.558714933 +0000 UTC m=+5.024017215 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/420491ca-5a34-4390-900c-61bd11f56d77-metrics-certs") pod "network-metrics-daemon-s6867" (UID: "420491ca-5a34-4390-900c-61bd11f56d77") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:46:13.559478 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:13.559194 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:46:13.559478 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:13.559213 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:46:13.559478 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:13.559227 2566 projected.go:196] Error preparing data for projected volume kube-api-access-j5hz7 for pod openshift-network-diagnostics/network-check-target-g7gjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:46:13.559478 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:13.559286 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6f370f6-23e4-4c5f-927d-2b4528227518-kube-api-access-j5hz7 podName:c6f370f6-23e4-4c5f-927d-2b4528227518 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:15.559260745 +0000 UTC m=+5.024563021 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-j5hz7" (UniqueName: "kubernetes.io/projected/c6f370f6-23e4-4c5f-927d-2b4528227518-kube-api-access-j5hz7") pod "network-check-target-g7gjs" (UID: "c6f370f6-23e4-4c5f-927d-2b4528227518") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:46:13.559478 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:13.559353 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:46:13.559478 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:13.559387 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6802a34f-0779-44b2-8c48-d3dadcc548ee-original-pull-secret podName:6802a34f-0779-44b2-8c48-d3dadcc548ee nodeName:}" failed. No retries permitted until 2026-07-06 22:46:15.559375835 +0000 UTC m=+5.024678104 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6802a34f-0779-44b2-8c48-d3dadcc548ee-original-pull-secret") pod "global-pull-secret-syncer-fc82v" (UID: "6802a34f-0779-44b2-8c48-d3dadcc548ee") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:46:13.598909 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:13.598660 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:46:13.967862 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:13.967774 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 22:41:12 +0000 UTC" deadline="2028-04-02 14:32:42.343064598 +0000 UTC" Jul 06 22:46:13.967862 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:13.967825 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15255h46m28.375257873s" Jul 06 22:46:14.099215 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:14.099169 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:14.099406 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:14.099353 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc82v" podUID="6802a34f-0779-44b2-8c48-d3dadcc548ee" Jul 06 22:46:14.099872 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:14.099847 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:14.100017 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:14.099990 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s6867" podUID="420491ca-5a34-4390-900c-61bd11f56d77" Jul 06 22:46:15.101681 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:15.101638 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:46:15.102178 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:15.101784 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7gjs" podUID="c6f370f6-23e4-4c5f-927d-2b4528227518" Jul 06 22:46:15.576478 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:15.576434 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5hz7\" (UniqueName: \"kubernetes.io/projected/c6f370f6-23e4-4c5f-927d-2b4528227518-kube-api-access-j5hz7\") pod \"network-check-target-g7gjs\" (UID: \"c6f370f6-23e4-4c5f-927d-2b4528227518\") " pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:46:15.576667 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:15.576519 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6802a34f-0779-44b2-8c48-d3dadcc548ee-original-pull-secret\") pod \"global-pull-secret-syncer-fc82v\" (UID: \"6802a34f-0779-44b2-8c48-d3dadcc548ee\") " pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:15.576667 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:15.576559 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/420491ca-5a34-4390-900c-61bd11f56d77-metrics-certs\") pod \"network-metrics-daemon-s6867\" (UID: \"420491ca-5a34-4390-900c-61bd11f56d77\") " pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:15.576774 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:15.576694 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:46:15.576774 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:15.576763 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/420491ca-5a34-4390-900c-61bd11f56d77-metrics-certs podName:420491ca-5a34-4390-900c-61bd11f56d77 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:19.576741916 +0000 UTC m=+9.042044182 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/420491ca-5a34-4390-900c-61bd11f56d77-metrics-certs") pod "network-metrics-daemon-s6867" (UID: "420491ca-5a34-4390-900c-61bd11f56d77") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:46:15.577239 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:15.577218 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:46:15.577330 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:15.577244 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:46:15.577330 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:15.577258 2566 projected.go:196] Error preparing data for projected volume kube-api-access-j5hz7 for pod openshift-network-diagnostics/network-check-target-g7gjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:46:15.577330 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:15.577307 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6f370f6-23e4-4c5f-927d-2b4528227518-kube-api-access-j5hz7 podName:c6f370f6-23e4-4c5f-927d-2b4528227518 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:19.577290734 +0000 UTC m=+9.042593014 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-j5hz7" (UniqueName: "kubernetes.io/projected/c6f370f6-23e4-4c5f-927d-2b4528227518-kube-api-access-j5hz7") pod "network-check-target-g7gjs" (UID: "c6f370f6-23e4-4c5f-927d-2b4528227518") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:46:15.577498 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:15.577385 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:46:15.577498 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:15.577421 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6802a34f-0779-44b2-8c48-d3dadcc548ee-original-pull-secret podName:6802a34f-0779-44b2-8c48-d3dadcc548ee nodeName:}" failed. No retries permitted until 2026-07-06 22:46:19.577408838 +0000 UTC m=+9.042711114 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6802a34f-0779-44b2-8c48-d3dadcc548ee-original-pull-secret") pod "global-pull-secret-syncer-fc82v" (UID: "6802a34f-0779-44b2-8c48-d3dadcc548ee") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:46:16.098632 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:16.098597 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:16.098856 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:16.098635 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:16.098856 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:16.098745 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc82v" podUID="6802a34f-0779-44b2-8c48-d3dadcc548ee" Jul 06 22:46:16.098993 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:16.098896 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s6867" podUID="420491ca-5a34-4390-900c-61bd11f56d77" Jul 06 22:46:17.099057 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:17.099027 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:46:17.099523 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:17.099164 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7gjs" podUID="c6f370f6-23e4-4c5f-927d-2b4528227518" Jul 06 22:46:18.099059 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:18.099017 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:18.099238 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:18.099070 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:18.099238 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:18.099164 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s6867" podUID="420491ca-5a34-4390-900c-61bd11f56d77" Jul 06 22:46:18.099681 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:18.099262 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc82v" podUID="6802a34f-0779-44b2-8c48-d3dadcc548ee" Jul 06 22:46:19.100323 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:19.098837 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:46:19.100323 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:19.099196 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7gjs" podUID="c6f370f6-23e4-4c5f-927d-2b4528227518" Jul 06 22:46:19.611253 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:19.611215 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6802a34f-0779-44b2-8c48-d3dadcc548ee-original-pull-secret\") pod \"global-pull-secret-syncer-fc82v\" (UID: \"6802a34f-0779-44b2-8c48-d3dadcc548ee\") " pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:19.611447 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:19.611273 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/420491ca-5a34-4390-900c-61bd11f56d77-metrics-certs\") pod \"network-metrics-daemon-s6867\" (UID: \"420491ca-5a34-4390-900c-61bd11f56d77\") " pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:19.611447 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:19.611339 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5hz7\" (UniqueName: \"kubernetes.io/projected/c6f370f6-23e4-4c5f-927d-2b4528227518-kube-api-access-j5hz7\") pod \"network-check-target-g7gjs\" (UID: \"c6f370f6-23e4-4c5f-927d-2b4528227518\") " pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:46:19.611555 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:19.611480 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:46:19.611555 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:19.611501 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:46:19.611555 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:19.611512 2566 projected.go:196] Error preparing data for projected volume kube-api-access-j5hz7 for pod openshift-network-diagnostics/network-check-target-g7gjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:46:19.611761 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:19.611569 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6f370f6-23e4-4c5f-927d-2b4528227518-kube-api-access-j5hz7 podName:c6f370f6-23e4-4c5f-927d-2b4528227518 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:27.611552004 +0000 UTC m=+17.076854270 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-j5hz7" (UniqueName: "kubernetes.io/projected/c6f370f6-23e4-4c5f-927d-2b4528227518-kube-api-access-j5hz7") pod "network-check-target-g7gjs" (UID: "c6f370f6-23e4-4c5f-927d-2b4528227518") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:46:19.611882 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:19.611859 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:46:19.611940 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:19.611931 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/420491ca-5a34-4390-900c-61bd11f56d77-metrics-certs podName:420491ca-5a34-4390-900c-61bd11f56d77 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:27.611911726 +0000 UTC m=+17.077213991 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/420491ca-5a34-4390-900c-61bd11f56d77-metrics-certs") pod "network-metrics-daemon-s6867" (UID: "420491ca-5a34-4390-900c-61bd11f56d77") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:46:19.611983 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:19.611964 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:46:19.612039 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:19.612013 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6802a34f-0779-44b2-8c48-d3dadcc548ee-original-pull-secret podName:6802a34f-0779-44b2-8c48-d3dadcc548ee nodeName:}" failed. No retries permitted until 2026-07-06 22:46:27.611998571 +0000 UTC m=+17.077300835 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6802a34f-0779-44b2-8c48-d3dadcc548ee-original-pull-secret") pod "global-pull-secret-syncer-fc82v" (UID: "6802a34f-0779-44b2-8c48-d3dadcc548ee") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:46:20.098934 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:20.098857 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:20.099086 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:20.098857 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:20.099086 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:20.098989 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s6867" podUID="420491ca-5a34-4390-900c-61bd11f56d77" Jul 06 22:46:20.099086 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:20.099076 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc82v" podUID="6802a34f-0779-44b2-8c48-d3dadcc548ee" Jul 06 22:46:21.100401 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:21.100362 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:46:21.100867 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:21.100480 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7gjs" podUID="c6f370f6-23e4-4c5f-927d-2b4528227518" Jul 06 22:46:22.099656 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:22.099565 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:22.099848 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:22.099565 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:22.099848 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:22.099705 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc82v" podUID="6802a34f-0779-44b2-8c48-d3dadcc548ee" Jul 06 22:46:22.099848 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:22.099754 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s6867" podUID="420491ca-5a34-4390-900c-61bd11f56d77" Jul 06 22:46:22.265575 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:22.265544 2566 generic.go:356] "Generic (PLEG): container finished" podID="dbb144a944f238083eea932f5d6ef419" containerID="7a18270ca7c097589b47966c31d64d6a8bbd21c07b465e42ebc616f4124af0b7" exitCode=0 Jul 06 22:46:22.266063 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:22.265637 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-21.ec2.internal" event={"ID":"dbb144a944f238083eea932f5d6ef419","Type":"ContainerDied","Data":"7a18270ca7c097589b47966c31d64d6a8bbd21c07b465e42ebc616f4124af0b7"} Jul 06 22:46:22.267320 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:22.267292 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5954w" event={"ID":"e1068e0c-7d61-469a-a508-dd97e6be6532","Type":"ContainerStarted","Data":"b1f617fce418bc502cf3cfc641f11f9e1ddcced58a85a3a892db2ced0d7ceb5e"} Jul 06 22:46:22.268801 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:22.268774 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-21.ec2.internal" event={"ID":"71bfcc916832c3d1846ee4d7572ec4f6","Type":"ContainerStarted","Data":"db1760b429f7e856f2455aedd341866eb51b93c4d95f0bf084e4ce4d331d7569"} Jul 06 22:46:22.270225 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:22.270204 2566 generic.go:356] "Generic (PLEG): container finished" podID="55227435-70da-4e08-af29-62da383155fc" containerID="c66d77eccdde3a70557548e289e6c51728516d57b1339080d391fc60889c3712" exitCode=0 Jul 06 22:46:22.270316 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:22.270265 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcwnt" event={"ID":"55227435-70da-4e08-af29-62da383155fc","Type":"ContainerDied","Data":"c66d77eccdde3a70557548e289e6c51728516d57b1339080d391fc60889c3712"} Jul 06 22:46:22.271895 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:22.271764 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dpsfc" event={"ID":"8fc501b7-3112-4f7e-b832-e14515946afa","Type":"ContainerStarted","Data":"8d077f3b273fec048a86f7d277b0820d3b10b3393554183788ae4cf6cf0e1660"} Jul 06 22:46:22.273316 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:22.273275 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr" event={"ID":"17f510f7-764d-409b-ba17-b4c9761d5a83","Type":"ContainerStarted","Data":"27a91e13b48e011c1c29bfbfa21a077f67ea1c57a73b7da73132798b2d6f8a14"} Jul 06 22:46:22.274767 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:22.274745 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ls869" event={"ID":"afb97aaa-10b7-4dc2-94cd-f4b98b8b8912","Type":"ContainerStarted","Data":"05f2b5047c58a429b082e32500447d565f0f9753cd2c0e77ca204509754a932b"} Jul 06 22:46:22.300300 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:22.300249 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dpsfc" podStartSLOduration=2.186345652 podStartE2EDuration="11.300231831s" totalImagesPullingTime="9.113886179s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:46:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:46:22.300034941 +0000 UTC m=+11.765337222" watchObservedRunningTime="2026-07-06 22:46:22.300231831 +0000 UTC m=+11.765534113" Jul 06 22:46:22.314094 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:22.313951 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ls869" podStartSLOduration=2.2057359930000002 podStartE2EDuration="11.313929477s" totalImagesPullingTime="9.108193484s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:46:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:46:22.313786099 +0000 UTC m=+11.779088393" watchObservedRunningTime="2026-07-06 22:46:22.313929477 +0000 UTC m=+11.779231759" Jul 06 22:46:22.353027 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:22.352913 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-21.ec2.internal" podStartSLOduration=10.352891288 podStartE2EDuration="10.352891288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:46:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:46:22.352402362 +0000 UTC m=+11.817704645" watchObservedRunningTime="2026-07-06 22:46:22.352891288 +0000 UTC m=+11.818193574" Jul 06 22:46:22.367004 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:22.366955 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5954w" podStartSLOduration=2.201995206 podStartE2EDuration="11.366939819s" totalImagesPullingTime="9.164944613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:46:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:46:22.366130592 +0000 UTC m=+11.831432882" watchObservedRunningTime="2026-07-06 22:46:22.366939819 +0000 UTC m=+11.832242102" Jul 06 22:46:22.499994 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:22.499958 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5954w" Jul 06 22:46:22.500669 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:22.500645 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5954w" Jul 06 22:46:23.099218 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:23.099184 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:46:23.099410 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:23.099313 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7gjs" podUID="c6f370f6-23e4-4c5f-927d-2b4528227518" Jul 06 22:46:23.279277 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:23.279186 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nhdwm" event={"ID":"8f0dfc20-fda6-49cb-a336-bf5fff3ef431","Type":"ContainerStarted","Data":"b3e27a3e8cd9958b9ff06dff5627e2df103f27a33e049f57db78d66c5689ddc7"} Jul 06 22:46:23.292412 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:23.292359 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nhdwm" podStartSLOduration=3.167370431 podStartE2EDuration="12.292340024s" totalImagesPullingTime="9.124969593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:46:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:46:23.292331489 +0000 UTC m=+12.757633771" watchObservedRunningTime="2026-07-06 22:46:23.292340024 +0000 UTC m=+12.757642307" Jul 06 22:46:24.099563 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:24.099518 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:24.099757 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:24.099540 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:24.099757 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:24.099655 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s6867" podUID="420491ca-5a34-4390-900c-61bd11f56d77" Jul 06 22:46:24.099757 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:24.099731 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc82v" podUID="6802a34f-0779-44b2-8c48-d3dadcc548ee" Jul 06 22:46:24.280786 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:24.280756 2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 22:46:25.099249 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:25.099215 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:46:25.099423 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:25.099344 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7gjs" podUID="c6f370f6-23e4-4c5f-927d-2b4528227518" Jul 06 22:46:26.099560 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:26.099525 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:26.100223 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:26.099659 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s6867" podUID="420491ca-5a34-4390-900c-61bd11f56d77" Jul 06 22:46:26.100223 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:26.099525 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:26.100223 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:26.099755 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc82v" podUID="6802a34f-0779-44b2-8c48-d3dadcc548ee" Jul 06 22:46:27.099119 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:27.099089 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:46:27.099298 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:27.099223 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7gjs" podUID="c6f370f6-23e4-4c5f-927d-2b4528227518" Jul 06 22:46:27.671203 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:27.671164 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5hz7\" (UniqueName: \"kubernetes.io/projected/c6f370f6-23e4-4c5f-927d-2b4528227518-kube-api-access-j5hz7\") pod \"network-check-target-g7gjs\" (UID: \"c6f370f6-23e4-4c5f-927d-2b4528227518\") " pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:46:27.671931 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:27.671225 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6802a34f-0779-44b2-8c48-d3dadcc548ee-original-pull-secret\") pod \"global-pull-secret-syncer-fc82v\" (UID: \"6802a34f-0779-44b2-8c48-d3dadcc548ee\") " pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:27.671931 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:27.671419 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:46:27.671931 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:27.671444 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:46:27.671931 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:27.671457 2566 projected.go:196] Error preparing data for projected volume kube-api-access-j5hz7 for pod openshift-network-diagnostics/network-check-target-g7gjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:46:27.671931 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:27.671512 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:46:27.671931 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:27.671522 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:46:27.671931 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:27.671514 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6f370f6-23e4-4c5f-927d-2b4528227518-kube-api-access-j5hz7 podName:c6f370f6-23e4-4c5f-927d-2b4528227518 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:43.671495435 +0000 UTC m=+33.136797713 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-j5hz7" (UniqueName: "kubernetes.io/projected/c6f370f6-23e4-4c5f-927d-2b4528227518-kube-api-access-j5hz7") pod "network-check-target-g7gjs" (UID: "c6f370f6-23e4-4c5f-927d-2b4528227518") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:46:27.671931 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:27.671420 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/420491ca-5a34-4390-900c-61bd11f56d77-metrics-certs\") pod \"network-metrics-daemon-s6867\" (UID: \"420491ca-5a34-4390-900c-61bd11f56d77\") " pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:27.671931 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:27.671577 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6802a34f-0779-44b2-8c48-d3dadcc548ee-original-pull-secret podName:6802a34f-0779-44b2-8c48-d3dadcc548ee nodeName:}" failed. No retries permitted until 2026-07-06 22:46:43.671561538 +0000 UTC m=+33.136863802 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6802a34f-0779-44b2-8c48-d3dadcc548ee-original-pull-secret") pod "global-pull-secret-syncer-fc82v" (UID: "6802a34f-0779-44b2-8c48-d3dadcc548ee") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:46:27.671931 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:27.671601 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/420491ca-5a34-4390-900c-61bd11f56d77-metrics-certs podName:420491ca-5a34-4390-900c-61bd11f56d77 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:43.671592157 +0000 UTC m=+33.136894422 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/420491ca-5a34-4390-900c-61bd11f56d77-metrics-certs") pod "network-metrics-daemon-s6867" (UID: "420491ca-5a34-4390-900c-61bd11f56d77") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:46:28.044983 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:28.044887 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5954w" Jul 06 22:46:28.045119 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:28.045108 2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 22:46:28.045531 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:28.045495 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5954w" Jul 06 22:46:28.099536 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:28.099493 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:28.099718 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:28.099493 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:28.099718 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:28.099633 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc82v" podUID="6802a34f-0779-44b2-8c48-d3dadcc548ee" Jul 06 22:46:28.099873 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:28.099768 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s6867" podUID="420491ca-5a34-4390-900c-61bd11f56d77" Jul 06 22:46:29.099525 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:29.099496 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:46:29.100035 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:29.099625 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7gjs" podUID="c6f370f6-23e4-4c5f-927d-2b4528227518" Jul 06 22:46:30.099240 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:30.099197 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:30.099415 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:30.099353 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s6867" podUID="420491ca-5a34-4390-900c-61bd11f56d77" Jul 06 22:46:30.099498 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:30.099429 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:30.099575 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:30.099552 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc82v" podUID="6802a34f-0779-44b2-8c48-d3dadcc548ee" Jul 06 22:46:31.100100 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:31.100072 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:46:31.100486 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:31.100171 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7gjs" podUID="c6f370f6-23e4-4c5f-927d-2b4528227518" Jul 06 22:46:32.099020 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:32.098983 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:32.099206 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:32.099022 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:32.099206 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:32.099133 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s6867" podUID="420491ca-5a34-4390-900c-61bd11f56d77" Jul 06 22:46:32.099365 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:32.099336 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc82v" podUID="6802a34f-0779-44b2-8c48-d3dadcc548ee" Jul 06 22:46:32.993254 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:32.993028 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 22:46:33.005347 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:33.005251 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T22:46:32.993198128Z","UUID":"6c020fa9-ec7b-4baf-a0f3-ead1b33d196a","Handler":null,"Name":"","Endpoint":""} Jul 06 22:46:33.010633 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:33.010463 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 22:46:33.010633 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:33.010510 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 22:46:33.099010 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:33.098860 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:46:33.099010 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:33.098978 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7gjs" podUID="c6f370f6-23e4-4c5f-927d-2b4528227518" Jul 06 22:46:33.300682 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:33.300513 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-21.ec2.internal" event={"ID":"dbb144a944f238083eea932f5d6ef419","Type":"ContainerStarted","Data":"20e2d5ed6ed0bebc243ccd3a29f0d6b6d470aff2e4aadb4592dcb5d7c49bbfa0"} Jul 06 22:46:33.302291 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:33.302264 2566 generic.go:356] "Generic (PLEG): container finished" podID="55227435-70da-4e08-af29-62da383155fc" containerID="f420c35ff1c9ed5c2b63359a4fb1261e20ad6ed502a68aa7145e45a19b8f42e4" exitCode=0 Jul 06 22:46:33.302415 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:33.302338 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcwnt" event={"ID":"55227435-70da-4e08-af29-62da383155fc","Type":"ContainerDied","Data":"f420c35ff1c9ed5c2b63359a4fb1261e20ad6ed502a68aa7145e45a19b8f42e4"} Jul 06 22:46:33.304147 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:33.304126 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr" event={"ID":"17f510f7-764d-409b-ba17-b4c9761d5a83","Type":"ContainerStarted","Data":"1f658336954b4612ec62ddf75549c749d57ee41701d6deecfb63c958cf5b8245"} Jul 06 22:46:33.305597 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:33.305572 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5frql" event={"ID":"2297dd87-145b-4fbf-95c3-7e235bbb35ba","Type":"ContainerStarted","Data":"f61272aa2feac1c6513ac9aaad7dd07c476c4502f3f69a57cfb28c643893a795"} Jul 06 22:46:33.307891 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:33.307873 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" event={"ID":"98470508-78de-405a-850c-4a3a20b09ca1","Type":"ContainerStarted","Data":"e440ca337cdeaab8ac94893aa6e3fe530b127ac3c6a4aa9acb66c35893336156"} Jul 06 22:46:33.307975 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:33.307924 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" event={"ID":"98470508-78de-405a-850c-4a3a20b09ca1","Type":"ContainerStarted","Data":"84b367e4e1a27c66259b66dc24d50ca4c902151a36ff3436a96dbc60e75d9e96"} Jul 06 22:46:33.307975 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:33.307957 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" event={"ID":"98470508-78de-405a-850c-4a3a20b09ca1","Type":"ContainerStarted","Data":"ed0b6234d9dc15a911720f84b867efce99e7315449eed8ed683596f3a37a4e38"} Jul 06 22:46:33.308042 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:33.308002 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" event={"ID":"98470508-78de-405a-850c-4a3a20b09ca1","Type":"ContainerStarted","Data":"6adeef9eec7c34151ad2750ceb35cd95bf33bb7cbf02086aec8dda48d5b3e17d"} Jul 06 22:46:33.308042 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:33.308034 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" event={"ID":"98470508-78de-405a-850c-4a3a20b09ca1","Type":"ContainerStarted","Data":"93584d4307fa5b0a830647aab7e17cb6239f2f9aea376ed153fbe548119b60cc"} Jul 06 22:46:33.418244 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:33.418195 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-21.ec2.internal" podStartSLOduration=21.418179414 podStartE2EDuration="21.418179414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:46:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:46:33.418053045 +0000 UTC m=+22.883355327" watchObservedRunningTime="2026-07-06 22:46:33.418179414 +0000 UTC m=+22.883481696" Jul 06 22:46:33.418507 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:33.418487 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5frql" podStartSLOduration=1.850766254 podStartE2EDuration="22.418480487s" totalImagesPullingTime="20.567714233s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:46:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:46:33.366195494 +0000 UTC m=+22.831497777" watchObservedRunningTime="2026-07-06 22:46:33.418480487 +0000 UTC m=+22.883782816" Jul 06 22:46:34.098667 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:34.098627 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:34.098667 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:34.098647 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:34.099141 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:34.098772 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s6867" podUID="420491ca-5a34-4390-900c-61bd11f56d77" Jul 06 22:46:34.099141 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:34.098892 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc82v" podUID="6802a34f-0779-44b2-8c48-d3dadcc548ee" Jul 06 22:46:34.313885 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:34.313784 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" event={"ID":"98470508-78de-405a-850c-4a3a20b09ca1","Type":"ContainerStarted","Data":"07e3319f3f5e4824426c42620c18e257919c8d3c16f7d98a17e641203f958f6a"} Jul 06 22:46:35.099235 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:35.099192 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:46:35.099625 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:35.099327 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7gjs" podUID="c6f370f6-23e4-4c5f-927d-2b4528227518" Jul 06 22:46:36.098780 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:36.098743 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:36.098780 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:36.098778 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:36.098980 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:36.098868 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc82v" podUID="6802a34f-0779-44b2-8c48-d3dadcc548ee" Jul 06 22:46:36.099124 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:36.099103 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s6867" podUID="420491ca-5a34-4390-900c-61bd11f56d77" Jul 06 22:46:36.322149 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:36.322072 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" event={"ID":"98470508-78de-405a-850c-4a3a20b09ca1","Type":"ContainerStarted","Data":"f9688b340287e8edadb836adaa0f8840122a4da07c7007c8cce115d35310a2bf"} Jul 06 22:46:36.323644 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:36.323613 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ckg82" event={"ID":"6ec17726-3063-4e63-a872-20e1b4018b36","Type":"ContainerStarted","Data":"4cde611cbae4e4d130a282237c732601ccad7dc6a7f38fddfaa29e7f5f5f9292"} Jul 06 22:46:37.099602 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:37.099575 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:46:37.099748 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:37.099668 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7gjs" podUID="c6f370f6-23e4-4c5f-927d-2b4528227518" Jul 06 22:46:37.327507 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:37.327472 2566 generic.go:356] "Generic (PLEG): container finished" podID="55227435-70da-4e08-af29-62da383155fc" containerID="65910d330f9a5572589da48ec30d39dcbc426dd0f888ffb189cf1e0346933457" exitCode=0 Jul 06 22:46:37.328135 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:37.327559 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcwnt" event={"ID":"55227435-70da-4e08-af29-62da383155fc","Type":"ContainerDied","Data":"65910d330f9a5572589da48ec30d39dcbc426dd0f888ffb189cf1e0346933457"} Jul 06 22:46:37.329734 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:37.329710 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr" event={"ID":"17f510f7-764d-409b-ba17-b4c9761d5a83","Type":"ContainerStarted","Data":"54c3874100cd30b5a3ab4abf1dbd0fe8428a06a1d6236d6d9e72aa6e84e15628"} Jul 06 22:46:37.348998 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:37.348956 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ckg82" podStartSLOduration=2.902653205 podStartE2EDuration="26.348942908s" totalImagesPullingTime="23.446289703s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:46:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-06 22:46:36.338582823 +0000 UTC m=+25.803885117" watchObservedRunningTime="2026-07-06 22:46:37.348942908 +0000 UTC m=+26.814245214" Jul 06 22:46:37.367364 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:37.367284 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmqkr" podStartSLOduration=4.178985207 podStartE2EDuration="26.367272999s" totalImagesPullingTime="22.188287792s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:46:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:46:37.36700243 +0000 UTC m=+26.832304724" watchObservedRunningTime="2026-07-06 22:46:37.367272999 +0000 UTC m=+26.832575282" Jul 06 22:46:38.098722 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:38.098550 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:38.098905 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:38.098586 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:38.098905 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:38.098824 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc82v" podUID="6802a34f-0779-44b2-8c48-d3dadcc548ee" Jul 06 22:46:38.098976 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:38.098912 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s6867" podUID="420491ca-5a34-4390-900c-61bd11f56d77" Jul 06 22:46:38.334921 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:38.334880 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" event={"ID":"98470508-78de-405a-850c-4a3a20b09ca1","Type":"ContainerStarted","Data":"de268adec3833e83e4e2ffd0420c2e7bdee48c12c10ce599e5c006499aa6e572"} Jul 06 22:46:38.383072 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:38.382988 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" podStartSLOduration=8.599099881 podStartE2EDuration="27.382973572s" totalImagesPullingTime="18.783873691s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:46:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:46:38.382361285 +0000 UTC m=+27.847663567" watchObservedRunningTime="2026-07-06 22:46:38.382973572 +0000 UTC m=+27.848275853" Jul 06 22:46:39.099150 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:39.099125 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:46:39.099278 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:39.099228 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7gjs" podUID="c6f370f6-23e4-4c5f-927d-2b4528227518" Jul 06 22:46:39.339300 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:39.339272 2566 generic.go:356] "Generic (PLEG): container finished" podID="55227435-70da-4e08-af29-62da383155fc" containerID="cf1d38da4818ed9d4f2ca928b0d7458bf5a1ee09f9edd5c77cbc063ddb9f2508" exitCode=0 Jul 06 22:46:39.339656 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:39.339357 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcwnt" event={"ID":"55227435-70da-4e08-af29-62da383155fc","Type":"ContainerDied","Data":"cf1d38da4818ed9d4f2ca928b0d7458bf5a1ee09f9edd5c77cbc063ddb9f2508"} Jul 06 22:46:39.339789 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:39.339758 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:39.339946 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:39.339849 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:39.339946 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:39.339901 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:39.354796 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:39.354746 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:39.355069 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:39.355056 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:46:39.714135 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:39.714052 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s6867"] Jul 06 22:46:39.714262 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:39.714212 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:39.714346 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:39.714327 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s6867" podUID="420491ca-5a34-4390-900c-61bd11f56d77" Jul 06 22:46:39.720250 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:39.718876 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-g7gjs"] Jul 06 22:46:39.720250 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:39.718966 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fc82v"] Jul 06 22:46:39.720250 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:39.719050 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:39.720250 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:39.719199 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc82v" podUID="6802a34f-0779-44b2-8c48-d3dadcc548ee" Jul 06 22:46:39.720250 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:39.719281 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:46:39.720250 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:39.719373 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7gjs" podUID="c6f370f6-23e4-4c5f-927d-2b4528227518" Jul 06 22:46:41.099622 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:41.099594 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:46:41.100002 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:41.099685 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7gjs" podUID="c6f370f6-23e4-4c5f-927d-2b4528227518" Jul 06 22:46:41.100002 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:41.099776 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:41.100002 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:41.099890 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s6867" podUID="420491ca-5a34-4390-900c-61bd11f56d77" Jul 06 22:46:41.100002 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:41.099931 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:41.100131 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:41.100000 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc82v" podUID="6802a34f-0779-44b2-8c48-d3dadcc548ee" Jul 06 22:46:43.099598 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:43.099419 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:46:43.100096 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:43.099419 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:43.100096 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:43.099696 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7gjs" podUID="c6f370f6-23e4-4c5f-927d-2b4528227518" Jul 06 22:46:43.100096 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:43.099428 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:43.100096 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:43.099775 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc82v" podUID="6802a34f-0779-44b2-8c48-d3dadcc548ee" Jul 06 22:46:43.100096 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:43.099869 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s6867" podUID="420491ca-5a34-4390-900c-61bd11f56d77" Jul 06 22:46:43.692402 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:43.692362 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5hz7\" (UniqueName: \"kubernetes.io/projected/c6f370f6-23e4-4c5f-927d-2b4528227518-kube-api-access-j5hz7\") pod \"network-check-target-g7gjs\" (UID: \"c6f370f6-23e4-4c5f-927d-2b4528227518\") " pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:46:43.692671 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:43.692419 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6802a34f-0779-44b2-8c48-d3dadcc548ee-original-pull-secret\") pod \"global-pull-secret-syncer-fc82v\" (UID: \"6802a34f-0779-44b2-8c48-d3dadcc548ee\") " pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:43.692671 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:43.692448 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/420491ca-5a34-4390-900c-61bd11f56d77-metrics-certs\") pod \"network-metrics-daemon-s6867\" (UID: \"420491ca-5a34-4390-900c-61bd11f56d77\") " pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:43.692671 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:43.692560 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:46:43.692671 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:43.692577 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:46:43.692671 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:43.692583 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:46:43.692671 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:43.692596 2566 projected.go:196] Error preparing data for projected volume kube-api-access-j5hz7 for pod openshift-network-diagnostics/network-check-target-g7gjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:46:43.692671 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:43.692582 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:46:43.692671 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:43.692637 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/420491ca-5a34-4390-900c-61bd11f56d77-metrics-certs podName:420491ca-5a34-4390-900c-61bd11f56d77 nodeName:}" failed. No retries permitted until 2026-07-06 22:47:15.692617636 +0000 UTC m=+65.157919912 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/420491ca-5a34-4390-900c-61bd11f56d77-metrics-certs") pod "network-metrics-daemon-s6867" (UID: "420491ca-5a34-4390-900c-61bd11f56d77") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:46:43.692671 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:43.692656 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6f370f6-23e4-4c5f-927d-2b4528227518-kube-api-access-j5hz7 podName:c6f370f6-23e4-4c5f-927d-2b4528227518 nodeName:}" failed. No retries permitted until 2026-07-06 22:47:15.692646647 +0000 UTC m=+65.157948912 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-j5hz7" (UniqueName: "kubernetes.io/projected/c6f370f6-23e4-4c5f-927d-2b4528227518-kube-api-access-j5hz7") pod "network-check-target-g7gjs" (UID: "c6f370f6-23e4-4c5f-927d-2b4528227518") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:46:43.692671 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:43.692672 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6802a34f-0779-44b2-8c48-d3dadcc548ee-original-pull-secret podName:6802a34f-0779-44b2-8c48-d3dadcc548ee nodeName:}" failed. No retries permitted until 2026-07-06 22:47:15.692663716 +0000 UTC m=+65.157965990 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6802a34f-0779-44b2-8c48-d3dadcc548ee-original-pull-secret") pod "global-pull-secret-syncer-fc82v" (UID: "6802a34f-0779-44b2-8c48-d3dadcc548ee") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:46:44.354328 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:44.354298 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcwnt" event={"ID":"55227435-70da-4e08-af29-62da383155fc","Type":"ContainerStarted","Data":"d762afbcd3adbf25e6ad5084eec450ebcfde792a2ea017e0e9afcaf522f945cd"} Jul 06 22:46:45.098844 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.098797 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:45.099010 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.098797 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:46:45.099010 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:45.098919 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s6867" podUID="420491ca-5a34-4390-900c-61bd11f56d77" Jul 06 22:46:45.099091 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:45.099015 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7gjs" podUID="c6f370f6-23e4-4c5f-927d-2b4528227518" Jul 06 22:46:45.099091 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.098797 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:45.099163 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:45.099105 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fc82v" podUID="6802a34f-0779-44b2-8c48-d3dadcc548ee" Jul 06 22:46:45.358394 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.358326 2566 generic.go:356] "Generic (PLEG): container finished" podID="55227435-70da-4e08-af29-62da383155fc" containerID="d762afbcd3adbf25e6ad5084eec450ebcfde792a2ea017e0e9afcaf522f945cd" exitCode=0 Jul 06 22:46:45.358394 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.358386 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcwnt" event={"ID":"55227435-70da-4e08-af29-62da383155fc","Type":"ContainerDied","Data":"d762afbcd3adbf25e6ad5084eec450ebcfde792a2ea017e0e9afcaf522f945cd"} Jul 06 22:46:45.771509 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.771441 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-21.ec2.internal" event="NodeReady" Jul 06 22:46:45.771635 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.771535 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 22:46:45.804437 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.804411 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-69845bbf78-hgzl5"] Jul 06 22:46:45.807655 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.807641 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:46:45.812151 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.810096 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 22:46:45.812151 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.810519 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 22:46:45.812151 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.810915 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 22:46:45.812151 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.810915 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fr57l\"" Jul 06 22:46:45.819737 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.819712 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rt8d9"] Jul 06 22:46:45.820988 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.820969 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 22:46:45.822925 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.822902 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69845bbf78-hgzl5"] Jul 06 22:46:45.823108 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.822942 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gnh7j"] Jul 06 22:46:45.823108 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.823023 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rt8d9" Jul 06 22:46:45.825363 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.825346 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 22:46:45.825432 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.825346 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jx42h\"" Jul 06 22:46:45.825476 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.825427 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 22:46:45.826129 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.826115 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gnh7j" Jul 06 22:46:45.828284 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.828262 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 22:46:45.828394 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.828261 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 22:46:45.828394 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.828337 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-d66nl\"" Jul 06 22:46:45.828394 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.828306 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 22:46:45.830987 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.830972 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rt8d9"] Jul 06 22:46:45.833625 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.833606 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gnh7j"] Jul 06 22:46:45.913668 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.913641 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/efff2dcd-797f-470d-9bde-befffa596ef9-registry-certificates\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:46:45.913668 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.913669 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pmnb\" (UniqueName: \"kubernetes.io/projected/7e00471d-a3c5-4971-971b-850ddb797e98-kube-api-access-6pmnb\") pod \"dns-default-rt8d9\" (UID: \"7e00471d-a3c5-4971-971b-850ddb797e98\") " pod="openshift-dns/dns-default-rt8d9" Jul 06 22:46:45.913847 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.913686 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e00471d-a3c5-4971-971b-850ddb797e98-tmp-dir\") pod \"dns-default-rt8d9\" (UID: \"7e00471d-a3c5-4971-971b-850ddb797e98\") " pod="openshift-dns/dns-default-rt8d9" Jul 06 22:46:45.913847 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.913704 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/efff2dcd-797f-470d-9bde-befffa596ef9-image-registry-private-configuration\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:46:45.913847 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.913775 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/efff2dcd-797f-470d-9bde-befffa596ef9-ca-trust-extracted\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:46:45.913847 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.913822 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20ad72c0-1ddb-4415-9fa8-62ca527e26af-cert\") pod \"ingress-canary-gnh7j\" (UID: \"20ad72c0-1ddb-4415-9fa8-62ca527e26af\") " pod="openshift-ingress-canary/ingress-canary-gnh7j" Jul 06 22:46:45.913847 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.913840 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qkv6\" (UniqueName: \"kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-kube-api-access-8qkv6\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:46:45.914028 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.913883 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-registry-tls\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:46:45.914028 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.913905 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/efff2dcd-797f-470d-9bde-befffa596ef9-installation-pull-secrets\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:46:45.914028 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.913937 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-bound-sa-token\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:46:45.914028 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.913956 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7e00471d-a3c5-4971-971b-850ddb797e98-config-volume\") pod \"dns-default-rt8d9\" (UID: \"7e00471d-a3c5-4971-971b-850ddb797e98\") " pod="openshift-dns/dns-default-rt8d9" Jul 06 22:46:45.914028 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.913983 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcl8j\" (UniqueName: \"kubernetes.io/projected/20ad72c0-1ddb-4415-9fa8-62ca527e26af-kube-api-access-tcl8j\") pod \"ingress-canary-gnh7j\" (UID: \"20ad72c0-1ddb-4415-9fa8-62ca527e26af\") " pod="openshift-ingress-canary/ingress-canary-gnh7j" Jul 06 22:46:45.914028 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.914005 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/efff2dcd-797f-470d-9bde-befffa596ef9-trusted-ca\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:46:45.914028 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.914023 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e00471d-a3c5-4971-971b-850ddb797e98-metrics-tls\") pod \"dns-default-rt8d9\" (UID: \"7e00471d-a3c5-4971-971b-850ddb797e98\") " pod="openshift-dns/dns-default-rt8d9" Jul 06 22:46:45.947973 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:45.947946 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:46:46.014620 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.014596 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/efff2dcd-797f-470d-9bde-befffa596ef9-ca-trust-extracted\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:46:46.014710 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.014623 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20ad72c0-1ddb-4415-9fa8-62ca527e26af-cert\") pod \"ingress-canary-gnh7j\" (UID: \"20ad72c0-1ddb-4415-9fa8-62ca527e26af\") " pod="openshift-ingress-canary/ingress-canary-gnh7j" Jul 06 22:46:46.014710 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.014640 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qkv6\" (UniqueName: \"kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-kube-api-access-8qkv6\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:46:46.014710 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.014671 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-registry-tls\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:46:46.014710 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.014687 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/efff2dcd-797f-470d-9bde-befffa596ef9-installation-pull-secrets\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:46:46.014710 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.014702 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-bound-sa-token\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:46:46.014997 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.014722 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7e00471d-a3c5-4971-971b-850ddb797e98-config-volume\") pod \"dns-default-rt8d9\" (UID: \"7e00471d-a3c5-4971-971b-850ddb797e98\") " pod="openshift-dns/dns-default-rt8d9" Jul 06 22:46:46.014997 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:46.014825 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:46:46.014997 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:46.014844 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69845bbf78-hgzl5: secret "image-registry-tls" not found Jul 06 22:46:46.014997 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.014863 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcl8j\" (UniqueName: \"kubernetes.io/projected/20ad72c0-1ddb-4415-9fa8-62ca527e26af-kube-api-access-tcl8j\") pod \"ingress-canary-gnh7j\" (UID: \"20ad72c0-1ddb-4415-9fa8-62ca527e26af\") " pod="openshift-ingress-canary/ingress-canary-gnh7j" Jul 06 22:46:46.014997 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:46.014898 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-registry-tls podName:efff2dcd-797f-470d-9bde-befffa596ef9 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:46.514880231 +0000 UTC m=+35.980182515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-registry-tls") pod "image-registry-69845bbf78-hgzl5" (UID: "efff2dcd-797f-470d-9bde-befffa596ef9") : secret "image-registry-tls" not found Jul 06 22:46:46.014997 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.014918 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/efff2dcd-797f-470d-9bde-befffa596ef9-trusted-ca\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:46:46.014997 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.014953 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e00471d-a3c5-4971-971b-850ddb797e98-metrics-tls\") pod \"dns-default-rt8d9\" (UID: \"7e00471d-a3c5-4971-971b-850ddb797e98\") " pod="openshift-dns/dns-default-rt8d9" Jul 06 22:46:46.015332 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.014999 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/efff2dcd-797f-470d-9bde-befffa596ef9-registry-certificates\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:46:46.015332 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.015025 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pmnb\" (UniqueName: \"kubernetes.io/projected/7e00471d-a3c5-4971-971b-850ddb797e98-kube-api-access-6pmnb\") pod \"dns-default-rt8d9\" (UID: \"7e00471d-a3c5-4971-971b-850ddb797e98\") " pod="openshift-dns/dns-default-rt8d9" Jul 06 22:46:46.015332 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.015043 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/efff2dcd-797f-470d-9bde-befffa596ef9-ca-trust-extracted\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:46:46.015332 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.015047 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e00471d-a3c5-4971-971b-850ddb797e98-tmp-dir\") pod \"dns-default-rt8d9\" (UID: \"7e00471d-a3c5-4971-971b-850ddb797e98\") " pod="openshift-dns/dns-default-rt8d9" Jul 06 22:46:46.015332 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.015107 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/efff2dcd-797f-470d-9bde-befffa596ef9-image-registry-private-configuration\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:46:46.015332 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:46.015139 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:46:46.015332 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:46.015194 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e00471d-a3c5-4971-971b-850ddb797e98-metrics-tls podName:7e00471d-a3c5-4971-971b-850ddb797e98 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:46.515178538 +0000 UTC m=+35.980480800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7e00471d-a3c5-4971-971b-850ddb797e98-metrics-tls") pod "dns-default-rt8d9" (UID: "7e00471d-a3c5-4971-971b-850ddb797e98") : secret "dns-default-metrics-tls" not found Jul 06 22:46:46.015332 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.015255 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7e00471d-a3c5-4971-971b-850ddb797e98-config-volume\") pod \"dns-default-rt8d9\" (UID: \"7e00471d-a3c5-4971-971b-850ddb797e98\") " pod="openshift-dns/dns-default-rt8d9" Jul 06 22:46:46.015332 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.015309 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e00471d-a3c5-4971-971b-850ddb797e98-tmp-dir\") pod \"dns-default-rt8d9\" (UID: \"7e00471d-a3c5-4971-971b-850ddb797e98\") " pod="openshift-dns/dns-default-rt8d9" Jul 06 22:46:46.015729 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.015709 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/efff2dcd-797f-470d-9bde-befffa596ef9-registry-certificates\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:46:46.016216 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.016199 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/efff2dcd-797f-470d-9bde-befffa596ef9-trusted-ca\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:46:46.018756 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.018727 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/efff2dcd-797f-470d-9bde-befffa596ef9-image-registry-private-configuration\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:46:46.018756 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.018749 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/efff2dcd-797f-470d-9bde-befffa596ef9-installation-pull-secrets\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:46:46.018895 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.018752 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20ad72c0-1ddb-4415-9fa8-62ca527e26af-cert\") pod \"ingress-canary-gnh7j\" (UID: \"20ad72c0-1ddb-4415-9fa8-62ca527e26af\") " pod="openshift-ingress-canary/ingress-canary-gnh7j" Jul 06 22:46:46.025133 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.025047 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qkv6\" (UniqueName: \"kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-kube-api-access-8qkv6\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:46:46.025227 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.025169 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcl8j\" (UniqueName: \"kubernetes.io/projected/20ad72c0-1ddb-4415-9fa8-62ca527e26af-kube-api-access-tcl8j\") pod \"ingress-canary-gnh7j\" (UID: \"20ad72c0-1ddb-4415-9fa8-62ca527e26af\") " pod="openshift-ingress-canary/ingress-canary-gnh7j" Jul 06 22:46:46.025950 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.025921 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-bound-sa-token\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:46:46.026073 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.026057 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pmnb\" (UniqueName: \"kubernetes.io/projected/7e00471d-a3c5-4971-971b-850ddb797e98-kube-api-access-6pmnb\") pod \"dns-default-rt8d9\" (UID: \"7e00471d-a3c5-4971-971b-850ddb797e98\") " pod="openshift-dns/dns-default-rt8d9" Jul 06 22:46:46.032108 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.032074 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:46:46.139693 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.139675 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gnh7j" Jul 06 22:46:46.337780 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.337719 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gnh7j"] Jul 06 22:46:46.341459 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:46:46.341431 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20ad72c0_1ddb_4415_9fa8_62ca527e26af.slice/crio-0e5eb7d8dfaa29479f155a6d3c96055c40c3bf78bd3ff1b4786ae1246951b026 WatchSource:0}: Error finding container 0e5eb7d8dfaa29479f155a6d3c96055c40c3bf78bd3ff1b4786ae1246951b026: Status 404 returned error can't find the container with id 0e5eb7d8dfaa29479f155a6d3c96055c40c3bf78bd3ff1b4786ae1246951b026 Jul 06 22:46:46.361527 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.361497 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gnh7j" event={"ID":"20ad72c0-1ddb-4415-9fa8-62ca527e26af","Type":"ContainerStarted","Data":"0e5eb7d8dfaa29479f155a6d3c96055c40c3bf78bd3ff1b4786ae1246951b026"} Jul 06 22:46:46.364364 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.364340 2566 generic.go:356] "Generic (PLEG): container finished" podID="55227435-70da-4e08-af29-62da383155fc" containerID="5619335f1c7e0f5452363bf27a86d0fb131a6891b2a71fe85bd3427d11efc153" exitCode=0 Jul 06 22:46:46.364444 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.364381 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcwnt" event={"ID":"55227435-70da-4e08-af29-62da383155fc","Type":"ContainerDied","Data":"5619335f1c7e0f5452363bf27a86d0fb131a6891b2a71fe85bd3427d11efc153"} Jul 06 22:46:46.518451 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.518419 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-registry-tls\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:46:46.518570 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:46.518523 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:46:46.518570 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:46.518537 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69845bbf78-hgzl5: secret "image-registry-tls" not found Jul 06 22:46:46.518664 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:46.518580 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-registry-tls podName:efff2dcd-797f-470d-9bde-befffa596ef9 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:47.518567214 +0000 UTC m=+36.983869478 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-registry-tls") pod "image-registry-69845bbf78-hgzl5" (UID: "efff2dcd-797f-470d-9bde-befffa596ef9") : secret "image-registry-tls" not found Jul 06 22:46:46.518664 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.518605 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e00471d-a3c5-4971-971b-850ddb797e98-metrics-tls\") pod \"dns-default-rt8d9\" (UID: \"7e00471d-a3c5-4971-971b-850ddb797e98\") " pod="openshift-dns/dns-default-rt8d9" Jul 06 22:46:46.518769 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:46.518753 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:46:46.518835 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:46.518802 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e00471d-a3c5-4971-971b-850ddb797e98-metrics-tls podName:7e00471d-a3c5-4971-971b-850ddb797e98 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:47.518789643 +0000 UTC m=+36.984091903 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7e00471d-a3c5-4971-971b-850ddb797e98-metrics-tls") pod "dns-default-rt8d9" (UID: "7e00471d-a3c5-4971-971b-850ddb797e98") : secret "dns-default-metrics-tls" not found Jul 06 22:46:46.609087 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.609062 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:46:46.661326 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:46.661301 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:46:47.099105 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:47.099075 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:46:47.099278 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:47.099242 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:46:47.099404 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:47.099075 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:46:47.102019 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:47.101999 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 22:46:47.102019 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:47.102016 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5j2wj\"" Jul 06 22:46:47.102174 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:47.102046 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 22:46:47.102174 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:47.102149 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lkkl7\"" Jul 06 22:46:47.102246 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:47.102197 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 22:46:47.102702 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:47.102686 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 22:46:47.371335 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:47.371246 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcwnt" event={"ID":"55227435-70da-4e08-af29-62da383155fc","Type":"ContainerStarted","Data":"c7edebf83a1262473806bc1f33f61e1856f012a8d4a8354021443a71d2493690"} Jul 06 22:46:47.393568 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:47.393511 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kcwnt" podStartSLOduration=7.205129014 podStartE2EDuration="36.393492103s" totalImagesPullingTime="29.188363089s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:46:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:46:47.391576908 +0000 UTC m=+36.856879189" watchObservedRunningTime="2026-07-06 22:46:47.393492103 +0000 UTC m=+36.858794385" Jul 06 22:46:47.523741 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:47.523704 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-registry-tls\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:46:47.523929 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:47.523770 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e00471d-a3c5-4971-971b-850ddb797e98-metrics-tls\") pod \"dns-default-rt8d9\" (UID: \"7e00471d-a3c5-4971-971b-850ddb797e98\") " pod="openshift-dns/dns-default-rt8d9" Jul 06 22:46:47.523929 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:47.523859 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:46:47.524047 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:47.523933 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e00471d-a3c5-4971-971b-850ddb797e98-metrics-tls podName:7e00471d-a3c5-4971-971b-850ddb797e98 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:49.52391458 +0000 UTC m=+38.989216857 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7e00471d-a3c5-4971-971b-850ddb797e98-metrics-tls") pod "dns-default-rt8d9" (UID: "7e00471d-a3c5-4971-971b-850ddb797e98") : secret "dns-default-metrics-tls" not found Jul 06 22:46:47.524047 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:47.523865 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:46:47.524047 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:47.524016 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69845bbf78-hgzl5: secret "image-registry-tls" not found Jul 06 22:46:47.524205 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:47.524085 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-registry-tls podName:efff2dcd-797f-470d-9bde-befffa596ef9 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:49.524066576 +0000 UTC m=+38.989368845 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-registry-tls") pod "image-registry-69845bbf78-hgzl5" (UID: "efff2dcd-797f-470d-9bde-befffa596ef9") : secret "image-registry-tls" not found Jul 06 22:46:47.597302 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:47.597257 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:46:47.653614 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:47.653508 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:46:49.378634 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:49.378556 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gnh7j" event={"ID":"20ad72c0-1ddb-4415-9fa8-62ca527e26af","Type":"ContainerStarted","Data":"1b1940392585689773121680188611ce1d0acfbfab876d43df18f52efcbd6f6e"} Jul 06 22:46:49.395552 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:49.395511 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gnh7j" podStartSLOduration=1.637891261 podStartE2EDuration="4.39549737s" totalImagesPullingTime="2.757606109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:46:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:46:49.394120128 +0000 UTC m=+38.859422413" watchObservedRunningTime="2026-07-06 22:46:49.39549737 +0000 UTC m=+38.860799652" Jul 06 22:46:49.538189 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:49.538153 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-registry-tls\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:46:49.538346 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:49.538215 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e00471d-a3c5-4971-971b-850ddb797e98-metrics-tls\") pod \"dns-default-rt8d9\" (UID: \"7e00471d-a3c5-4971-971b-850ddb797e98\") " pod="openshift-dns/dns-default-rt8d9" Jul 06 22:46:49.538346 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:49.538295 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:46:49.538346 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:49.538314 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69845bbf78-hgzl5: secret "image-registry-tls" not found Jul 06 22:46:49.538346 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:49.538294 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:46:49.538473 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:49.538371 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-registry-tls podName:efff2dcd-797f-470d-9bde-befffa596ef9 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:53.538357551 +0000 UTC m=+43.003659815 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-registry-tls") pod "image-registry-69845bbf78-hgzl5" (UID: "efff2dcd-797f-470d-9bde-befffa596ef9") : secret "image-registry-tls" not found Jul 06 22:46:49.538473 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:49.538387 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e00471d-a3c5-4971-971b-850ddb797e98-metrics-tls podName:7e00471d-a3c5-4971-971b-850ddb797e98 nodeName:}" failed. No retries permitted until 2026-07-06 22:46:53.538380204 +0000 UTC m=+43.003682463 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7e00471d-a3c5-4971-971b-850ddb797e98-metrics-tls") pod "dns-default-rt8d9" (UID: "7e00471d-a3c5-4971-971b-850ddb797e98") : secret "dns-default-metrics-tls" not found Jul 06 22:46:51.629978 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:51.629942 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:46:51.694977 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:51.694947 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:46:52.554211 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:52.554178 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:46:52.655137 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:52.655106 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:46:52.889655 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:52.889622 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:46:52.990608 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:52.990575 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:46:53.569971 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:53.569930 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-registry-tls\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:46:53.570150 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:53.569982 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e00471d-a3c5-4971-971b-850ddb797e98-metrics-tls\") pod \"dns-default-rt8d9\" (UID: \"7e00471d-a3c5-4971-971b-850ddb797e98\") " pod="openshift-dns/dns-default-rt8d9" Jul 06 22:46:53.570150 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:53.570101 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:46:53.570150 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:53.570124 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69845bbf78-hgzl5: secret "image-registry-tls" not found Jul 06 22:46:53.570319 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:53.570179 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:46:53.570319 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:53.570206 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-registry-tls podName:efff2dcd-797f-470d-9bde-befffa596ef9 nodeName:}" failed. No retries permitted until 2026-07-06 22:47:01.570187263 +0000 UTC m=+51.035489524 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-registry-tls") pod "image-registry-69845bbf78-hgzl5" (UID: "efff2dcd-797f-470d-9bde-befffa596ef9") : secret "image-registry-tls" not found Jul 06 22:46:53.570319 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:46:53.570231 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e00471d-a3c5-4971-971b-850ddb797e98-metrics-tls podName:7e00471d-a3c5-4971-971b-850ddb797e98 nodeName:}" failed. No retries permitted until 2026-07-06 22:47:01.570219289 +0000 UTC m=+51.035521549 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7e00471d-a3c5-4971-971b-850ddb797e98-metrics-tls") pod "dns-default-rt8d9" (UID: "7e00471d-a3c5-4971-971b-850ddb797e98") : secret "dns-default-metrics-tls" not found Jul 06 22:46:55.502976 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:55.502937 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:46:55.806064 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:55.805990 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:46:55.904102 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:46:55.904053 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:01.629670 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:01.629627 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-registry-tls\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:47:01.630161 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:01.629680 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e00471d-a3c5-4971-971b-850ddb797e98-metrics-tls\") pod \"dns-default-rt8d9\" (UID: \"7e00471d-a3c5-4971-971b-850ddb797e98\") " pod="openshift-dns/dns-default-rt8d9" Jul 06 22:47:01.630161 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:01.629765 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:47:01.630161 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:01.629858 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e00471d-a3c5-4971-971b-850ddb797e98-metrics-tls podName:7e00471d-a3c5-4971-971b-850ddb797e98 nodeName:}" failed. No retries permitted until 2026-07-06 22:47:17.629840022 +0000 UTC m=+67.095142303 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7e00471d-a3c5-4971-971b-850ddb797e98-metrics-tls") pod "dns-default-rt8d9" (UID: "7e00471d-a3c5-4971-971b-850ddb797e98") : secret "dns-default-metrics-tls" not found Jul 06 22:47:01.630161 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:01.629868 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:47:01.630161 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:01.629886 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69845bbf78-hgzl5: secret "image-registry-tls" not found Jul 06 22:47:01.630161 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:01.629934 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-registry-tls podName:efff2dcd-797f-470d-9bde-befffa596ef9 nodeName:}" failed. No retries permitted until 2026-07-06 22:47:17.629921911 +0000 UTC m=+67.095224171 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-registry-tls") pod "image-registry-69845bbf78-hgzl5" (UID: "efff2dcd-797f-470d-9bde-befffa596ef9") : secret "image-registry-tls" not found Jul 06 22:47:02.333467 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:02.333421 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:02.387557 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:02.387525 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:03.580060 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:03.580024 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:03.634106 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:03.634078 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:04.563916 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.563881 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fc5c9"] Jul 06 22:47:04.566289 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.566272 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwhjz"] Jul 06 22:47:04.566420 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.566404 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fc5c9" Jul 06 22:47:04.568329 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.568309 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwhjz" Jul 06 22:47:04.569469 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.569448 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-6c9h9"] Jul 06 22:47:04.570692 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.570672 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:47:04.571182 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.571163 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6c9h9" Jul 06 22:47:04.571766 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.571748 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-z8vqs\"" Jul 06 22:47:04.571928 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.571906 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 06 22:47:04.572081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.571887 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:47:04.572159 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.571841 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-jnj8j\"" Jul 06 22:47:04.572159 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.571936 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 06 22:47:04.572266 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.571942 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 06 22:47:04.572266 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.572013 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 06 22:47:04.577700 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.577680 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwhjz"] Jul 06 22:47:04.578363 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.578347 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-gg828\"" Jul 06 22:47:04.583469 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.583448 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:04.584695 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.584676 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fc5c9"] Jul 06 22:47:04.585470 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.585453 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-6c9h9"] Jul 06 22:47:04.652429 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.652402 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m2kz\" (UniqueName: \"kubernetes.io/projected/2fac8ed3-0adc-4542-aab1-fe8308b1aea0-kube-api-access-7m2kz\") pod \"service-ca-operator-5d46d9ffd4-lwhjz\" (UID: \"2fac8ed3-0adc-4542-aab1-fe8308b1aea0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwhjz" Jul 06 22:47:04.652429 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.652434 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2fac8ed3-0adc-4542-aab1-fe8308b1aea0-config\") pod \"service-ca-operator-5d46d9ffd4-lwhjz\" (UID: \"2fac8ed3-0adc-4542-aab1-fe8308b1aea0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwhjz" Jul 06 22:47:04.652622 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.652452 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2fac8ed3-0adc-4542-aab1-fe8308b1aea0-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-lwhjz\" (UID: \"2fac8ed3-0adc-4542-aab1-fe8308b1aea0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwhjz" Jul 06 22:47:04.652622 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.652564 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntx8z\" (UniqueName: \"kubernetes.io/projected/f8c866fa-1188-4367-807e-f44e8e284050-kube-api-access-ntx8z\") pod \"volume-data-source-validator-5d456fdbcd-fc5c9\" (UID: \"f8c866fa-1188-4367-807e-f44e8e284050\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fc5c9" Jul 06 22:47:04.652703 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.652639 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kgqv\" (UniqueName: \"kubernetes.io/projected/9a863898-4829-431a-957f-0983c162a1a2-kube-api-access-6kgqv\") pod \"network-check-source-989f8b8dc-6c9h9\" (UID: \"9a863898-4829-431a-957f-0983c162a1a2\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6c9h9" Jul 06 22:47:04.659857 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.659830 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8fdv"] Jul 06 22:47:04.661704 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.661688 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-rtzxs"] Jul 06 22:47:04.661849 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.661834 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8fdv" Jul 06 22:47:04.663856 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.663839 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" Jul 06 22:47:04.664485 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.664466 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 22:47:04.665431 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.665414 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:47:04.666928 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.666912 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 06 22:47:04.668036 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.668008 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 06 22:47:04.668230 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.668214 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-9ck2n\"" Jul 06 22:47:04.668403 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.668216 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-vmqpj\"" Jul 06 22:47:04.668579 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.668529 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 22:47:04.668739 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.668725 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 22:47:04.669361 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.669342 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 06 22:47:04.669519 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.669508 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:47:04.672510 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.672491 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 06 22:47:04.676481 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.676464 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8fdv"] Jul 06 22:47:04.681572 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.681546 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-rtzxs"] Jul 06 22:47:04.683832 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.683776 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:04.750281 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.750212 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:04.753251 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.753232 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2fac8ed3-0adc-4542-aab1-fe8308b1aea0-config\") pod \"service-ca-operator-5d46d9ffd4-lwhjz\" (UID: \"2fac8ed3-0adc-4542-aab1-fe8308b1aea0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwhjz" Jul 06 22:47:04.753334 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.753263 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2fac8ed3-0adc-4542-aab1-fe8308b1aea0-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-lwhjz\" (UID: \"2fac8ed3-0adc-4542-aab1-fe8308b1aea0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwhjz" Jul 06 22:47:04.753334 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.753316 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntx8z\" (UniqueName: \"kubernetes.io/projected/f8c866fa-1188-4367-807e-f44e8e284050-kube-api-access-ntx8z\") pod \"volume-data-source-validator-5d456fdbcd-fc5c9\" (UID: \"f8c866fa-1188-4367-807e-f44e8e284050\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fc5c9" Jul 06 22:47:04.753404 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.753379 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kgqv\" (UniqueName: \"kubernetes.io/projected/9a863898-4829-431a-957f-0983c162a1a2-kube-api-access-6kgqv\") pod \"network-check-source-989f8b8dc-6c9h9\" (UID: \"9a863898-4829-431a-957f-0983c162a1a2\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6c9h9" Jul 06 22:47:04.753449 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.753417 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcln9\" (UniqueName: \"kubernetes.io/projected/44a73ff1-a1c0-483d-9edf-500cf057759e-kube-api-access-zcln9\") pod \"kube-storage-version-migrator-operator-846bf668f7-n8fdv\" (UID: \"44a73ff1-a1c0-483d-9edf-500cf057759e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8fdv" Jul 06 22:47:04.753449 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.753443 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1dc50270-5e71-4a7b-8160-9041cbc18cd9-config\") pod \"console-operator-68b757fb67-rtzxs\" (UID: \"1dc50270-5e71-4a7b-8160-9041cbc18cd9\") " pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" Jul 06 22:47:04.753544 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.753468 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72jnn\" (UniqueName: \"kubernetes.io/projected/1dc50270-5e71-4a7b-8160-9041cbc18cd9-kube-api-access-72jnn\") pod \"console-operator-68b757fb67-rtzxs\" (UID: \"1dc50270-5e71-4a7b-8160-9041cbc18cd9\") " pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" Jul 06 22:47:04.753544 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.753498 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1dc50270-5e71-4a7b-8160-9041cbc18cd9-serving-cert\") pod \"console-operator-68b757fb67-rtzxs\" (UID: \"1dc50270-5e71-4a7b-8160-9041cbc18cd9\") " pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" Jul 06 22:47:04.753544 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.753524 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/44a73ff1-a1c0-483d-9edf-500cf057759e-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-n8fdv\" (UID: \"44a73ff1-a1c0-483d-9edf-500cf057759e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8fdv" Jul 06 22:47:04.753671 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.753552 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/44a73ff1-a1c0-483d-9edf-500cf057759e-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-n8fdv\" (UID: \"44a73ff1-a1c0-483d-9edf-500cf057759e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8fdv" Jul 06 22:47:04.753671 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.753587 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1dc50270-5e71-4a7b-8160-9041cbc18cd9-trusted-ca\") pod \"console-operator-68b757fb67-rtzxs\" (UID: \"1dc50270-5e71-4a7b-8160-9041cbc18cd9\") " pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" Jul 06 22:47:04.753671 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.753617 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m2kz\" (UniqueName: \"kubernetes.io/projected/2fac8ed3-0adc-4542-aab1-fe8308b1aea0-kube-api-access-7m2kz\") pod \"service-ca-operator-5d46d9ffd4-lwhjz\" (UID: \"2fac8ed3-0adc-4542-aab1-fe8308b1aea0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwhjz" Jul 06 22:47:04.753848 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.753828 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2fac8ed3-0adc-4542-aab1-fe8308b1aea0-config\") pod \"service-ca-operator-5d46d9ffd4-lwhjz\" (UID: \"2fac8ed3-0adc-4542-aab1-fe8308b1aea0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwhjz" Jul 06 22:47:04.755464 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.755446 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2fac8ed3-0adc-4542-aab1-fe8308b1aea0-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-lwhjz\" (UID: \"2fac8ed3-0adc-4542-aab1-fe8308b1aea0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwhjz" Jul 06 22:47:04.761258 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.761234 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntx8z\" (UniqueName: \"kubernetes.io/projected/f8c866fa-1188-4367-807e-f44e8e284050-kube-api-access-ntx8z\") pod \"volume-data-source-validator-5d456fdbcd-fc5c9\" (UID: \"f8c866fa-1188-4367-807e-f44e8e284050\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fc5c9" Jul 06 22:47:04.761415 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.761394 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m2kz\" (UniqueName: \"kubernetes.io/projected/2fac8ed3-0adc-4542-aab1-fe8308b1aea0-kube-api-access-7m2kz\") pod \"service-ca-operator-5d46d9ffd4-lwhjz\" (UID: \"2fac8ed3-0adc-4542-aab1-fe8308b1aea0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwhjz" Jul 06 22:47:04.761464 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.761402 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kgqv\" (UniqueName: \"kubernetes.io/projected/9a863898-4829-431a-957f-0983c162a1a2-kube-api-access-6kgqv\") pod \"network-check-source-989f8b8dc-6c9h9\" (UID: \"9a863898-4829-431a-957f-0983c162a1a2\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6c9h9" Jul 06 22:47:04.850681 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.850647 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:04.854686 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.854665 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcln9\" (UniqueName: \"kubernetes.io/projected/44a73ff1-a1c0-483d-9edf-500cf057759e-kube-api-access-zcln9\") pod \"kube-storage-version-migrator-operator-846bf668f7-n8fdv\" (UID: \"44a73ff1-a1c0-483d-9edf-500cf057759e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8fdv" Jul 06 22:47:04.854760 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.854694 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1dc50270-5e71-4a7b-8160-9041cbc18cd9-config\") pod \"console-operator-68b757fb67-rtzxs\" (UID: \"1dc50270-5e71-4a7b-8160-9041cbc18cd9\") " pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" Jul 06 22:47:04.854760 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.854709 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72jnn\" (UniqueName: \"kubernetes.io/projected/1dc50270-5e71-4a7b-8160-9041cbc18cd9-kube-api-access-72jnn\") pod \"console-operator-68b757fb67-rtzxs\" (UID: \"1dc50270-5e71-4a7b-8160-9041cbc18cd9\") " pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" Jul 06 22:47:04.854760 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.854726 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1dc50270-5e71-4a7b-8160-9041cbc18cd9-serving-cert\") pod \"console-operator-68b757fb67-rtzxs\" (UID: \"1dc50270-5e71-4a7b-8160-9041cbc18cd9\") " pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" Jul 06 22:47:04.854760 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.854751 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/44a73ff1-a1c0-483d-9edf-500cf057759e-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-n8fdv\" (UID: \"44a73ff1-a1c0-483d-9edf-500cf057759e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8fdv" Jul 06 22:47:04.854944 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.854774 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/44a73ff1-a1c0-483d-9edf-500cf057759e-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-n8fdv\" (UID: \"44a73ff1-a1c0-483d-9edf-500cf057759e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8fdv" Jul 06 22:47:04.854944 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.854920 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1dc50270-5e71-4a7b-8160-9041cbc18cd9-trusted-ca\") pod \"console-operator-68b757fb67-rtzxs\" (UID: \"1dc50270-5e71-4a7b-8160-9041cbc18cd9\") " pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" Jul 06 22:47:04.855298 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.855278 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/44a73ff1-a1c0-483d-9edf-500cf057759e-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-n8fdv\" (UID: \"44a73ff1-a1c0-483d-9edf-500cf057759e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8fdv" Jul 06 22:47:04.855590 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.855571 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1dc50270-5e71-4a7b-8160-9041cbc18cd9-config\") pod \"console-operator-68b757fb67-rtzxs\" (UID: \"1dc50270-5e71-4a7b-8160-9041cbc18cd9\") " pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" Jul 06 22:47:04.855784 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.855762 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1dc50270-5e71-4a7b-8160-9041cbc18cd9-trusted-ca\") pod \"console-operator-68b757fb67-rtzxs\" (UID: \"1dc50270-5e71-4a7b-8160-9041cbc18cd9\") " pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" Jul 06 22:47:04.857406 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.857386 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/44a73ff1-a1c0-483d-9edf-500cf057759e-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-n8fdv\" (UID: \"44a73ff1-a1c0-483d-9edf-500cf057759e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8fdv" Jul 06 22:47:04.857540 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.857520 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1dc50270-5e71-4a7b-8160-9041cbc18cd9-serving-cert\") pod \"console-operator-68b757fb67-rtzxs\" (UID: \"1dc50270-5e71-4a7b-8160-9041cbc18cd9\") " pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" Jul 06 22:47:04.862238 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.862206 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcln9\" (UniqueName: \"kubernetes.io/projected/44a73ff1-a1c0-483d-9edf-500cf057759e-kube-api-access-zcln9\") pod \"kube-storage-version-migrator-operator-846bf668f7-n8fdv\" (UID: \"44a73ff1-a1c0-483d-9edf-500cf057759e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8fdv" Jul 06 22:47:04.862561 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.862541 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72jnn\" (UniqueName: \"kubernetes.io/projected/1dc50270-5e71-4a7b-8160-9041cbc18cd9-kube-api-access-72jnn\") pod \"console-operator-68b757fb67-rtzxs\" (UID: \"1dc50270-5e71-4a7b-8160-9041cbc18cd9\") " pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" Jul 06 22:47:04.877188 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.877157 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fc5c9" Jul 06 22:47:04.883174 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.883157 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwhjz" Jul 06 22:47:04.888939 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.888923 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6c9h9" Jul 06 22:47:04.906848 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.906791 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:04.972514 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.971771 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8fdv" Jul 06 22:47:04.977200 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:04.977092 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" Jul 06 22:47:05.025623 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:05.025524 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwhjz"] Jul 06 22:47:05.031736 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:47:05.031709 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fac8ed3_0adc_4542_aab1_fe8308b1aea0.slice/crio-1f1f8105c0ae7abb8359901c0a235b93b6e2023aa08ccd7ea7d46f395eadfc19 WatchSource:0}: Error finding container 1f1f8105c0ae7abb8359901c0a235b93b6e2023aa08ccd7ea7d46f395eadfc19: Status 404 returned error can't find the container with id 1f1f8105c0ae7abb8359901c0a235b93b6e2023aa08ccd7ea7d46f395eadfc19 Jul 06 22:47:05.115557 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:05.115528 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8fdv"] Jul 06 22:47:05.118407 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:47:05.118382 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44a73ff1_a1c0_483d_9edf_500cf057759e.slice/crio-8e2361338a87fa7fb835ee62a61a31bb1c01514cc2c914477536f2d228132135 WatchSource:0}: Error finding container 8e2361338a87fa7fb835ee62a61a31bb1c01514cc2c914477536f2d228132135: Status 404 returned error can't find the container with id 8e2361338a87fa7fb835ee62a61a31bb1c01514cc2c914477536f2d228132135 Jul 06 22:47:05.131216 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:05.131190 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-rtzxs"] Jul 06 22:47:05.134278 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:47:05.134254 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dc50270_5e71_4a7b_8160_9041cbc18cd9.slice/crio-6e994001b77c6c62b204a330fb1448c5e39cff766e05a8e998f91b31baace0ea WatchSource:0}: Error finding container 6e994001b77c6c62b204a330fb1448c5e39cff766e05a8e998f91b31baace0ea: Status 404 returned error can't find the container with id 6e994001b77c6c62b204a330fb1448c5e39cff766e05a8e998f91b31baace0ea Jul 06 22:47:05.251294 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:05.251215 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fc5c9"] Jul 06 22:47:05.252573 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:05.252552 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-6c9h9"] Jul 06 22:47:05.254455 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:47:05.254429 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8c866fa_1188_4367_807e_f44e8e284050.slice/crio-ae17fa3467334a758911e75d057a23eee1c6aa895a08c7d89e1091395698b392 WatchSource:0}: Error finding container ae17fa3467334a758911e75d057a23eee1c6aa895a08c7d89e1091395698b392: Status 404 returned error can't find the container with id ae17fa3467334a758911e75d057a23eee1c6aa895a08c7d89e1091395698b392 Jul 06 22:47:05.254895 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:47:05.254869 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a863898_4829_431a_957f_0983c162a1a2.slice/crio-45fcab97cd34326d58b6cea89d8584f9e9f4432e9e3cefa3c2090b6fa31ac0d2 WatchSource:0}: Error finding container 45fcab97cd34326d58b6cea89d8584f9e9f4432e9e3cefa3c2090b6fa31ac0d2: Status 404 returned error can't find the container with id 45fcab97cd34326d58b6cea89d8584f9e9f4432e9e3cefa3c2090b6fa31ac0d2 Jul 06 22:47:05.414178 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:05.414147 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8fdv" event={"ID":"44a73ff1-a1c0-483d-9edf-500cf057759e","Type":"ContainerStarted","Data":"8e2361338a87fa7fb835ee62a61a31bb1c01514cc2c914477536f2d228132135"} Jul 06 22:47:05.415339 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:05.415313 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6c9h9" event={"ID":"9a863898-4829-431a-957f-0983c162a1a2","Type":"ContainerStarted","Data":"45fcab97cd34326d58b6cea89d8584f9e9f4432e9e3cefa3c2090b6fa31ac0d2"} Jul 06 22:47:05.416315 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:05.416281 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwhjz" event={"ID":"2fac8ed3-0adc-4542-aab1-fe8308b1aea0","Type":"ContainerStarted","Data":"1f1f8105c0ae7abb8359901c0a235b93b6e2023aa08ccd7ea7d46f395eadfc19"} Jul 06 22:47:05.417271 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:05.417249 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" event={"ID":"1dc50270-5e71-4a7b-8160-9041cbc18cd9","Type":"ContainerStarted","Data":"6e994001b77c6c62b204a330fb1448c5e39cff766e05a8e998f91b31baace0ea"} Jul 06 22:47:05.418276 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:05.418258 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fc5c9" event={"ID":"f8c866fa-1188-4367-807e-f44e8e284050","Type":"ContainerStarted","Data":"ae17fa3467334a758911e75d057a23eee1c6aa895a08c7d89e1091395698b392"} Jul 06 22:47:07.427195 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:07.427160 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fc5c9" event={"ID":"f8c866fa-1188-4367-807e-f44e8e284050","Type":"ContainerStarted","Data":"fbb1ebfb3c08009fbc936d70c6ad68fd4022399840e7f0d76ad964419fb5fdbf"} Jul 06 22:47:07.442418 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:07.442315 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fc5c9" podStartSLOduration=2.012745569 podStartE2EDuration="3.44229518s" totalImagesPullingTime="1.429549611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:07.441709599 +0000 UTC m=+56.907011882" watchObservedRunningTime="2026-07-06 22:47:07.44229518 +0000 UTC m=+56.907597462" Jul 06 22:47:07.525859 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:07.525818 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:07.626717 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:07.626662 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:07.727138 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:07.727038 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:07.826401 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:07.826368 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:08.250618 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:08.250564 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:08.351300 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:08.351265 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:09.207027 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:09.206991 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kb6h6"] Jul 06 22:47:09.246401 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:09.246335 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:09.252579 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:09.252540 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kb6h6"] Jul 06 22:47:09.252730 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:09.252666 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kb6h6" Jul 06 22:47:09.255291 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:09.255267 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 22:47:09.255421 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:09.255268 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 22:47:09.256432 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:09.256410 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 22:47:09.256568 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:09.256432 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 22:47:09.256568 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:09.256412 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4p5jh\"" Jul 06 22:47:09.289821 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:09.289787 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1724ae64-fb19-417f-9090-22d7a5f4effa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kb6h6\" (UID: \"1724ae64-fb19-417f-9090-22d7a5f4effa\") " pod="openshift-insights/insights-runtime-extractor-kb6h6" Jul 06 22:47:09.289965 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:09.289864 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6cj4\" (UniqueName: \"kubernetes.io/projected/1724ae64-fb19-417f-9090-22d7a5f4effa-kube-api-access-m6cj4\") pod \"insights-runtime-extractor-kb6h6\" (UID: \"1724ae64-fb19-417f-9090-22d7a5f4effa\") " pod="openshift-insights/insights-runtime-extractor-kb6h6" Jul 06 22:47:09.290026 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:09.289994 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1724ae64-fb19-417f-9090-22d7a5f4effa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kb6h6\" (UID: \"1724ae64-fb19-417f-9090-22d7a5f4effa\") " pod="openshift-insights/insights-runtime-extractor-kb6h6" Jul 06 22:47:09.290080 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:09.290045 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1724ae64-fb19-417f-9090-22d7a5f4effa-crio-socket\") pod \"insights-runtime-extractor-kb6h6\" (UID: \"1724ae64-fb19-417f-9090-22d7a5f4effa\") " pod="openshift-insights/insights-runtime-extractor-kb6h6" Jul 06 22:47:09.290080 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:09.290073 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1724ae64-fb19-417f-9090-22d7a5f4effa-data-volume\") pod \"insights-runtime-extractor-kb6h6\" (UID: \"1724ae64-fb19-417f-9090-22d7a5f4effa\") " pod="openshift-insights/insights-runtime-extractor-kb6h6" Jul 06 22:47:09.391238 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:09.391193 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1724ae64-fb19-417f-9090-22d7a5f4effa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kb6h6\" (UID: \"1724ae64-fb19-417f-9090-22d7a5f4effa\") " pod="openshift-insights/insights-runtime-extractor-kb6h6" Jul 06 22:47:09.391416 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:09.391260 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1724ae64-fb19-417f-9090-22d7a5f4effa-crio-socket\") pod \"insights-runtime-extractor-kb6h6\" (UID: \"1724ae64-fb19-417f-9090-22d7a5f4effa\") " pod="openshift-insights/insights-runtime-extractor-kb6h6" Jul 06 22:47:09.391416 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:09.391281 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1724ae64-fb19-417f-9090-22d7a5f4effa-data-volume\") pod \"insights-runtime-extractor-kb6h6\" (UID: \"1724ae64-fb19-417f-9090-22d7a5f4effa\") " pod="openshift-insights/insights-runtime-extractor-kb6h6" Jul 06 22:47:09.391416 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:09.391312 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1724ae64-fb19-417f-9090-22d7a5f4effa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kb6h6\" (UID: \"1724ae64-fb19-417f-9090-22d7a5f4effa\") " pod="openshift-insights/insights-runtime-extractor-kb6h6" Jul 06 22:47:09.391416 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:09.391345 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6cj4\" (UniqueName: \"kubernetes.io/projected/1724ae64-fb19-417f-9090-22d7a5f4effa-kube-api-access-m6cj4\") pod \"insights-runtime-extractor-kb6h6\" (UID: \"1724ae64-fb19-417f-9090-22d7a5f4effa\") " pod="openshift-insights/insights-runtime-extractor-kb6h6" Jul 06 22:47:09.391416 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:09.391406 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1724ae64-fb19-417f-9090-22d7a5f4effa-crio-socket\") pod \"insights-runtime-extractor-kb6h6\" (UID: \"1724ae64-fb19-417f-9090-22d7a5f4effa\") " pod="openshift-insights/insights-runtime-extractor-kb6h6" Jul 06 22:47:09.391667 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:09.391445 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:47:09.391667 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:09.391460 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:47:09.391667 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:09.391530 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1724ae64-fb19-417f-9090-22d7a5f4effa-insights-runtime-extractor-tls podName:1724ae64-fb19-417f-9090-22d7a5f4effa nodeName:}" failed. No retries permitted until 2026-07-06 22:47:09.891508474 +0000 UTC m=+59.356810733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1724ae64-fb19-417f-9090-22d7a5f4effa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kb6h6" (UID: "1724ae64-fb19-417f-9090-22d7a5f4effa") : secret "insights-runtime-extractor-tls" not found Jul 06 22:47:09.391667 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:09.391548 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1724ae64-fb19-417f-9090-22d7a5f4effa-kube-rbac-proxy-cm podName:1724ae64-fb19-417f-9090-22d7a5f4effa nodeName:}" failed. No retries permitted until 2026-07-06 22:47:09.891539474 +0000 UTC m=+59.356841734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1724ae64-fb19-417f-9090-22d7a5f4effa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kb6h6" (UID: "1724ae64-fb19-417f-9090-22d7a5f4effa") : configmap "kube-rbac-proxy" not found Jul 06 22:47:09.391858 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:09.391664 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1724ae64-fb19-417f-9090-22d7a5f4effa-data-volume\") pod \"insights-runtime-extractor-kb6h6\" (UID: \"1724ae64-fb19-417f-9090-22d7a5f4effa\") " pod="openshift-insights/insights-runtime-extractor-kb6h6" Jul 06 22:47:09.399922 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:09.399895 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6cj4\" (UniqueName: \"kubernetes.io/projected/1724ae64-fb19-417f-9090-22d7a5f4effa-kube-api-access-m6cj4\") pod \"insights-runtime-extractor-kb6h6\" (UID: \"1724ae64-fb19-417f-9090-22d7a5f4effa\") " pod="openshift-insights/insights-runtime-extractor-kb6h6" Jul 06 22:47:09.894119 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:09.894073 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1724ae64-fb19-417f-9090-22d7a5f4effa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kb6h6\" (UID: \"1724ae64-fb19-417f-9090-22d7a5f4effa\") " pod="openshift-insights/insights-runtime-extractor-kb6h6" Jul 06 22:47:09.894304 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:09.894195 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1724ae64-fb19-417f-9090-22d7a5f4effa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kb6h6\" (UID: \"1724ae64-fb19-417f-9090-22d7a5f4effa\") " pod="openshift-insights/insights-runtime-extractor-kb6h6" Jul 06 22:47:09.894304 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:09.894232 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:47:09.894399 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:09.894305 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:47:09.894399 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:09.894326 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1724ae64-fb19-417f-9090-22d7a5f4effa-insights-runtime-extractor-tls podName:1724ae64-fb19-417f-9090-22d7a5f4effa nodeName:}" failed. No retries permitted until 2026-07-06 22:47:10.8943039 +0000 UTC m=+60.359606167 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1724ae64-fb19-417f-9090-22d7a5f4effa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kb6h6" (UID: "1724ae64-fb19-417f-9090-22d7a5f4effa") : secret "insights-runtime-extractor-tls" not found Jul 06 22:47:09.894399 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:09.894353 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1724ae64-fb19-417f-9090-22d7a5f4effa-kube-rbac-proxy-cm podName:1724ae64-fb19-417f-9090-22d7a5f4effa nodeName:}" failed. No retries permitted until 2026-07-06 22:47:10.89434235 +0000 UTC m=+60.359644615 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1724ae64-fb19-417f-9090-22d7a5f4effa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kb6h6" (UID: "1724ae64-fb19-417f-9090-22d7a5f4effa") : configmap "kube-rbac-proxy" not found Jul 06 22:47:10.439105 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:10.439070 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rtzxs_1dc50270-5e71-4a7b-8160-9041cbc18cd9/console-operator/0.log" Jul 06 22:47:10.439583 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:10.439124 2566 generic.go:356] "Generic (PLEG): container finished" podID="1dc50270-5e71-4a7b-8160-9041cbc18cd9" containerID="38be60b94eb926d03a7c3e586346b4d248d128070b155ce98095d732e1bd8427" exitCode=255 Jul 06 22:47:10.439583 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:10.439218 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" event={"ID":"1dc50270-5e71-4a7b-8160-9041cbc18cd9","Type":"ContainerDied","Data":"38be60b94eb926d03a7c3e586346b4d248d128070b155ce98095d732e1bd8427"} Jul 06 22:47:10.439583 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:10.439406 2566 scope.go:117] "RemoveContainer" containerID="38be60b94eb926d03a7c3e586346b4d248d128070b155ce98095d732e1bd8427" Jul 06 22:47:10.440865 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:10.440838 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8fdv" event={"ID":"44a73ff1-a1c0-483d-9edf-500cf057759e","Type":"ContainerStarted","Data":"f6d90a7793e2faf7b18c35f340b0b8ca032e62e9309b4b99fd98e983c299df8e"} Jul 06 22:47:10.442394 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:10.442374 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6c9h9" event={"ID":"9a863898-4829-431a-957f-0983c162a1a2","Type":"ContainerStarted","Data":"fd6b7f7f406f70bf4221d859d1fca84b7a2235a9f23fc5d9b79878293c311b44"} Jul 06 22:47:10.444348 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:10.444326 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwhjz" event={"ID":"2fac8ed3-0adc-4542-aab1-fe8308b1aea0","Type":"ContainerStarted","Data":"ecfc8407a8a67ec65c8d82c6359b0d2119805a604e64c72572a466ee356c92ab"} Jul 06 22:47:10.547440 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:10.547370 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwhjz" podStartSLOduration=1.618855054 podStartE2EDuration="6.547346033s" totalImagesPullingTime="4.928490979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:10.522631664 +0000 UTC m=+59.987933948" watchObservedRunningTime="2026-07-06 22:47:10.547346033 +0000 UTC m=+60.012648315" Jul 06 22:47:10.548030 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:10.547990 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6c9h9" podStartSLOduration=1.8267809910000001 podStartE2EDuration="6.547979835s" totalImagesPullingTime="4.721198844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:10.546052754 +0000 UTC m=+60.011355037" watchObservedRunningTime="2026-07-06 22:47:10.547979835 +0000 UTC m=+60.013282118" Jul 06 22:47:10.565719 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:10.565670 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8fdv" podStartSLOduration=1.719074183 podStartE2EDuration="6.565658093s" totalImagesPullingTime="4.84658391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:10.565127862 +0000 UTC m=+60.030430146" watchObservedRunningTime="2026-07-06 22:47:10.565658093 +0000 UTC m=+60.030960375" Jul 06 22:47:10.903623 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:10.903585 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1724ae64-fb19-417f-9090-22d7a5f4effa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kb6h6\" (UID: \"1724ae64-fb19-417f-9090-22d7a5f4effa\") " pod="openshift-insights/insights-runtime-extractor-kb6h6" Jul 06 22:47:10.903799 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:10.903648 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1724ae64-fb19-417f-9090-22d7a5f4effa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kb6h6\" (UID: \"1724ae64-fb19-417f-9090-22d7a5f4effa\") " pod="openshift-insights/insights-runtime-extractor-kb6h6" Jul 06 22:47:10.903799 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:10.903729 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:47:10.903799 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:10.903756 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:47:10.903987 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:10.903821 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1724ae64-fb19-417f-9090-22d7a5f4effa-kube-rbac-proxy-cm podName:1724ae64-fb19-417f-9090-22d7a5f4effa nodeName:}" failed. No retries permitted until 2026-07-06 22:47:12.90378956 +0000 UTC m=+62.369091826 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1724ae64-fb19-417f-9090-22d7a5f4effa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kb6h6" (UID: "1724ae64-fb19-417f-9090-22d7a5f4effa") : configmap "kube-rbac-proxy" not found Jul 06 22:47:10.903987 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:10.903838 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1724ae64-fb19-417f-9090-22d7a5f4effa-insights-runtime-extractor-tls podName:1724ae64-fb19-417f-9090-22d7a5f4effa nodeName:}" failed. No retries permitted until 2026-07-06 22:47:12.903831482 +0000 UTC m=+62.369133742 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1724ae64-fb19-417f-9090-22d7a5f4effa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kb6h6" (UID: "1724ae64-fb19-417f-9090-22d7a5f4effa") : secret "insights-runtime-extractor-tls" not found Jul 06 22:47:10.992542 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:10.992514 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dpsfc_8fc501b7-3112-4f7e-b832-e14515946afa/dns-node-resolver/0.log" Jul 06 22:47:11.354939 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:11.354911 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jhdnr" Jul 06 22:47:11.449590 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:11.449554 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rtzxs_1dc50270-5e71-4a7b-8160-9041cbc18cd9/console-operator/1.log" Jul 06 22:47:11.450063 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:11.450049 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rtzxs_1dc50270-5e71-4a7b-8160-9041cbc18cd9/console-operator/0.log" Jul 06 22:47:11.450111 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:11.450088 2566 generic.go:356] "Generic (PLEG): container finished" podID="1dc50270-5e71-4a7b-8160-9041cbc18cd9" containerID="687ef20c73d5970f669e9ffbfa832b823d153a47645521534c60b03dc2de61a7" exitCode=255 Jul 06 22:47:11.450177 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:11.450159 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" event={"ID":"1dc50270-5e71-4a7b-8160-9041cbc18cd9","Type":"ContainerDied","Data":"687ef20c73d5970f669e9ffbfa832b823d153a47645521534c60b03dc2de61a7"} Jul 06 22:47:11.450232 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:11.450220 2566 scope.go:117] "RemoveContainer" containerID="38be60b94eb926d03a7c3e586346b4d248d128070b155ce98095d732e1bd8427" Jul 06 22:47:11.450539 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:11.450502 2566 scope.go:117] "RemoveContainer" containerID="687ef20c73d5970f669e9ffbfa832b823d153a47645521534c60b03dc2de61a7" Jul 06 22:47:11.450710 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:11.450686 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-rtzxs_openshift-console-operator(1dc50270-5e71-4a7b-8160-9041cbc18cd9)\"" pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" podUID="1dc50270-5e71-4a7b-8160-9041cbc18cd9" Jul 06 22:47:11.477453 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:11.474430 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:11.544795 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:11.544757 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:11.645371 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:11.645284 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:11.874319 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:11.874281 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:11.935155 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:11.935059 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:11.995141 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:11.995103 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:12.262373 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:12.262280 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:12.359184 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:12.359145 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:12.391980 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:12.391955 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ls869_afb97aaa-10b7-4dc2-94cd-f4b98b8b8912/node-ca/0.log" Jul 06 22:47:12.455582 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:12.455558 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rtzxs_1dc50270-5e71-4a7b-8160-9041cbc18cd9/console-operator/1.log" Jul 06 22:47:12.455991 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:12.455912 2566 scope.go:117] "RemoveContainer" containerID="687ef20c73d5970f669e9ffbfa832b823d153a47645521534c60b03dc2de61a7" Jul 06 22:47:12.456067 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:12.456049 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-rtzxs_openshift-console-operator(1dc50270-5e71-4a7b-8160-9041cbc18cd9)\"" pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" podUID="1dc50270-5e71-4a7b-8160-9041cbc18cd9" Jul 06 22:47:12.770876 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:12.770845 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:12.826047 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:12.825999 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:12.921724 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:12.921692 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1724ae64-fb19-417f-9090-22d7a5f4effa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kb6h6\" (UID: \"1724ae64-fb19-417f-9090-22d7a5f4effa\") " pod="openshift-insights/insights-runtime-extractor-kb6h6" Jul 06 22:47:12.921906 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:12.921756 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1724ae64-fb19-417f-9090-22d7a5f4effa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kb6h6\" (UID: \"1724ae64-fb19-417f-9090-22d7a5f4effa\") " pod="openshift-insights/insights-runtime-extractor-kb6h6" Jul 06 22:47:12.921906 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:12.921836 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:47:12.921979 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:12.921912 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1724ae64-fb19-417f-9090-22d7a5f4effa-kube-rbac-proxy-cm podName:1724ae64-fb19-417f-9090-22d7a5f4effa nodeName:}" failed. No retries permitted until 2026-07-06 22:47:16.92189525 +0000 UTC m=+66.387197510 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1724ae64-fb19-417f-9090-22d7a5f4effa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kb6h6" (UID: "1724ae64-fb19-417f-9090-22d7a5f4effa") : configmap "kube-rbac-proxy" not found Jul 06 22:47:12.921979 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:12.921930 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:47:12.922051 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:12.921985 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1724ae64-fb19-417f-9090-22d7a5f4effa-insights-runtime-extractor-tls podName:1724ae64-fb19-417f-9090-22d7a5f4effa nodeName:}" failed. No retries permitted until 2026-07-06 22:47:16.921969662 +0000 UTC m=+66.387271925 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1724ae64-fb19-417f-9090-22d7a5f4effa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kb6h6" (UID: "1724ae64-fb19-417f-9090-22d7a5f4effa") : secret "insights-runtime-extractor-tls" not found Jul 06 22:47:12.992185 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:12.992156 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gnh7j_20ad72c0-1ddb-4415-9fa8-62ca527e26af/serve-healthcheck-canary/0.log" Jul 06 22:47:13.858943 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:13.858907 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-wvm5p"] Jul 06 22:47:13.863015 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:13.862997 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-wvm5p" Jul 06 22:47:13.865537 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:13.865510 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 06 22:47:13.865537 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:13.865527 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 06 22:47:13.866503 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:13.866486 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 06 22:47:13.866591 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:13.866567 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-nbq5s\"" Jul 06 22:47:13.866591 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:13.866582 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 06 22:47:13.869933 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:13.869911 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-wvm5p"] Jul 06 22:47:13.886580 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:13.886538 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:13.930671 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:13.930636 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ce09fb44-c7a2-4fa7-b595-cfa4ad0e22f2-signing-key\") pod \"service-ca-758f599c5-wvm5p\" (UID: \"ce09fb44-c7a2-4fa7-b595-cfa4ad0e22f2\") " pod="openshift-service-ca/service-ca-758f599c5-wvm5p" Jul 06 22:47:13.930852 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:13.930682 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ce09fb44-c7a2-4fa7-b595-cfa4ad0e22f2-signing-cabundle\") pod \"service-ca-758f599c5-wvm5p\" (UID: \"ce09fb44-c7a2-4fa7-b595-cfa4ad0e22f2\") " pod="openshift-service-ca/service-ca-758f599c5-wvm5p" Jul 06 22:47:13.930852 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:13.930737 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc24l\" (UniqueName: \"kubernetes.io/projected/ce09fb44-c7a2-4fa7-b595-cfa4ad0e22f2-kube-api-access-dc24l\") pod \"service-ca-758f599c5-wvm5p\" (UID: \"ce09fb44-c7a2-4fa7-b595-cfa4ad0e22f2\") " pod="openshift-service-ca/service-ca-758f599c5-wvm5p" Jul 06 22:47:13.953215 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:13.953165 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:14.031449 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:14.031416 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ce09fb44-c7a2-4fa7-b595-cfa4ad0e22f2-signing-key\") pod \"service-ca-758f599c5-wvm5p\" (UID: \"ce09fb44-c7a2-4fa7-b595-cfa4ad0e22f2\") " pod="openshift-service-ca/service-ca-758f599c5-wvm5p" Jul 06 22:47:14.031623 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:14.031455 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ce09fb44-c7a2-4fa7-b595-cfa4ad0e22f2-signing-cabundle\") pod \"service-ca-758f599c5-wvm5p\" (UID: \"ce09fb44-c7a2-4fa7-b595-cfa4ad0e22f2\") " pod="openshift-service-ca/service-ca-758f599c5-wvm5p" Jul 06 22:47:14.031623 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:14.031486 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc24l\" (UniqueName: \"kubernetes.io/projected/ce09fb44-c7a2-4fa7-b595-cfa4ad0e22f2-kube-api-access-dc24l\") pod \"service-ca-758f599c5-wvm5p\" (UID: \"ce09fb44-c7a2-4fa7-b595-cfa4ad0e22f2\") " pod="openshift-service-ca/service-ca-758f599c5-wvm5p" Jul 06 22:47:14.032087 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:14.032066 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ce09fb44-c7a2-4fa7-b595-cfa4ad0e22f2-signing-cabundle\") pod \"service-ca-758f599c5-wvm5p\" (UID: \"ce09fb44-c7a2-4fa7-b595-cfa4ad0e22f2\") " pod="openshift-service-ca/service-ca-758f599c5-wvm5p" Jul 06 22:47:14.033907 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:14.033887 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ce09fb44-c7a2-4fa7-b595-cfa4ad0e22f2-signing-key\") pod \"service-ca-758f599c5-wvm5p\" (UID: \"ce09fb44-c7a2-4fa7-b595-cfa4ad0e22f2\") " pod="openshift-service-ca/service-ca-758f599c5-wvm5p" Jul 06 22:47:14.040289 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:14.040271 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc24l\" (UniqueName: \"kubernetes.io/projected/ce09fb44-c7a2-4fa7-b595-cfa4ad0e22f2-kube-api-access-dc24l\") pod \"service-ca-758f599c5-wvm5p\" (UID: \"ce09fb44-c7a2-4fa7-b595-cfa4ad0e22f2\") " pod="openshift-service-ca/service-ca-758f599c5-wvm5p" Jul 06 22:47:14.172077 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:14.171995 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-wvm5p" Jul 06 22:47:14.293039 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:14.293006 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-wvm5p"] Jul 06 22:47:14.296095 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:47:14.296068 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce09fb44_c7a2_4fa7_b595_cfa4ad0e22f2.slice/crio-e8875d44fea7efc866e027c928e4dc197782b0cc85f1e5dd91fe2ae3eba1e064 WatchSource:0}: Error finding container e8875d44fea7efc866e027c928e4dc197782b0cc85f1e5dd91fe2ae3eba1e064: Status 404 returned error can't find the container with id e8875d44fea7efc866e027c928e4dc197782b0cc85f1e5dd91fe2ae3eba1e064 Jul 06 22:47:14.463916 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:14.463822 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-wvm5p" event={"ID":"ce09fb44-c7a2-4fa7-b595-cfa4ad0e22f2","Type":"ContainerStarted","Data":"3972cbaefc5c257c8974de7457731352d2b34ca77abceeb5e734b2274fe0d76f"} Jul 06 22:47:14.463916 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:14.463869 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-wvm5p" event={"ID":"ce09fb44-c7a2-4fa7-b595-cfa4ad0e22f2","Type":"ContainerStarted","Data":"e8875d44fea7efc866e027c928e4dc197782b0cc85f1e5dd91fe2ae3eba1e064"} Jul 06 22:47:14.483703 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:14.483653 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-wvm5p" podStartSLOduration=1.483638035 podStartE2EDuration="1.483638035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:47:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:14.482250891 +0000 UTC m=+63.947553173" watchObservedRunningTime="2026-07-06 22:47:14.483638035 +0000 UTC m=+63.948940317" Jul 06 22:47:14.772491 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:14.772407 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:14.978142 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:14.978104 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" Jul 06 22:47:14.978627 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:14.978167 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" Jul 06 22:47:14.978627 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:14.978584 2566 scope.go:117] "RemoveContainer" containerID="687ef20c73d5970f669e9ffbfa832b823d153a47645521534c60b03dc2de61a7" Jul 06 22:47:14.978797 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:14.978773 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-rtzxs_openshift-console-operator(1dc50270-5e71-4a7b-8160-9041cbc18cd9)\"" pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" podUID="1dc50270-5e71-4a7b-8160-9041cbc18cd9" Jul 06 22:47:15.746568 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:15.746520 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6802a34f-0779-44b2-8c48-d3dadcc548ee-original-pull-secret\") pod \"global-pull-secret-syncer-fc82v\" (UID: \"6802a34f-0779-44b2-8c48-d3dadcc548ee\") " pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:47:15.746793 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:15.746613 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5hz7\" (UniqueName: \"kubernetes.io/projected/c6f370f6-23e4-4c5f-927d-2b4528227518-kube-api-access-j5hz7\") pod \"network-check-target-g7gjs\" (UID: \"c6f370f6-23e4-4c5f-927d-2b4528227518\") " pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:47:15.746793 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:15.746655 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/420491ca-5a34-4390-900c-61bd11f56d77-metrics-certs\") pod \"network-metrics-daemon-s6867\" (UID: \"420491ca-5a34-4390-900c-61bd11f56d77\") " pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:47:15.749874 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:15.749675 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 22:47:15.750102 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:15.750085 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 22:47:15.750249 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:15.750191 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5hz7\" (UniqueName: \"kubernetes.io/projected/c6f370f6-23e4-4c5f-927d-2b4528227518-kube-api-access-j5hz7\") pod \"network-check-target-g7gjs\" (UID: \"c6f370f6-23e4-4c5f-927d-2b4528227518\") " pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:47:15.757561 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:15.757474 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:15.757866 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:15.757738 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 22:47:15.757866 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:15.757832 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/420491ca-5a34-4390-900c-61bd11f56d77-metrics-certs podName:420491ca-5a34-4390-900c-61bd11f56d77 nodeName:}" failed. No retries permitted until 2026-07-06 22:48:19.757793094 +0000 UTC m=+129.223095368 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/420491ca-5a34-4390-900c-61bd11f56d77-metrics-certs") pod "network-metrics-daemon-s6867" (UID: "420491ca-5a34-4390-900c-61bd11f56d77") : secret "metrics-daemon-secret" not found Jul 06 22:47:15.760321 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:15.760283 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6802a34f-0779-44b2-8c48-d3dadcc548ee-original-pull-secret\") pod \"global-pull-secret-syncer-fc82v\" (UID: \"6802a34f-0779-44b2-8c48-d3dadcc548ee\") " pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:47:15.919362 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:15.919316 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fc82v" Jul 06 22:47:15.927148 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:15.927119 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lkkl7\"" Jul 06 22:47:15.935283 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:15.935254 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:47:15.963861 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:15.963676 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:16.068779 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:16.068674 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:16.142962 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:16.142866 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fc82v"] Jul 06 22:47:16.154111 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:16.154036 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-g7gjs"] Jul 06 22:47:16.154457 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:47:16.154418 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6802a34f_0779_44b2_8c48_d3dadcc548ee.slice/crio-5a20215ee3651d302190a440f023954cc4ed8643db8dfa0d0e3539e72a1b907d WatchSource:0}: Error finding container 5a20215ee3651d302190a440f023954cc4ed8643db8dfa0d0e3539e72a1b907d: Status 404 returned error can't find the container with id 5a20215ee3651d302190a440f023954cc4ed8643db8dfa0d0e3539e72a1b907d Jul 06 22:47:16.259595 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:16.259389 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:16.367498 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:16.367460 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:16.472073 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:16.472040 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fc82v" event={"ID":"6802a34f-0779-44b2-8c48-d3dadcc548ee","Type":"ContainerStarted","Data":"5a20215ee3651d302190a440f023954cc4ed8643db8dfa0d0e3539e72a1b907d"} Jul 06 22:47:16.473255 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:16.473226 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:16.473957 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:16.473933 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-g7gjs" event={"ID":"c6f370f6-23e4-4c5f-927d-2b4528227518","Type":"ContainerStarted","Data":"9d3741fc27719458aa446cfdc10f285a46c240001bdfa40a352fdc7e3eeed6c1"} Jul 06 22:47:16.474049 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:16.473977 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-g7gjs" event={"ID":"c6f370f6-23e4-4c5f-927d-2b4528227518","Type":"ContainerStarted","Data":"b57ce689d0df8e8a2dc0752dea748361b6bbca45f8ee457b2336bdc5b862ffb7"} Jul 06 22:47:16.474130 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:16.474084 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:47:16.490682 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:16.490641 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-g7gjs" podStartSLOduration=65.490623985 podStartE2EDuration="1m5.490623985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:46:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:16.490354446 +0000 UTC m=+65.955656729" watchObservedRunningTime="2026-07-06 22:47:16.490623985 +0000 UTC m=+65.955926268" Jul 06 22:47:16.856150 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:16.856101 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:16.956023 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:16.955985 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1724ae64-fb19-417f-9090-22d7a5f4effa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kb6h6\" (UID: \"1724ae64-fb19-417f-9090-22d7a5f4effa\") " pod="openshift-insights/insights-runtime-extractor-kb6h6" Jul 06 22:47:16.956208 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:16.956051 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1724ae64-fb19-417f-9090-22d7a5f4effa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kb6h6\" (UID: \"1724ae64-fb19-417f-9090-22d7a5f4effa\") " pod="openshift-insights/insights-runtime-extractor-kb6h6" Jul 06 22:47:16.956208 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:16.956128 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:47:16.956208 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:16.956141 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:47:16.956208 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:16.956196 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1724ae64-fb19-417f-9090-22d7a5f4effa-insights-runtime-extractor-tls podName:1724ae64-fb19-417f-9090-22d7a5f4effa nodeName:}" failed. No retries permitted until 2026-07-06 22:47:24.956183582 +0000 UTC m=+74.421485842 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1724ae64-fb19-417f-9090-22d7a5f4effa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kb6h6" (UID: "1724ae64-fb19-417f-9090-22d7a5f4effa") : secret "insights-runtime-extractor-tls" not found Jul 06 22:47:16.956208 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:16.956211 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1724ae64-fb19-417f-9090-22d7a5f4effa-kube-rbac-proxy-cm podName:1724ae64-fb19-417f-9090-22d7a5f4effa nodeName:}" failed. No retries permitted until 2026-07-06 22:47:24.956202968 +0000 UTC m=+74.421505227 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1724ae64-fb19-417f-9090-22d7a5f4effa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kb6h6" (UID: "1724ae64-fb19-417f-9090-22d7a5f4effa") : configmap "kube-rbac-proxy" not found Jul 06 22:47:17.363240 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:17.363175 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:17.660979 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:17.660886 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e00471d-a3c5-4971-971b-850ddb797e98-metrics-tls\") pod \"dns-default-rt8d9\" (UID: \"7e00471d-a3c5-4971-971b-850ddb797e98\") " pod="openshift-dns/dns-default-rt8d9" Jul 06 22:47:17.660979 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:17.660968 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-registry-tls\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:47:17.661206 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:17.661039 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:47:17.661206 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:17.661079 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:47:17.661206 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:17.661096 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69845bbf78-hgzl5: secret "image-registry-tls" not found Jul 06 22:47:17.661206 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:17.661113 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e00471d-a3c5-4971-971b-850ddb797e98-metrics-tls podName:7e00471d-a3c5-4971-971b-850ddb797e98 nodeName:}" failed. No retries permitted until 2026-07-06 22:47:49.661097736 +0000 UTC m=+99.126400014 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7e00471d-a3c5-4971-971b-850ddb797e98-metrics-tls") pod "dns-default-rt8d9" (UID: "7e00471d-a3c5-4971-971b-850ddb797e98") : secret "dns-default-metrics-tls" not found Jul 06 22:47:17.661206 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:17.661145 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-registry-tls podName:efff2dcd-797f-470d-9bde-befffa596ef9 nodeName:}" failed. No retries permitted until 2026-07-06 22:47:49.661130298 +0000 UTC m=+99.126432561 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-registry-tls") pod "image-registry-69845bbf78-hgzl5" (UID: "efff2dcd-797f-470d-9bde-befffa596ef9") : secret "image-registry-tls" not found Jul 06 22:47:18.064758 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:18.064677 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:18.265623 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:18.265592 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:18.463995 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:18.463957 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:18.655475 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:18.655391 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:18.863923 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:18.863887 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:19.389696 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:19.389659 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:19.494165 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:19.494129 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:19.862044 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:19.861968 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:20.262446 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:20.262364 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:20.367074 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:20.365309 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:20.465304 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:20.465261 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:20.657902 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:20.657849 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:20.862063 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:20.862028 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:21.494059 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:21.494022 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fc82v" event={"ID":"6802a34f-0779-44b2-8c48-d3dadcc548ee","Type":"ContainerStarted","Data":"59349b8b4392316e703cffa82441db1b3537b7f8f2409da238cda0e785893791"} Jul 06 22:47:21.508824 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:21.508766 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fc82v" podStartSLOduration=65.971521772 podStartE2EDuration="1m10.508752869s" totalImagesPullingTime="4.537231097s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:46:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:21.508269917 +0000 UTC m=+70.973572196" watchObservedRunningTime="2026-07-06 22:47:21.508752869 +0000 UTC m=+70.974055150" Jul 06 22:47:21.961194 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:21.961159 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:22.061071 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:22.061034 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:22.258055 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:22.257960 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:22.383352 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:22.383308 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:22.484147 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:22.484115 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:22.649714 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:22.649682 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:22.845885 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:22.845839 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:24.048592 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:24.048557 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:24.257931 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:24.257892 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:24.466762 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:24.466726 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:24.650296 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:24.650263 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:24.851219 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:24.851186 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:25.026397 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:25.026358 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1724ae64-fb19-417f-9090-22d7a5f4effa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kb6h6\" (UID: \"1724ae64-fb19-417f-9090-22d7a5f4effa\") " pod="openshift-insights/insights-runtime-extractor-kb6h6" Jul 06 22:47:25.026563 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:25.026435 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1724ae64-fb19-417f-9090-22d7a5f4effa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kb6h6\" (UID: \"1724ae64-fb19-417f-9090-22d7a5f4effa\") " pod="openshift-insights/insights-runtime-extractor-kb6h6" Jul 06 22:47:25.026563 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:25.026535 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:47:25.026630 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:25.026593 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1724ae64-fb19-417f-9090-22d7a5f4effa-insights-runtime-extractor-tls podName:1724ae64-fb19-417f-9090-22d7a5f4effa nodeName:}" failed. No retries permitted until 2026-07-06 22:47:41.026577862 +0000 UTC m=+90.491880123 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1724ae64-fb19-417f-9090-22d7a5f4effa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kb6h6" (UID: "1724ae64-fb19-417f-9090-22d7a5f4effa") : secret "insights-runtime-extractor-tls" not found Jul 06 22:47:25.027005 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:25.026986 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1724ae64-fb19-417f-9090-22d7a5f4effa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kb6h6\" (UID: \"1724ae64-fb19-417f-9090-22d7a5f4effa\") " pod="openshift-insights/insights-runtime-extractor-kb6h6" Jul 06 22:47:25.773576 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:25.773535 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:25.873262 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:25.873230 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:26.055621 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:26.055529 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:26.255565 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:26.255531 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:26.452828 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:26.452777 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:28.098801 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:28.098767 2566 scope.go:117] "RemoveContainer" containerID="687ef20c73d5970f669e9ffbfa832b823d153a47645521534c60b03dc2de61a7" Jul 06 22:47:28.516251 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:28.516176 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rtzxs_1dc50270-5e71-4a7b-8160-9041cbc18cd9/console-operator/2.log" Jul 06 22:47:28.516624 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:28.516608 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rtzxs_1dc50270-5e71-4a7b-8160-9041cbc18cd9/console-operator/1.log" Jul 06 22:47:28.516677 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:28.516642 2566 generic.go:356] "Generic (PLEG): container finished" podID="1dc50270-5e71-4a7b-8160-9041cbc18cd9" containerID="8b0411e46e9610cc144808e8d4259caf15d03415913298305f57573abb711ab5" exitCode=255 Jul 06 22:47:28.516712 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:28.516672 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" event={"ID":"1dc50270-5e71-4a7b-8160-9041cbc18cd9","Type":"ContainerDied","Data":"8b0411e46e9610cc144808e8d4259caf15d03415913298305f57573abb711ab5"} Jul 06 22:47:28.516745 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:28.516718 2566 scope.go:117] "RemoveContainer" containerID="687ef20c73d5970f669e9ffbfa832b823d153a47645521534c60b03dc2de61a7" Jul 06 22:47:28.517030 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:28.517013 2566 scope.go:117] "RemoveContainer" containerID="8b0411e46e9610cc144808e8d4259caf15d03415913298305f57573abb711ab5" Jul 06 22:47:28.517271 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:28.517251 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-rtzxs_openshift-console-operator(1dc50270-5e71-4a7b-8160-9041cbc18cd9)\"" pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" podUID="1dc50270-5e71-4a7b-8160-9041cbc18cd9" Jul 06 22:47:29.520967 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:29.520943 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rtzxs_1dc50270-5e71-4a7b-8160-9041cbc18cd9/console-operator/2.log" Jul 06 22:47:32.331406 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:32.331275 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:32.431575 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:32.431542 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:34.977593 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:34.977555 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" Jul 06 22:47:34.978030 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:34.977615 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" Jul 06 22:47:34.978030 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:34.977932 2566 scope.go:117] "RemoveContainer" containerID="8b0411e46e9610cc144808e8d4259caf15d03415913298305f57573abb711ab5" Jul 06 22:47:34.978134 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:34.978087 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-rtzxs_openshift-console-operator(1dc50270-5e71-4a7b-8160-9041cbc18cd9)\"" pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" podUID="1dc50270-5e71-4a7b-8160-9041cbc18cd9" Jul 06 22:47:35.147711 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:35.147683 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8655fbf76b-f2x8z"] Jul 06 22:47:35.148212 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:35.148181 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:35.151102 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:35.151082 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8655fbf76b-f2x8z" Jul 06 22:47:35.153744 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:35.153723 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 06 22:47:35.153744 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:35.153732 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 06 22:47:35.153925 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:35.153773 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 06 22:47:35.153925 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:35.153846 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-pftqm\"" Jul 06 22:47:35.153925 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:35.153886 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 06 22:47:35.164474 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:35.164454 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8655fbf76b-f2x8z"] Jul 06 22:47:35.232435 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:35.232336 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:35.308902 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:35.308868 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25xxx\" (UniqueName: \"kubernetes.io/projected/1158852f-e018-4ee4-8ccc-9681cbee8231-kube-api-access-25xxx\") pod \"managed-serviceaccount-addon-agent-8655fbf76b-f2x8z\" (UID: \"1158852f-e018-4ee4-8ccc-9681cbee8231\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8655fbf76b-f2x8z" Jul 06 22:47:35.309073 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:35.308928 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1158852f-e018-4ee4-8ccc-9681cbee8231-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8655fbf76b-f2x8z\" (UID: \"1158852f-e018-4ee4-8ccc-9681cbee8231\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8655fbf76b-f2x8z" Jul 06 22:47:35.332567 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:35.332536 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:35.410264 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:35.410227 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25xxx\" (UniqueName: \"kubernetes.io/projected/1158852f-e018-4ee4-8ccc-9681cbee8231-kube-api-access-25xxx\") pod \"managed-serviceaccount-addon-agent-8655fbf76b-f2x8z\" (UID: \"1158852f-e018-4ee4-8ccc-9681cbee8231\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8655fbf76b-f2x8z" Jul 06 22:47:35.410424 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:35.410288 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1158852f-e018-4ee4-8ccc-9681cbee8231-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8655fbf76b-f2x8z\" (UID: \"1158852f-e018-4ee4-8ccc-9681cbee8231\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8655fbf76b-f2x8z" Jul 06 22:47:35.412926 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:35.412903 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1158852f-e018-4ee4-8ccc-9681cbee8231-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8655fbf76b-f2x8z\" (UID: \"1158852f-e018-4ee4-8ccc-9681cbee8231\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8655fbf76b-f2x8z" Jul 06 22:47:35.418517 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:35.418495 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25xxx\" (UniqueName: \"kubernetes.io/projected/1158852f-e018-4ee4-8ccc-9681cbee8231-kube-api-access-25xxx\") pod \"managed-serviceaccount-addon-agent-8655fbf76b-f2x8z\" (UID: \"1158852f-e018-4ee4-8ccc-9681cbee8231\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8655fbf76b-f2x8z" Jul 06 22:47:35.469403 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:35.469363 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8655fbf76b-f2x8z" Jul 06 22:47:35.594827 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:35.594778 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8655fbf76b-f2x8z"] Jul 06 22:47:35.597617 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:47:35.597592 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1158852f_e018_4ee4_8ccc_9681cbee8231.slice/crio-5bae113d57a17838d47969011e37097b11aa873c1b9ebccbe57368cab8760747 WatchSource:0}: Error finding container 5bae113d57a17838d47969011e37097b11aa873c1b9ebccbe57368cab8760747: Status 404 returned error can't find the container with id 5bae113d57a17838d47969011e37097b11aa873c1b9ebccbe57368cab8760747 Jul 06 22:47:36.545732 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:36.545688 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8655fbf76b-f2x8z" event={"ID":"1158852f-e018-4ee4-8ccc-9681cbee8231","Type":"ContainerStarted","Data":"5bae113d57a17838d47969011e37097b11aa873c1b9ebccbe57368cab8760747"} Jul 06 22:47:36.787344 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:36.787304 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:36.887074 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:36.887040 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:38.313847 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:38.313737 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:38.554307 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:38.554272 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8655fbf76b-f2x8z" event={"ID":"1158852f-e018-4ee4-8ccc-9681cbee8231","Type":"ContainerStarted","Data":"b1c91b5e92b40936051121edb01ea4e080f73a4c97757d91fb07fc7457769c24"} Jul 06 22:47:38.570336 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:38.570226 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8655fbf76b-f2x8z" podStartSLOduration=1.11379326 podStartE2EDuration="3.570206274s" totalImagesPullingTime="2.456413014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:47:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:38.570204386 +0000 UTC m=+88.035506671" watchObservedRunningTime="2026-07-06 22:47:38.570206274 +0000 UTC m=+88.035508557" Jul 06 22:47:40.945871 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:40.945832 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:41.004482 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:41.004450 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:41.057034 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:41.056999 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1724ae64-fb19-417f-9090-22d7a5f4effa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kb6h6\" (UID: \"1724ae64-fb19-417f-9090-22d7a5f4effa\") " pod="openshift-insights/insights-runtime-extractor-kb6h6" Jul 06 22:47:41.059238 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:41.059209 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1724ae64-fb19-417f-9090-22d7a5f4effa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kb6h6\" (UID: \"1724ae64-fb19-417f-9090-22d7a5f4effa\") " pod="openshift-insights/insights-runtime-extractor-kb6h6" Jul 06 22:47:41.066143 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:41.066121 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4p5jh\"" Jul 06 22:47:41.073774 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:41.073752 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kb6h6" Jul 06 22:47:41.102172 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:41.102140 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:41.237183 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:41.237102 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kb6h6"] Jul 06 22:47:41.240233 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:47:41.240194 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1724ae64_fb19_417f_9090_22d7a5f4effa.slice/crio-6e99762072a077a753d312f805f6b4092da80aea29c6105bc33c9d44d823b2eb WatchSource:0}: Error finding container 6e99762072a077a753d312f805f6b4092da80aea29c6105bc33c9d44d823b2eb: Status 404 returned error can't find the container with id 6e99762072a077a753d312f805f6b4092da80aea29c6105bc33c9d44d823b2eb Jul 06 22:47:41.564463 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:41.564368 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kb6h6" event={"ID":"1724ae64-fb19-417f-9090-22d7a5f4effa","Type":"ContainerStarted","Data":"6e99762072a077a753d312f805f6b4092da80aea29c6105bc33c9d44d823b2eb"} Jul 06 22:47:42.785782 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:42.785748 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:42.891570 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:42.891509 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:42.940367 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:42.940328 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tpbxs"] Jul 06 22:47:42.945431 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:42.945404 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tpbxs" Jul 06 22:47:42.948877 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:42.948831 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gx79d\"" Jul 06 22:47:42.949249 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:42.949118 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 22:47:42.950441 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:42.950414 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tpbxs"] Jul 06 22:47:42.964787 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:42.964758 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:43.072897 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:43.072785 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/27c5038b-6397-4793-89fc-8f8b74588249-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-tpbxs\" (UID: \"27c5038b-6397-4793-89fc-8f8b74588249\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tpbxs" Jul 06 22:47:43.173417 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:43.173377 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/27c5038b-6397-4793-89fc-8f8b74588249-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-tpbxs\" (UID: \"27c5038b-6397-4793-89fc-8f8b74588249\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tpbxs" Jul 06 22:47:43.173619 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:43.173563 2566 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 06 22:47:43.173685 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:43.173645 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27c5038b-6397-4793-89fc-8f8b74588249-tls-certificates podName:27c5038b-6397-4793-89fc-8f8b74588249 nodeName:}" failed. No retries permitted until 2026-07-06 22:47:43.6736213 +0000 UTC m=+93.138923574 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/27c5038b-6397-4793-89fc-8f8b74588249-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-tpbxs" (UID: "27c5038b-6397-4793-89fc-8f8b74588249") : secret "prometheus-operator-admission-webhook-tls" not found Jul 06 22:47:43.241374 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:43.241293 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:43.679271 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:43.679231 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/27c5038b-6397-4793-89fc-8f8b74588249-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-tpbxs\" (UID: \"27c5038b-6397-4793-89fc-8f8b74588249\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tpbxs" Jul 06 22:47:43.682051 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:43.682020 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/27c5038b-6397-4793-89fc-8f8b74588249-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-tpbxs\" (UID: \"27c5038b-6397-4793-89fc-8f8b74588249\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tpbxs" Jul 06 22:47:43.858185 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:43.858147 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tpbxs" Jul 06 22:47:45.058462 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:45.058433 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tpbxs"] Jul 06 22:47:45.062135 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:47:45.062108 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27c5038b_6397_4793_89fc_8f8b74588249.slice/crio-d568200d49653d0fb42518090221673fe0cf96410e6590114e3f846838ea6a57 WatchSource:0}: Error finding container d568200d49653d0fb42518090221673fe0cf96410e6590114e3f846838ea6a57: Status 404 returned error can't find the container with id d568200d49653d0fb42518090221673fe0cf96410e6590114e3f846838ea6a57 Jul 06 22:47:45.586869 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:45.586828 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tpbxs" event={"ID":"27c5038b-6397-4793-89fc-8f8b74588249","Type":"ContainerStarted","Data":"d568200d49653d0fb42518090221673fe0cf96410e6590114e3f846838ea6a57"} Jul 06 22:47:45.588235 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:45.588211 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kb6h6" event={"ID":"1724ae64-fb19-417f-9090-22d7a5f4effa","Type":"ContainerStarted","Data":"ddfe47f3ebb7890d006ba311dece4b0a1438ac9c7756325610a9d357918bee81"} Jul 06 22:47:46.594621 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:46.594586 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kb6h6" event={"ID":"1724ae64-fb19-417f-9090-22d7a5f4effa","Type":"ContainerStarted","Data":"1de37a1063b5e90c9d02c468b73c1cd64e06e6707bc5f7009efca8e07dc33263"} Jul 06 22:47:46.596231 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:46.596201 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tpbxs" event={"ID":"27c5038b-6397-4793-89fc-8f8b74588249","Type":"ContainerStarted","Data":"47740c0a4aa790e2cffac9c14d406322638fb7cf53a6769ddc4993da39424ca2"} Jul 06 22:47:46.596458 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:46.596434 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tpbxs" Jul 06 22:47:46.601533 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:46.601504 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tpbxs" Jul 06 22:47:46.612139 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:46.612087 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tpbxs" podStartSLOduration=3.4948104669999998 podStartE2EDuration="4.612074022s" totalImagesPullingTime="1.117263555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:46.610219386 +0000 UTC m=+96.075521668" watchObservedRunningTime="2026-07-06 22:47:46.612074022 +0000 UTC m=+96.077376285" Jul 06 22:47:46.966939 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:46.966855 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:46.996947 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:46.996917 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-gzcc9"] Jul 06 22:47:46.999342 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:46.999320 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gzcc9" Jul 06 22:47:47.002000 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:47.001974 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 22:47:47.002122 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:47.001973 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 06 22:47:47.002122 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:47.002007 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 06 22:47:47.003182 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:47.003151 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-799lk\"" Jul 06 22:47:47.003466 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:47.003449 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 22:47:47.003561 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:47.003472 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 22:47:47.005294 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:47.005271 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f9c5a23-b7a6-4050-939f-9d517d287b23-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-gzcc9\" (UID: \"6f9c5a23-b7a6-4050-939f-9d517d287b23\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gzcc9" Jul 06 22:47:47.005407 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:47.005313 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f9c5a23-b7a6-4050-939f-9d517d287b23-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-gzcc9\" (UID: \"6f9c5a23-b7a6-4050-939f-9d517d287b23\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gzcc9" Jul 06 22:47:47.005476 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:47.005405 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8csb\" (UniqueName: \"kubernetes.io/projected/6f9c5a23-b7a6-4050-939f-9d517d287b23-kube-api-access-x8csb\") pod \"prometheus-operator-567f7b8b7c-gzcc9\" (UID: \"6f9c5a23-b7a6-4050-939f-9d517d287b23\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gzcc9" Jul 06 22:47:47.005600 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:47.005455 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f9c5a23-b7a6-4050-939f-9d517d287b23-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-gzcc9\" (UID: \"6f9c5a23-b7a6-4050-939f-9d517d287b23\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gzcc9" Jul 06 22:47:47.008523 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:47.008457 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-gzcc9"] Jul 06 22:47:47.032202 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:47.032104 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:47.106586 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:47.106558 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f9c5a23-b7a6-4050-939f-9d517d287b23-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-gzcc9\" (UID: \"6f9c5a23-b7a6-4050-939f-9d517d287b23\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gzcc9" Jul 06 22:47:47.106781 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:47.106605 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f9c5a23-b7a6-4050-939f-9d517d287b23-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-gzcc9\" (UID: \"6f9c5a23-b7a6-4050-939f-9d517d287b23\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gzcc9" Jul 06 22:47:47.106781 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:47.106640 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f9c5a23-b7a6-4050-939f-9d517d287b23-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-gzcc9\" (UID: \"6f9c5a23-b7a6-4050-939f-9d517d287b23\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gzcc9" Jul 06 22:47:47.106781 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:47.106716 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8csb\" (UniqueName: \"kubernetes.io/projected/6f9c5a23-b7a6-4050-939f-9d517d287b23-kube-api-access-x8csb\") pod \"prometheus-operator-567f7b8b7c-gzcc9\" (UID: \"6f9c5a23-b7a6-4050-939f-9d517d287b23\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gzcc9" Jul 06 22:47:47.107534 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:47.107504 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f9c5a23-b7a6-4050-939f-9d517d287b23-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-gzcc9\" (UID: \"6f9c5a23-b7a6-4050-939f-9d517d287b23\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gzcc9" Jul 06 22:47:47.109489 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:47.109461 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f9c5a23-b7a6-4050-939f-9d517d287b23-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-gzcc9\" (UID: \"6f9c5a23-b7a6-4050-939f-9d517d287b23\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gzcc9" Jul 06 22:47:47.109594 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:47.109552 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f9c5a23-b7a6-4050-939f-9d517d287b23-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-gzcc9\" (UID: \"6f9c5a23-b7a6-4050-939f-9d517d287b23\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gzcc9" Jul 06 22:47:47.115077 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:47.115043 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:47.115188 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:47.115128 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8csb\" (UniqueName: \"kubernetes.io/projected/6f9c5a23-b7a6-4050-939f-9d517d287b23-kube-api-access-x8csb\") pod \"prometheus-operator-567f7b8b7c-gzcc9\" (UID: \"6f9c5a23-b7a6-4050-939f-9d517d287b23\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gzcc9" Jul 06 22:47:47.311220 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:47.311137 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gzcc9" Jul 06 22:47:47.480456 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:47.480423 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-g7gjs" Jul 06 22:47:48.317714 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:48.317645 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-gzcc9"] Jul 06 22:47:48.319959 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:47:48.319937 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f9c5a23_b7a6_4050_939f_9d517d287b23.slice/crio-d8ba97a807bedff03f0ea1738e5a9e664347df01e9f9911e3e55247c33e7282b WatchSource:0}: Error finding container d8ba97a807bedff03f0ea1738e5a9e664347df01e9f9911e3e55247c33e7282b: Status 404 returned error can't find the container with id d8ba97a807bedff03f0ea1738e5a9e664347df01e9f9911e3e55247c33e7282b Jul 06 22:47:48.603625 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:48.603594 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gzcc9" event={"ID":"6f9c5a23-b7a6-4050-939f-9d517d287b23","Type":"ContainerStarted","Data":"d8ba97a807bedff03f0ea1738e5a9e664347df01e9f9911e3e55247c33e7282b"} Jul 06 22:47:48.605884 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:48.605854 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kb6h6" event={"ID":"1724ae64-fb19-417f-9090-22d7a5f4effa","Type":"ContainerStarted","Data":"dcafbb43861b374a97178ac852ec9612adf081de55b07f7cb254e5e92fa6447b"} Jul 06 22:47:48.623401 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:48.623370 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kb6h6" podStartSLOduration=32.750402304 podStartE2EDuration="39.623357471s" totalImagesPullingTime="6.872955167s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:47:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:48.622312266 +0000 UTC m=+98.087614549" watchObservedRunningTime="2026-07-06 22:47:48.623357471 +0000 UTC m=+98.088659746" Jul 06 22:47:49.611209 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:49.611174 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gzcc9" event={"ID":"6f9c5a23-b7a6-4050-939f-9d517d287b23","Type":"ContainerStarted","Data":"214a4b746aae0f9447f154576b133cd10aebdcb0163d40ac651e8d5c0dea310b"} Jul 06 22:47:49.611599 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:49.611271 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gzcc9" event={"ID":"6f9c5a23-b7a6-4050-939f-9d517d287b23","Type":"ContainerStarted","Data":"117b3feac8b146f7cee1e6113165864adf387485cc8a9264ecb4dcf4f8687985"} Jul 06 22:47:49.615614 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:49.615588 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:49.627646 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:49.627599 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gzcc9" podStartSLOduration=2.587244464 podStartE2EDuration="3.627586026s" totalImagesPullingTime="1.040341562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:47:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:49.62630151 +0000 UTC m=+99.091603792" watchObservedRunningTime="2026-07-06 22:47:49.627586026 +0000 UTC m=+99.092888308" Jul 06 22:47:49.727546 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:49.727519 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-registry-tls\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:47:49.727684 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:49.727570 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e00471d-a3c5-4971-971b-850ddb797e98-metrics-tls\") pod \"dns-default-rt8d9\" (UID: \"7e00471d-a3c5-4971-971b-850ddb797e98\") " pod="openshift-dns/dns-default-rt8d9" Jul 06 22:47:49.729901 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:49.729875 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-registry-tls\") pod \"image-registry-69845bbf78-hgzl5\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:47:49.729999 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:49.729919 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e00471d-a3c5-4971-971b-850ddb797e98-metrics-tls\") pod \"dns-default-rt8d9\" (UID: \"7e00471d-a3c5-4971-971b-850ddb797e98\") " pod="openshift-dns/dns-default-rt8d9" Jul 06 22:47:49.735075 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:49.735042 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jx42h\"" Jul 06 22:47:49.743036 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:49.743022 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rt8d9" Jul 06 22:47:49.863071 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:49.863048 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rt8d9"] Jul 06 22:47:49.866558 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:47:49.866530 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e00471d_a3c5_4971_971b_850ddb797e98.slice/crio-9e959e5886610ad4aac2b2e2958195fc90ec5264a009ce656a5238a34a81bce1 WatchSource:0}: Error finding container 9e959e5886610ad4aac2b2e2958195fc90ec5264a009ce656a5238a34a81bce1: Status 404 returned error can't find the container with id 9e959e5886610ad4aac2b2e2958195fc90ec5264a009ce656a5238a34a81bce1 Jul 06 22:47:50.021296 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:50.021263 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fr57l\"" Jul 06 22:47:50.029297 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:50.029274 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:47:50.099848 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:50.099802 2566 scope.go:117] "RemoveContainer" containerID="8b0411e46e9610cc144808e8d4259caf15d03415913298305f57573abb711ab5" Jul 06 22:47:50.159619 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:50.159594 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69845bbf78-hgzl5"] Jul 06 22:47:50.161932 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:47:50.161909 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefff2dcd_797f_470d_9bde_befffa596ef9.slice/crio-d08c20af3e471976b3a9cd51f4eaeb7da80313ab3b4afc881a6b360d138b385c WatchSource:0}: Error finding container d08c20af3e471976b3a9cd51f4eaeb7da80313ab3b4afc881a6b360d138b385c: Status 404 returned error can't find the container with id d08c20af3e471976b3a9cd51f4eaeb7da80313ab3b4afc881a6b360d138b385c Jul 06 22:47:50.617784 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:50.617758 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rtzxs_1dc50270-5e71-4a7b-8160-9041cbc18cd9/console-operator/2.log" Jul 06 22:47:50.618245 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:50.617884 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" event={"ID":"1dc50270-5e71-4a7b-8160-9041cbc18cd9","Type":"ContainerStarted","Data":"e8868bc53da8629799729bbe9ee7b80b78a2f56d74edacfbeea1f4bff8e84216"} Jul 06 22:47:50.618343 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:50.618320 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" Jul 06 22:47:50.619959 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:50.619935 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" event={"ID":"efff2dcd-797f-470d-9bde-befffa596ef9","Type":"ContainerStarted","Data":"e886428b6ec460de5f1c446ffd894e4152eb465c0d3455dcb9ee7690c96947a0"} Jul 06 22:47:50.620085 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:50.619976 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" event={"ID":"efff2dcd-797f-470d-9bde-befffa596ef9","Type":"ContainerStarted","Data":"d08c20af3e471976b3a9cd51f4eaeb7da80313ab3b4afc881a6b360d138b385c"} Jul 06 22:47:50.620085 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:50.620000 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:47:50.621879 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:50.621852 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rt8d9" event={"ID":"7e00471d-a3c5-4971-971b-850ddb797e98","Type":"ContainerStarted","Data":"9e959e5886610ad4aac2b2e2958195fc90ec5264a009ce656a5238a34a81bce1"} Jul 06 22:47:50.634916 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:50.634863 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" podStartSLOduration=41.805980876 podStartE2EDuration="46.634845473s" totalImagesPullingTime="4.828864597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:50.634098702 +0000 UTC m=+100.099400984" watchObservedRunningTime="2026-07-06 22:47:50.634845473 +0000 UTC m=+100.100147758" Jul 06 22:47:50.652375 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:50.652318 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" podStartSLOduration=98.652299998 podStartE2EDuration="1m38.652299998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:46:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:50.65150263 +0000 UTC m=+100.116804946" watchObservedRunningTime="2026-07-06 22:47:50.652299998 +0000 UTC m=+100.117602261" Jul 06 22:47:51.091307 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.091221 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:51.300450 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.300411 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:51.375619 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.375588 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7mn2v"] Jul 06 22:47:51.378990 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.378968 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:51.381826 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.381783 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-v6465\"" Jul 06 22:47:51.388527 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.381989 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 22:47:51.388665 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.382073 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 22:47:51.388803 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.382552 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 22:47:51.401586 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.401543 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:51.445132 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.445104 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-node-exporter-tls\") pod \"node-exporter-7mn2v\" (UID: \"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd\") " pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:51.445292 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.445148 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-node-exporter-textfile\") pod \"node-exporter-7mn2v\" (UID: \"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd\") " pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:51.445292 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.445168 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-metrics-client-ca\") pod \"node-exporter-7mn2v\" (UID: \"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd\") " pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:51.445292 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.445228 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-node-exporter-accelerators-collector-config\") pod \"node-exporter-7mn2v\" (UID: \"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd\") " pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:51.445292 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.445252 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-sys\") pod \"node-exporter-7mn2v\" (UID: \"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd\") " pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:51.445292 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.445277 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr4mq\" (UniqueName: \"kubernetes.io/projected/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-kube-api-access-xr4mq\") pod \"node-exporter-7mn2v\" (UID: \"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd\") " pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:51.445536 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.445314 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-node-exporter-wtmp\") pod \"node-exporter-7mn2v\" (UID: \"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd\") " pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:51.445536 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.445332 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-root\") pod \"node-exporter-7mn2v\" (UID: \"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd\") " pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:51.445536 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.445357 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7mn2v\" (UID: \"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd\") " pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:51.546065 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.546032 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-node-exporter-accelerators-collector-config\") pod \"node-exporter-7mn2v\" (UID: \"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd\") " pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:51.546162 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.546089 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-sys\") pod \"node-exporter-7mn2v\" (UID: \"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd\") " pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:51.546162 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.546121 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr4mq\" (UniqueName: \"kubernetes.io/projected/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-kube-api-access-xr4mq\") pod \"node-exporter-7mn2v\" (UID: \"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd\") " pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:51.546276 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.546170 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-node-exporter-wtmp\") pod \"node-exporter-7mn2v\" (UID: \"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd\") " pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:51.546276 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.546196 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-root\") pod \"node-exporter-7mn2v\" (UID: \"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd\") " pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:51.546276 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.546220 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7mn2v\" (UID: \"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd\") " pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:51.546418 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.546278 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-node-exporter-tls\") pod \"node-exporter-7mn2v\" (UID: \"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd\") " pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:51.546418 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.546317 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-node-exporter-textfile\") pod \"node-exporter-7mn2v\" (UID: \"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd\") " pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:51.546418 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.546339 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-metrics-client-ca\") pod \"node-exporter-7mn2v\" (UID: \"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd\") " pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:51.547725 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.546937 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-metrics-client-ca\") pod \"node-exporter-7mn2v\" (UID: \"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd\") " pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:51.547725 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.547059 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-node-exporter-accelerators-collector-config\") pod \"node-exporter-7mn2v\" (UID: \"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd\") " pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:51.547725 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.547079 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-node-exporter-wtmp\") pod \"node-exporter-7mn2v\" (UID: \"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd\") " pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:51.547725 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.547108 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-sys\") pod \"node-exporter-7mn2v\" (UID: \"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd\") " pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:51.547725 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.547121 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-root\") pod \"node-exporter-7mn2v\" (UID: \"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd\") " pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:51.547725 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:51.547194 2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 22:47:51.547725 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:47:51.547246 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-node-exporter-tls podName:084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd nodeName:}" failed. No retries permitted until 2026-07-06 22:47:52.047228531 +0000 UTC m=+101.512530794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-node-exporter-tls") pod "node-exporter-7mn2v" (UID: "084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd") : secret "node-exporter-tls" not found Jul 06 22:47:51.547725 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.547374 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-node-exporter-textfile\") pod \"node-exporter-7mn2v\" (UID: \"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd\") " pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:51.558604 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.558561 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr4mq\" (UniqueName: \"kubernetes.io/projected/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-kube-api-access-xr4mq\") pod \"node-exporter-7mn2v\" (UID: \"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd\") " pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:51.565722 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.565683 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7mn2v\" (UID: \"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd\") " pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:51.618327 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.618297 2566 patch_prober.go:28] interesting pod/console-operator-68b757fb67-rtzxs container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.13:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 06 22:47:51.618628 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.618355 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" podUID="1dc50270-5e71-4a7b-8160-9041cbc18cd9" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.13:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Jul 06 22:47:51.634615 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.634558 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-rtzxs" Jul 06 22:47:51.675281 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.671306 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:51.735895 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.735790 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:51.855940 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.855906 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:51.953991 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:51.953909 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:52.051732 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:52.051703 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-node-exporter-tls\") pod \"node-exporter-7mn2v\" (UID: \"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd\") " pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:52.052668 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:52.052641 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:52.054151 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:52.054130 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd-node-exporter-tls\") pod \"node-exporter-7mn2v\" (UID: \"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd\") " pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:52.156473 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:52.156443 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:52.295099 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:52.295043 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7mn2v" Jul 06 22:47:52.304192 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:47:52.304170 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod084c68fd_0deb_4c34_a9b2_07e2ef0f5ccd.slice/crio-3d7d5419b1881844f3335c593a33be504aaefdc09a98c455575c316f00515956 WatchSource:0}: Error finding container 3d7d5419b1881844f3335c593a33be504aaefdc09a98c455575c316f00515956: Status 404 returned error can't find the container with id 3d7d5419b1881844f3335c593a33be504aaefdc09a98c455575c316f00515956 Jul 06 22:47:52.322511 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:52.322483 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:52.423171 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:52.423142 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:52.520257 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:52.520222 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:52.632953 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:52.632917 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rt8d9" event={"ID":"7e00471d-a3c5-4971-971b-850ddb797e98","Type":"ContainerStarted","Data":"48384306fddef5f683650a5885cc1022a108b360ecd657afd263c18ac770ab07"} Jul 06 22:47:52.633408 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:52.632979 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rt8d9" event={"ID":"7e00471d-a3c5-4971-971b-850ddb797e98","Type":"ContainerStarted","Data":"bdbf321f1efe729e9db260930c5a0e87b70d429d1d9a1f1aa4fb8121c768dd25"} Jul 06 22:47:52.633408 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:52.633087 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rt8d9" Jul 06 22:47:52.634225 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:52.634199 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7mn2v" event={"ID":"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd","Type":"ContainerStarted","Data":"3d7d5419b1881844f3335c593a33be504aaefdc09a98c455575c316f00515956"} Jul 06 22:47:52.736287 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:52.736258 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:52.837563 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:52.837509 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:52.939669 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:52.939567 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:53.008377 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:53.008345 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:53.093891 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:53.093859 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:53.196209 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:53.196125 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:53.555917 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:53.555846 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:53.724629 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:53.724601 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:53.824126 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:53.824100 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:54.303380 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:54.303347 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:54.361505 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:54.361465 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:54.427275 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:54.427234 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:54.635079 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:54.635044 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:54.642167 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:54.642144 2566 generic.go:356] "Generic (PLEG): container finished" podID="084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd" containerID="fc9f3331f78d943432ba878e344b7d241f486993a14c7d51d4970f505259ac73" exitCode=0 Jul 06 22:47:54.642305 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:54.642203 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7mn2v" event={"ID":"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd","Type":"ContainerDied","Data":"fc9f3331f78d943432ba878e344b7d241f486993a14c7d51d4970f505259ac73"} Jul 06 22:47:54.663206 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:54.663172 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rt8d9" podStartSLOduration=68.032295741 podStartE2EDuration="1m9.663156153s" totalImagesPullingTime="1.630860412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:46:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:52.656254358 +0000 UTC m=+102.121556640" watchObservedRunningTime="2026-07-06 22:47:54.663156153 +0000 UTC m=+104.128458446" Jul 06 22:47:55.156027 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.155994 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:55.254799 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.254772 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:55.647475 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.647447 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7mn2v" event={"ID":"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd","Type":"ContainerStarted","Data":"a9a00ae5883600713152f2d61fdbce5d6b22fdbd592169b1f437b8ec7a55a356"} Jul 06 22:47:55.647638 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.647497 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7mn2v" event={"ID":"084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd","Type":"ContainerStarted","Data":"544f6c0345270420dcb59000253577544dec311e844a017065408b0464d18539"} Jul 06 22:47:55.666952 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.666908 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7mn2v" podStartSLOduration=3.183077637 podStartE2EDuration="4.666891997s" totalImagesPullingTime="1.396624347s" totalInitContainerRuntime="87.190013ms" isStatefulPod=true podCreationTimestamp="2026-07-06 22:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:55.665970356 +0000 UTC m=+105.131272639" watchObservedRunningTime="2026-07-06 22:47:55.666891997 +0000 UTC m=+105.132194280" Jul 06 22:47:55.769468 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.769435 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5c84b57f8-vgsqk"] Jul 06 22:47:55.772498 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.772480 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" Jul 06 22:47:55.774999 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.774978 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 06 22:47:55.775144 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.775126 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 22:47:55.775364 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.775336 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-xcnzw\"" Jul 06 22:47:55.775364 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.775358 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 06 22:47:55.775653 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.775639 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-a9ioetm7hgais\"" Jul 06 22:47:55.776274 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.776261 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 06 22:47:55.782002 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.781983 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5c84b57f8-vgsqk"] Jul 06 22:47:55.884058 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.884035 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b8zd\" (UniqueName: \"kubernetes.io/projected/f06af77f-2b43-4344-8aa0-e57e11b9ce16-kube-api-access-8b8zd\") pod \"metrics-server-5c84b57f8-vgsqk\" (UID: \"f06af77f-2b43-4344-8aa0-e57e11b9ce16\") " pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" Jul 06 22:47:55.884165 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.884064 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f06af77f-2b43-4344-8aa0-e57e11b9ce16-audit-log\") pod \"metrics-server-5c84b57f8-vgsqk\" (UID: \"f06af77f-2b43-4344-8aa0-e57e11b9ce16\") " pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" Jul 06 22:47:55.884165 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.884097 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06af77f-2b43-4344-8aa0-e57e11b9ce16-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5c84b57f8-vgsqk\" (UID: \"f06af77f-2b43-4344-8aa0-e57e11b9ce16\") " pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" Jul 06 22:47:55.884165 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.884148 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f06af77f-2b43-4344-8aa0-e57e11b9ce16-secret-metrics-server-client-certs\") pod \"metrics-server-5c84b57f8-vgsqk\" (UID: \"f06af77f-2b43-4344-8aa0-e57e11b9ce16\") " pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" Jul 06 22:47:55.884278 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.884173 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f06af77f-2b43-4344-8aa0-e57e11b9ce16-metrics-server-audit-profiles\") pod \"metrics-server-5c84b57f8-vgsqk\" (UID: \"f06af77f-2b43-4344-8aa0-e57e11b9ce16\") " pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" Jul 06 22:47:55.884278 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.884220 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f06af77f-2b43-4344-8aa0-e57e11b9ce16-client-ca-bundle\") pod \"metrics-server-5c84b57f8-vgsqk\" (UID: \"f06af77f-2b43-4344-8aa0-e57e11b9ce16\") " pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" Jul 06 22:47:55.884278 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.884269 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f06af77f-2b43-4344-8aa0-e57e11b9ce16-secret-metrics-server-tls\") pod \"metrics-server-5c84b57f8-vgsqk\" (UID: \"f06af77f-2b43-4344-8aa0-e57e11b9ce16\") " pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" Jul 06 22:47:55.985441 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.985374 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f06af77f-2b43-4344-8aa0-e57e11b9ce16-secret-metrics-server-client-certs\") pod \"metrics-server-5c84b57f8-vgsqk\" (UID: \"f06af77f-2b43-4344-8aa0-e57e11b9ce16\") " pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" Jul 06 22:47:55.985441 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.985416 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f06af77f-2b43-4344-8aa0-e57e11b9ce16-metrics-server-audit-profiles\") pod \"metrics-server-5c84b57f8-vgsqk\" (UID: \"f06af77f-2b43-4344-8aa0-e57e11b9ce16\") " pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" Jul 06 22:47:55.985441 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.985433 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f06af77f-2b43-4344-8aa0-e57e11b9ce16-client-ca-bundle\") pod \"metrics-server-5c84b57f8-vgsqk\" (UID: \"f06af77f-2b43-4344-8aa0-e57e11b9ce16\") " pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" Jul 06 22:47:55.985611 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.985548 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f06af77f-2b43-4344-8aa0-e57e11b9ce16-secret-metrics-server-tls\") pod \"metrics-server-5c84b57f8-vgsqk\" (UID: \"f06af77f-2b43-4344-8aa0-e57e11b9ce16\") " pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" Jul 06 22:47:55.985611 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.985587 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b8zd\" (UniqueName: \"kubernetes.io/projected/f06af77f-2b43-4344-8aa0-e57e11b9ce16-kube-api-access-8b8zd\") pod \"metrics-server-5c84b57f8-vgsqk\" (UID: \"f06af77f-2b43-4344-8aa0-e57e11b9ce16\") " pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" Jul 06 22:47:55.985687 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.985609 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f06af77f-2b43-4344-8aa0-e57e11b9ce16-audit-log\") pod \"metrics-server-5c84b57f8-vgsqk\" (UID: \"f06af77f-2b43-4344-8aa0-e57e11b9ce16\") " pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" Jul 06 22:47:55.985857 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.985832 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06af77f-2b43-4344-8aa0-e57e11b9ce16-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5c84b57f8-vgsqk\" (UID: \"f06af77f-2b43-4344-8aa0-e57e11b9ce16\") " pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" Jul 06 22:47:55.986029 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.986000 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f06af77f-2b43-4344-8aa0-e57e11b9ce16-audit-log\") pod \"metrics-server-5c84b57f8-vgsqk\" (UID: \"f06af77f-2b43-4344-8aa0-e57e11b9ce16\") " pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" Jul 06 22:47:55.986402 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.986381 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06af77f-2b43-4344-8aa0-e57e11b9ce16-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5c84b57f8-vgsqk\" (UID: \"f06af77f-2b43-4344-8aa0-e57e11b9ce16\") " pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" Jul 06 22:47:55.986492 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.986447 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f06af77f-2b43-4344-8aa0-e57e11b9ce16-metrics-server-audit-profiles\") pod \"metrics-server-5c84b57f8-vgsqk\" (UID: \"f06af77f-2b43-4344-8aa0-e57e11b9ce16\") " pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" Jul 06 22:47:55.988011 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.987992 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f06af77f-2b43-4344-8aa0-e57e11b9ce16-client-ca-bundle\") pod \"metrics-server-5c84b57f8-vgsqk\" (UID: \"f06af77f-2b43-4344-8aa0-e57e11b9ce16\") " pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" Jul 06 22:47:55.988439 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.988420 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f06af77f-2b43-4344-8aa0-e57e11b9ce16-secret-metrics-server-client-certs\") pod \"metrics-server-5c84b57f8-vgsqk\" (UID: \"f06af77f-2b43-4344-8aa0-e57e11b9ce16\") " pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" Jul 06 22:47:55.988584 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.988564 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f06af77f-2b43-4344-8aa0-e57e11b9ce16-secret-metrics-server-tls\") pod \"metrics-server-5c84b57f8-vgsqk\" (UID: \"f06af77f-2b43-4344-8aa0-e57e11b9ce16\") " pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" Jul 06 22:47:55.994686 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:55.994661 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b8zd\" (UniqueName: \"kubernetes.io/projected/f06af77f-2b43-4344-8aa0-e57e11b9ce16-kube-api-access-8b8zd\") pod \"metrics-server-5c84b57f8-vgsqk\" (UID: \"f06af77f-2b43-4344-8aa0-e57e11b9ce16\") " pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" Jul 06 22:47:56.082081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:56.082048 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" Jul 06 22:47:56.111506 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:56.111469 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:56.128999 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:56.128974 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-whqd2"] Jul 06 22:47:56.131993 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:56.131969 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-whqd2" Jul 06 22:47:56.135155 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:56.134919 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 06 22:47:56.135155 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:56.134940 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rhx9h\"" Jul 06 22:47:56.140285 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:56.140263 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-whqd2"] Jul 06 22:47:56.187681 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:56.187651 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77kp7\" (UniqueName: \"kubernetes.io/projected/e7d5983e-4a15-48a3-9718-81dcaac2586e-kube-api-access-77kp7\") pod \"monitoring-plugin-d5dcff7cf-whqd2\" (UID: \"e7d5983e-4a15-48a3-9718-81dcaac2586e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-whqd2" Jul 06 22:47:56.188065 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:56.187715 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e7d5983e-4a15-48a3-9718-81dcaac2586e-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-whqd2\" (UID: \"e7d5983e-4a15-48a3-9718-81dcaac2586e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-whqd2" Jul 06 22:47:56.218076 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:56.218038 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:56.226408 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:56.226389 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5c84b57f8-vgsqk"] Jul 06 22:47:56.228826 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:47:56.228786 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf06af77f_2b43_4344_8aa0_e57e11b9ce16.slice/crio-332d362743303414b6fe022903a55c3ceed38fb5aaa5903644b8deec28649a22 WatchSource:0}: Error finding container 332d362743303414b6fe022903a55c3ceed38fb5aaa5903644b8deec28649a22: Status 404 returned error can't find the container with id 332d362743303414b6fe022903a55c3ceed38fb5aaa5903644b8deec28649a22 Jul 06 22:47:56.288663 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:56.288592 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e7d5983e-4a15-48a3-9718-81dcaac2586e-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-whqd2\" (UID: \"e7d5983e-4a15-48a3-9718-81dcaac2586e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-whqd2" Jul 06 22:47:56.288784 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:56.288767 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77kp7\" (UniqueName: \"kubernetes.io/projected/e7d5983e-4a15-48a3-9718-81dcaac2586e-kube-api-access-77kp7\") pod \"monitoring-plugin-d5dcff7cf-whqd2\" (UID: \"e7d5983e-4a15-48a3-9718-81dcaac2586e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-whqd2" Jul 06 22:47:56.290929 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:56.290909 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e7d5983e-4a15-48a3-9718-81dcaac2586e-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-whqd2\" (UID: \"e7d5983e-4a15-48a3-9718-81dcaac2586e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-whqd2" Jul 06 22:47:56.297698 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:56.297674 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77kp7\" (UniqueName: \"kubernetes.io/projected/e7d5983e-4a15-48a3-9718-81dcaac2586e-kube-api-access-77kp7\") pod \"monitoring-plugin-d5dcff7cf-whqd2\" (UID: \"e7d5983e-4a15-48a3-9718-81dcaac2586e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-whqd2" Jul 06 22:47:56.307074 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:56.307049 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:56.445532 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:56.445501 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-whqd2" Jul 06 22:47:56.564711 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:56.564688 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-whqd2"] Jul 06 22:47:56.566952 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:47:56.566926 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7d5983e_4a15_48a3_9718_81dcaac2586e.slice/crio-ebd0d2c068cb02bd3c1ef13c1d136f95fba558a6d2dad3275d54500644e5de8b WatchSource:0}: Error finding container ebd0d2c068cb02bd3c1ef13c1d136f95fba558a6d2dad3275d54500644e5de8b: Status 404 returned error can't find the container with id ebd0d2c068cb02bd3c1ef13c1d136f95fba558a6d2dad3275d54500644e5de8b Jul 06 22:47:56.652818 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:56.652771 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-whqd2" event={"ID":"e7d5983e-4a15-48a3-9718-81dcaac2586e","Type":"ContainerStarted","Data":"ebd0d2c068cb02bd3c1ef13c1d136f95fba558a6d2dad3275d54500644e5de8b"} Jul 06 22:47:56.653847 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:56.653820 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" event={"ID":"f06af77f-2b43-4344-8aa0-e57e11b9ce16","Type":"ContainerStarted","Data":"332d362743303414b6fe022903a55c3ceed38fb5aaa5903644b8deec28649a22"} Jul 06 22:47:56.873213 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:56.873184 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69845bbf78-hgzl5"] Jul 06 22:47:56.978203 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:56.978174 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:57.048094 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.048061 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:57.649655 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.649562 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:57.653895 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.653477 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 22:47:57.659573 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.659432 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.662233 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.662213 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 22:47:57.662375 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.662266 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 22:47:57.662761 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.662568 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 22:47:57.663072 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.663051 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4wsl4\"" Jul 06 22:47:57.663239 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.663217 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 22:47:57.663390 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.663371 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 22:47:57.664559 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.664541 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 22:47:57.665114 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.665090 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fq9d374c22b3h\"" Jul 06 22:47:57.665275 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.665250 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 22:47:57.665369 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.665268 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 22:47:57.665868 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.665851 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 22:47:57.666143 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.666121 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 22:47:57.667053 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.665875 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 22:47:57.673468 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.673453 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 22:47:57.674409 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.674390 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 22:47:57.680113 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.680090 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 22:47:57.683026 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.682326 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 22:47:57.704460 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.704428 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.704590 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.704518 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.704590 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.704544 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.704759 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.704627 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.704759 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.704678 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-web-config\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.704759 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.704705 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.704759 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.704731 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.705008 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.704767 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.705008 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.704799 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.705008 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.704854 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.705008 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.704878 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-config\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.705008 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.704912 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.705008 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.704943 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.705008 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.704976 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.705008 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.704992 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.705385 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.705016 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.705385 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.705069 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-config-out\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.705385 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.705087 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.705385 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.705157 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.705385 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.705205 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrckq\" (UniqueName: \"kubernetes.io/projected/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-kube-api-access-mrckq\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.805986 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.805942 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.806164 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.805999 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.806164 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.806045 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-web-config\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.806164 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.806070 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.806398 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.806376 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.806487 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.806417 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.806487 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.806458 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.806595 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.806493 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.806595 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.806521 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-config\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.806595 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.806530 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.806595 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.806584 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.806799 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.806613 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.806799 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.806644 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.806799 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.806677 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.806799 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.806700 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.806799 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.806740 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-config-out\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.806799 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.806762 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.806799 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.806837 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.807738 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.806863 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.807738 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.806870 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrckq\" (UniqueName: \"kubernetes.io/projected/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-kube-api-access-mrckq\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.807738 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.806917 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.807738 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.806943 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.807738 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.807364 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.808018 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.807890 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.808335 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.808307 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.808599 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.808572 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.809964 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.809245 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.809964 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.809642 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.810122 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.810001 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.810795 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.810771 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-config-out\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.811064 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.811043 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-web-config\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.811426 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.811399 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.813154 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.813116 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.813623 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.813586 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.815167 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.815040 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-config\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.815167 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.815046 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.815167 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.815110 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.816143 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.816120 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.816448 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.816428 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.817117 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.817100 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrckq\" (UniqueName: \"kubernetes.io/projected/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-kube-api-access-mrckq\") pod \"prometheus-k8s-0\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:57.981029 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:57.980948 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:47:58.540972 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:58.540944 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 22:47:58.543448 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:47:58.543419 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5763f1af_6772_4ca0_b9bb_483d5cb0cf9c.slice/crio-a298c24993b91c103125cef79e93fac3ce2b2856b5095c674f81727d16975559 WatchSource:0}: Error finding container a298c24993b91c103125cef79e93fac3ce2b2856b5095c674f81727d16975559: Status 404 returned error can't find the container with id a298c24993b91c103125cef79e93fac3ce2b2856b5095c674f81727d16975559 Jul 06 22:47:58.665995 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:58.665919 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c","Type":"ContainerStarted","Data":"a298c24993b91c103125cef79e93fac3ce2b2856b5095c674f81727d16975559"} Jul 06 22:47:58.667833 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:58.667778 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" event={"ID":"f06af77f-2b43-4344-8aa0-e57e11b9ce16","Type":"ContainerStarted","Data":"0c161c1a2626dbfc0cc981e7182e2e84a28766618448cbfaeede49a55ef13a99"} Jul 06 22:47:58.669345 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:58.669323 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-whqd2" event={"ID":"e7d5983e-4a15-48a3-9718-81dcaac2586e","Type":"ContainerStarted","Data":"ea71b01bf6fe21d3fb0fb20038576cbde15798fb04352ece5454a2640b2b608a"} Jul 06 22:47:58.669508 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:58.669485 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-whqd2" Jul 06 22:47:58.674392 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:58.674376 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-whqd2" Jul 06 22:47:58.684829 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:58.684773 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" podStartSLOduration=1.5211334010000002 podStartE2EDuration="3.684760384s" totalImagesPullingTime="2.163626983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:47:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:58.684233529 +0000 UTC m=+108.149535806" watchObservedRunningTime="2026-07-06 22:47:58.684760384 +0000 UTC m=+108.150062667" Jul 06 22:47:58.701337 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:58.701295 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-whqd2" podStartSLOduration=0.873256478 podStartE2EDuration="2.70128212s" totalImagesPullingTime="1.828025642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:47:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:47:58.699686151 +0000 UTC m=+108.164988436" watchObservedRunningTime="2026-07-06 22:47:58.70128212 +0000 UTC m=+108.166584449" Jul 06 22:47:59.681736 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:59.681649 2566 generic.go:356] "Generic (PLEG): container finished" podID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerID="2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0" exitCode=0 Jul 06 22:47:59.682171 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:47:59.681735 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c","Type":"ContainerDied","Data":"2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0"} Jul 06 22:48:02.336716 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:02.336681 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:02.437875 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:02.437830 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:02.640372 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:02.640339 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rt8d9" Jul 06 22:48:03.701197 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:03.701164 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c","Type":"ContainerStarted","Data":"edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43"} Jul 06 22:48:03.701617 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:03.701229 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c","Type":"ContainerStarted","Data":"00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed"} Jul 06 22:48:03.845014 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:03.844968 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:03.934322 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:03.934272 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:03.990042 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:03.989963 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:04.707348 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:04.707324 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c","Type":"ContainerStarted","Data":"738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca"} Jul 06 22:48:05.714103 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:05.714071 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c","Type":"ContainerStarted","Data":"7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f"} Jul 06 22:48:05.714495 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:05.714134 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c","Type":"ContainerStarted","Data":"4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483"} Jul 06 22:48:05.714495 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:05.714160 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c","Type":"ContainerStarted","Data":"6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520"} Jul 06 22:48:05.744580 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:05.744530 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.04174129 podStartE2EDuration="8.74451171s" totalImagesPullingTime="5.68365026s" totalInitContainerRuntime="19.12016ms" isStatefulPod=false podCreationTimestamp="2026-07-06 22:47:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:48:05.743159294 +0000 UTC m=+115.208461602" watchObservedRunningTime="2026-07-06 22:48:05.74451171 +0000 UTC m=+115.209813995" Jul 06 22:48:06.879745 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:06.879713 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:48:06.936530 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:06.936498 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:06.998226 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:06.998193 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:07.549098 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:07.549051 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:07.608442 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:07.608412 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:07.981429 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:07.981400 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:48:11.739052 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:11.739011 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:11.839991 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:11.839961 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:12.807141 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:12.807105 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:13.131220 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:13.131168 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:13.231517 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:13.231479 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:14.144086 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:14.144047 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:14.202317 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:14.202281 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:16.024947 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:16.024916 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:16.082743 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:16.082720 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" Jul 06 22:48:16.082898 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:16.082797 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" Jul 06 22:48:16.086071 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:16.086042 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:17.336212 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:17.336175 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:17.402913 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:17.402879 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:19.804037 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:19.804000 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/420491ca-5a34-4390-900c-61bd11f56d77-metrics-certs\") pod \"network-metrics-daemon-s6867\" (UID: \"420491ca-5a34-4390-900c-61bd11f56d77\") " pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:48:19.806360 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:19.806329 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/420491ca-5a34-4390-900c-61bd11f56d77-metrics-certs\") pod \"network-metrics-daemon-s6867\" (UID: \"420491ca-5a34-4390-900c-61bd11f56d77\") " pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:48:19.813140 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:19.813117 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5j2wj\"" Jul 06 22:48:19.821022 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:19.821005 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s6867" Jul 06 22:48:19.990278 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:19.990255 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s6867"] Jul 06 22:48:19.994381 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:48:19.994346 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod420491ca_5a34_4390_900c_61bd11f56d77.slice/crio-547dc96de131c774f6ad3d433ee02593d3ed5d1e8647562b97e96f918f0cbb9c WatchSource:0}: Error finding container 547dc96de131c774f6ad3d433ee02593d3ed5d1e8647562b97e96f918f0cbb9c: Status 404 returned error can't find the container with id 547dc96de131c774f6ad3d433ee02593d3ed5d1e8647562b97e96f918f0cbb9c Jul 06 22:48:20.772619 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:20.772588 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s6867" event={"ID":"420491ca-5a34-4390-900c-61bd11f56d77","Type":"ContainerStarted","Data":"547dc96de131c774f6ad3d433ee02593d3ed5d1e8647562b97e96f918f0cbb9c"} Jul 06 22:48:21.778050 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:21.778014 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s6867" event={"ID":"420491ca-5a34-4390-900c-61bd11f56d77","Type":"ContainerStarted","Data":"d39517e8d39b84ac9655be533576f25dd5be4b8b09b9e347bedb6cf452c8cebf"} Jul 06 22:48:21.778510 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:21.778069 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s6867" event={"ID":"420491ca-5a34-4390-900c-61bd11f56d77","Type":"ContainerStarted","Data":"0a407d68e00e66684fe9875d72e5c7fe6a6ee3a0bb6076129d396383543152bf"} Jul 06 22:48:21.779396 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:21.779368 2566 generic.go:356] "Generic (PLEG): container finished" podID="2fac8ed3-0adc-4542-aab1-fe8308b1aea0" containerID="ecfc8407a8a67ec65c8d82c6359b0d2119805a604e64c72572a466ee356c92ab" exitCode=0 Jul 06 22:48:21.779521 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:21.779420 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwhjz" event={"ID":"2fac8ed3-0adc-4542-aab1-fe8308b1aea0","Type":"ContainerDied","Data":"ecfc8407a8a67ec65c8d82c6359b0d2119805a604e64c72572a466ee356c92ab"} Jul 06 22:48:21.779701 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:21.779687 2566 scope.go:117] "RemoveContainer" containerID="ecfc8407a8a67ec65c8d82c6359b0d2119805a604e64c72572a466ee356c92ab" Jul 06 22:48:21.794535 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:21.794485 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-s6867" podStartSLOduration=129.846503024 podStartE2EDuration="2m10.794471235s" totalImagesPullingTime="947.968211ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:46:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:48:21.793596738 +0000 UTC m=+131.258899020" watchObservedRunningTime="2026-07-06 22:48:21.794471235 +0000 UTC m=+131.259773516" Jul 06 22:48:21.894341 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:21.894293 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" podUID="efff2dcd-797f-470d-9bde-befffa596ef9" containerName="registry" containerID="cri-o://e886428b6ec460de5f1c446ffd894e4152eb465c0d3455dcb9ee7690c96947a0" gracePeriod=30 Jul 06 22:48:21.894947 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:21.894910 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:21.962031 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:21.961999 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:22.031321 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.031225 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:22.093435 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.093400 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:22.148316 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.148291 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:48:22.326789 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.326699 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-bound-sa-token\") pod \"efff2dcd-797f-470d-9bde-befffa596ef9\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " Jul 06 22:48:22.326789 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.326759 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/efff2dcd-797f-470d-9bde-befffa596ef9-registry-certificates\") pod \"efff2dcd-797f-470d-9bde-befffa596ef9\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " Jul 06 22:48:22.326789 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.326792 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qkv6\" (UniqueName: \"kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-kube-api-access-8qkv6\") pod \"efff2dcd-797f-470d-9bde-befffa596ef9\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " Jul 06 22:48:22.327098 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.326849 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/efff2dcd-797f-470d-9bde-befffa596ef9-trusted-ca\") pod \"efff2dcd-797f-470d-9bde-befffa596ef9\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " Jul 06 22:48:22.327098 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.326985 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/efff2dcd-797f-470d-9bde-befffa596ef9-installation-pull-secrets\") pod \"efff2dcd-797f-470d-9bde-befffa596ef9\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " Jul 06 22:48:22.327098 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.327046 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/efff2dcd-797f-470d-9bde-befffa596ef9-image-registry-private-configuration\") pod \"efff2dcd-797f-470d-9bde-befffa596ef9\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " Jul 06 22:48:22.327335 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.327311 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efff2dcd-797f-470d-9bde-befffa596ef9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "efff2dcd-797f-470d-9bde-befffa596ef9" (UID: "efff2dcd-797f-470d-9bde-befffa596ef9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:48:22.327401 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.327315 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efff2dcd-797f-470d-9bde-befffa596ef9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "efff2dcd-797f-470d-9bde-befffa596ef9" (UID: "efff2dcd-797f-470d-9bde-befffa596ef9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:48:22.327401 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.327393 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/efff2dcd-797f-470d-9bde-befffa596ef9-ca-trust-extracted\") pod \"efff2dcd-797f-470d-9bde-befffa596ef9\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " Jul 06 22:48:22.327498 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.327434 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-registry-tls\") pod \"efff2dcd-797f-470d-9bde-befffa596ef9\" (UID: \"efff2dcd-797f-470d-9bde-befffa596ef9\") " Jul 06 22:48:22.327834 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.327783 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/efff2dcd-797f-470d-9bde-befffa596ef9-trusted-ca\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:48:22.327940 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.327837 2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/efff2dcd-797f-470d-9bde-befffa596ef9-registry-certificates\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:48:22.330052 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.329965 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efff2dcd-797f-470d-9bde-befffa596ef9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "efff2dcd-797f-470d-9bde-befffa596ef9" (UID: "efff2dcd-797f-470d-9bde-befffa596ef9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:48:22.330052 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.329995 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-kube-api-access-8qkv6" (OuterVolumeSpecName: "kube-api-access-8qkv6") pod "efff2dcd-797f-470d-9bde-befffa596ef9" (UID: "efff2dcd-797f-470d-9bde-befffa596ef9"). InnerVolumeSpecName "kube-api-access-8qkv6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:48:22.330218 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.330150 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "efff2dcd-797f-470d-9bde-befffa596ef9" (UID: "efff2dcd-797f-470d-9bde-befffa596ef9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:48:22.330363 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.330333 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efff2dcd-797f-470d-9bde-befffa596ef9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "efff2dcd-797f-470d-9bde-befffa596ef9" (UID: "efff2dcd-797f-470d-9bde-befffa596ef9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:48:22.330454 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.330336 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "efff2dcd-797f-470d-9bde-befffa596ef9" (UID: "efff2dcd-797f-470d-9bde-befffa596ef9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:48:22.336922 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.336832 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efff2dcd-797f-470d-9bde-befffa596ef9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "efff2dcd-797f-470d-9bde-befffa596ef9" (UID: "efff2dcd-797f-470d-9bde-befffa596ef9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:48:22.429066 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.429033 2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/efff2dcd-797f-470d-9bde-befffa596ef9-installation-pull-secrets\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:48:22.429066 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.429066 2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/efff2dcd-797f-470d-9bde-befffa596ef9-image-registry-private-configuration\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:48:22.429066 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.429077 2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/efff2dcd-797f-470d-9bde-befffa596ef9-ca-trust-extracted\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:48:22.429289 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.429086 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-registry-tls\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:48:22.429289 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.429096 2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-bound-sa-token\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:48:22.429289 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.429103 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qkv6\" (UniqueName: \"kubernetes.io/projected/efff2dcd-797f-470d-9bde-befffa596ef9-kube-api-access-8qkv6\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:48:22.784119 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.784086 2566 generic.go:356] "Generic (PLEG): container finished" podID="efff2dcd-797f-470d-9bde-befffa596ef9" containerID="e886428b6ec460de5f1c446ffd894e4152eb465c0d3455dcb9ee7690c96947a0" exitCode=0 Jul 06 22:48:22.784614 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.784130 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" Jul 06 22:48:22.784614 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.784180 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" event={"ID":"efff2dcd-797f-470d-9bde-befffa596ef9","Type":"ContainerDied","Data":"e886428b6ec460de5f1c446ffd894e4152eb465c0d3455dcb9ee7690c96947a0"} Jul 06 22:48:22.784614 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.784238 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69845bbf78-hgzl5" event={"ID":"efff2dcd-797f-470d-9bde-befffa596ef9","Type":"ContainerDied","Data":"d08c20af3e471976b3a9cd51f4eaeb7da80313ab3b4afc881a6b360d138b385c"} Jul 06 22:48:22.784614 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.784273 2566 scope.go:117] "RemoveContainer" containerID="e886428b6ec460de5f1c446ffd894e4152eb465c0d3455dcb9ee7690c96947a0" Jul 06 22:48:22.786151 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.786127 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lwhjz" event={"ID":"2fac8ed3-0adc-4542-aab1-fe8308b1aea0","Type":"ContainerStarted","Data":"43659163feebc66aba9b866e429ba73e311981d739a130a78bc4205a44b09016"} Jul 06 22:48:22.793023 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.793006 2566 scope.go:117] "RemoveContainer" containerID="e886428b6ec460de5f1c446ffd894e4152eb465c0d3455dcb9ee7690c96947a0" Jul 06 22:48:22.793286 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:48:22.793267 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e886428b6ec460de5f1c446ffd894e4152eb465c0d3455dcb9ee7690c96947a0\": container with ID starting with e886428b6ec460de5f1c446ffd894e4152eb465c0d3455dcb9ee7690c96947a0 not found: ID does not exist" containerID="e886428b6ec460de5f1c446ffd894e4152eb465c0d3455dcb9ee7690c96947a0" Jul 06 22:48:22.793335 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.793294 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e886428b6ec460de5f1c446ffd894e4152eb465c0d3455dcb9ee7690c96947a0"} err="failed to get container status \"e886428b6ec460de5f1c446ffd894e4152eb465c0d3455dcb9ee7690c96947a0\": rpc error: code = NotFound desc = could not find container \"e886428b6ec460de5f1c446ffd894e4152eb465c0d3455dcb9ee7690c96947a0\": container with ID starting with e886428b6ec460de5f1c446ffd894e4152eb465c0d3455dcb9ee7690c96947a0 not found: ID does not exist" Jul 06 22:48:22.823340 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.823307 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69845bbf78-hgzl5"] Jul 06 22:48:22.829823 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:22.829783 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-69845bbf78-hgzl5"] Jul 06 22:48:23.106331 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:23.106297 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efff2dcd-797f-470d-9bde-befffa596ef9" path="/var/lib/kubelet/pods/efff2dcd-797f-470d-9bde-befffa596ef9/volumes" Jul 06 22:48:23.171919 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:23.171882 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:23.233664 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:23.233629 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:23.287801 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:23.287766 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:25.283887 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:25.283852 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:25.384511 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:25.384468 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:26.143522 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:26.143487 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:26.244780 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:26.244749 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:32.333008 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:32.332969 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:32.425768 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:32.425736 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:36.088159 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:36.088122 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" Jul 06 22:48:36.092586 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:36.092559 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5c84b57f8-vgsqk" Jul 06 22:48:46.881473 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:46.881439 2566 generic.go:356] "Generic (PLEG): container finished" podID="44a73ff1-a1c0-483d-9edf-500cf057759e" containerID="f6d90a7793e2faf7b18c35f340b0b8ca032e62e9309b4b99fd98e983c299df8e" exitCode=0 Jul 06 22:48:46.881911 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:46.881515 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8fdv" event={"ID":"44a73ff1-a1c0-483d-9edf-500cf057759e","Type":"ContainerDied","Data":"f6d90a7793e2faf7b18c35f340b0b8ca032e62e9309b4b99fd98e983c299df8e"} Jul 06 22:48:46.881911 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:46.881900 2566 scope.go:117] "RemoveContainer" containerID="f6d90a7793e2faf7b18c35f340b0b8ca032e62e9309b4b99fd98e983c299df8e" Jul 06 22:48:47.886952 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:47.886919 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n8fdv" event={"ID":"44a73ff1-a1c0-483d-9edf-500cf057759e","Type":"ContainerStarted","Data":"e637ee09e75dd95e2313ae873e963d5141e184c3e0b55055d3244f2e76e8f41e"} Jul 06 22:48:51.806505 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:51.806456 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:57.982228 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:57.982176 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:48:58.003600 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:58.003568 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:48:58.943555 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:48:58.943524 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:10.567478 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:10.567381 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:49:10.969396 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:10.969354 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:49:15.930499 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:15.930462 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 22:49:15.931021 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:15.930844 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerName="prometheus" containerID="cri-o://00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed" gracePeriod=600 Jul 06 22:49:15.931021 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:15.930870 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerName="kube-rbac-proxy" containerID="cri-o://4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483" gracePeriod=600 Jul 06 22:49:15.931021 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:15.930895 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerName="kube-rbac-proxy-thanos" containerID="cri-o://7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f" gracePeriod=600 Jul 06 22:49:15.931162 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:15.931029 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerName="kube-rbac-proxy-web" containerID="cri-o://6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520" gracePeriod=600 Jul 06 22:49:15.931162 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:15.931030 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerName="thanos-sidecar" containerID="cri-o://738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca" gracePeriod=600 Jul 06 22:49:15.931162 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:15.931030 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerName="config-reloader" containerID="cri-o://edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43" gracePeriod=600 Jul 06 22:49:16.176715 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.176688 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:16.269333 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.269244 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-metrics-client-certs\") pod \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " Jul 06 22:49:16.269333 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.269277 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-configmap-serving-certs-ca-bundle\") pod \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " Jul 06 22:49:16.269333 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.269297 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrckq\" (UniqueName: \"kubernetes.io/projected/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-kube-api-access-mrckq\") pod \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " Jul 06 22:49:16.269333 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.269319 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-configmap-metrics-client-ca\") pod \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " Jul 06 22:49:16.269333 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.269336 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-tls-assets\") pod \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " Jul 06 22:49:16.269722 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.269358 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-k8s-rulefiles-2\") pod \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " Jul 06 22:49:16.269722 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.269382 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-thanos-prometheus-http-client-file\") pod \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " Jul 06 22:49:16.269722 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.269405 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-web-config\") pod \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " Jul 06 22:49:16.269722 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.269430 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-k8s-db\") pod \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " Jul 06 22:49:16.269722 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.269451 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-config-out\") pod \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " Jul 06 22:49:16.269722 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.269481 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-kube-rbac-proxy\") pod \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " Jul 06 22:49:16.269722 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.269513 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-k8s-rulefiles-0\") pod \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " Jul 06 22:49:16.269722 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.269548 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-configmap-kubelet-serving-ca-bundle\") pod \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " Jul 06 22:49:16.269722 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.269584 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " Jul 06 22:49:16.269722 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.269616 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-config\") pod \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " Jul 06 22:49:16.269722 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.269659 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " Jul 06 22:49:16.269722 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.269690 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-grpc-tls\") pod \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " Jul 06 22:49:16.270323 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.269733 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-prometheus-k8s-tls\") pod \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " Jul 06 22:49:16.270323 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.269770 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-trusted-ca-bundle\") pod \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " Jul 06 22:49:16.270323 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.269773 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" (UID: "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:49:16.270323 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.269785 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" (UID: "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:49:16.270323 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.269798 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-k8s-rulefiles-1\") pod \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\" (UID: \"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c\") " Jul 06 22:49:16.270323 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.270120 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-configmap-metrics-client-ca\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:49:16.270323 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.270140 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:49:16.270738 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.270500 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" (UID: "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:49:16.270738 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.270625 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" (UID: "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:49:16.271862 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.271832 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" (UID: "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:49:16.272632 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.272432 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" (UID: "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:49:16.272800 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.272763 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-config" (OuterVolumeSpecName: "config") pod "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" (UID: "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:49:16.272800 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.272770 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" (UID: "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:49:16.273101 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.273063 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" (UID: "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:49:16.273195 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.273171 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" (UID: "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:49:16.273401 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.273370 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-config-out" (OuterVolumeSpecName: "config-out") pod "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" (UID: "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:49:16.274003 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.273976 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" (UID: "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:49:16.274447 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.274401 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" (UID: "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:49:16.274546 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.274448 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" (UID: "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:49:16.274616 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.274565 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" (UID: "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:49:16.274801 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.274774 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" (UID: "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:49:16.274904 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.274866 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-kube-api-access-mrckq" (OuterVolumeSpecName: "kube-api-access-mrckq") pod "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" (UID: "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c"). InnerVolumeSpecName "kube-api-access-mrckq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:49:16.274904 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.274884 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" (UID: "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:49:16.275066 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.275046 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" (UID: "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:49:16.283151 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.283132 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-web-config" (OuterVolumeSpecName: "web-config") pod "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" (UID: "5763f1af-6772-4ca0-b9bb-483d5cb0cf9c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:49:16.370797 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.370764 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:49:16.370797 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.370798 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:49:16.370952 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.370830 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:49:16.370952 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.370839 2566 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-metrics-client-certs\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:49:16.370952 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.370850 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:49:16.370952 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.370858 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrckq\" (UniqueName: \"kubernetes.io/projected/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-kube-api-access-mrckq\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:49:16.370952 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.370866 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-tls-assets\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:49:16.370952 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.370874 2566 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:49:16.370952 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.370882 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-web-config\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:49:16.370952 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.370890 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-k8s-db\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:49:16.370952 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.370899 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-config-out\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:49:16.370952 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.370907 2566 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-kube-rbac-proxy\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:49:16.370952 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.370915 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:49:16.370952 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.370923 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:49:16.370952 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.370934 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:49:16.370952 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.370943 2566 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-config\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:49:16.370952 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.370950 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:49:16.370952 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:16.370959 2566 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c-secret-grpc-tls\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:49:17.000045 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.000018 2566 generic.go:356] "Generic (PLEG): container finished" podID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerID="7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f" exitCode=0 Jul 06 22:49:17.000045 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.000039 2566 generic.go:356] "Generic (PLEG): container finished" podID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerID="4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483" exitCode=0 Jul 06 22:49:17.000045 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.000045 2566 generic.go:356] "Generic (PLEG): container finished" podID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerID="6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520" exitCode=0 Jul 06 22:49:17.000421 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.000051 2566 generic.go:356] "Generic (PLEG): container finished" podID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerID="738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca" exitCode=0 Jul 06 22:49:17.000421 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.000059 2566 generic.go:356] "Generic (PLEG): container finished" podID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerID="edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43" exitCode=0 Jul 06 22:49:17.000421 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.000067 2566 generic.go:356] "Generic (PLEG): container finished" podID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerID="00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed" exitCode=0 Jul 06 22:49:17.000421 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.000077 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c","Type":"ContainerDied","Data":"7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f"} Jul 06 22:49:17.000421 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.000093 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.000421 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.000151 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c","Type":"ContainerDied","Data":"4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483"} Jul 06 22:49:17.000421 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.000182 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c","Type":"ContainerDied","Data":"6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520"} Jul 06 22:49:17.000421 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.000226 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c","Type":"ContainerDied","Data":"738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca"} Jul 06 22:49:17.000421 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.000257 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c","Type":"ContainerDied","Data":"edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43"} Jul 06 22:49:17.000421 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.000281 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c","Type":"ContainerDied","Data":"00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed"} Jul 06 22:49:17.000421 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.000229 2566 scope.go:117] "RemoveContainer" containerID="7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f" Jul 06 22:49:17.000421 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.000318 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5763f1af-6772-4ca0-b9bb-483d5cb0cf9c","Type":"ContainerDied","Data":"a298c24993b91c103125cef79e93fac3ce2b2856b5095c674f81727d16975559"} Jul 06 22:49:17.010438 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.010419 2566 scope.go:117] "RemoveContainer" containerID="4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483" Jul 06 22:49:17.017286 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.017268 2566 scope.go:117] "RemoveContainer" containerID="6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520" Jul 06 22:49:17.023963 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.023931 2566 scope.go:117] "RemoveContainer" containerID="738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca" Jul 06 22:49:17.025565 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.025546 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 22:49:17.030476 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.030459 2566 scope.go:117] "RemoveContainer" containerID="edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43" Jul 06 22:49:17.033471 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.033449 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 22:49:17.037300 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.037285 2566 scope.go:117] "RemoveContainer" containerID="00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed" Jul 06 22:49:17.044031 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.044014 2566 scope.go:117] "RemoveContainer" containerID="2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0" Jul 06 22:49:17.050416 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.050398 2566 scope.go:117] "RemoveContainer" containerID="7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f" Jul 06 22:49:17.050713 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:49:17.050693 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f\": container with ID starting with 7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f not found: ID does not exist" containerID="7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f" Jul 06 22:49:17.050782 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.050720 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f"} err="failed to get container status \"7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f\": rpc error: code = NotFound desc = could not find container \"7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f\": container with ID starting with 7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f not found: ID does not exist" Jul 06 22:49:17.050782 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.050737 2566 scope.go:117] "RemoveContainer" containerID="4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483" Jul 06 22:49:17.050995 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:49:17.050979 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483\": container with ID starting with 4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483 not found: ID does not exist" containerID="4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483" Jul 06 22:49:17.051030 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.050998 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483"} err="failed to get container status \"4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483\": rpc error: code = NotFound desc = could not find container \"4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483\": container with ID starting with 4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483 not found: ID does not exist" Jul 06 22:49:17.051030 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.051011 2566 scope.go:117] "RemoveContainer" containerID="6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520" Jul 06 22:49:17.051211 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:49:17.051197 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520\": container with ID starting with 6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520 not found: ID does not exist" containerID="6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520" Jul 06 22:49:17.051246 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.051215 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520"} err="failed to get container status \"6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520\": rpc error: code = NotFound desc = could not find container \"6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520\": container with ID starting with 6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520 not found: ID does not exist" Jul 06 22:49:17.051246 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.051230 2566 scope.go:117] "RemoveContainer" containerID="738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca" Jul 06 22:49:17.051415 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:49:17.051398 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca\": container with ID starting with 738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca not found: ID does not exist" containerID="738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca" Jul 06 22:49:17.051452 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.051418 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca"} err="failed to get container status \"738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca\": rpc error: code = NotFound desc = could not find container \"738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca\": container with ID starting with 738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca not found: ID does not exist" Jul 06 22:49:17.051452 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.051432 2566 scope.go:117] "RemoveContainer" containerID="edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43" Jul 06 22:49:17.051631 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:49:17.051617 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43\": container with ID starting with edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43 not found: ID does not exist" containerID="edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43" Jul 06 22:49:17.051669 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.051634 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43"} err="failed to get container status \"edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43\": rpc error: code = NotFound desc = could not find container \"edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43\": container with ID starting with edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43 not found: ID does not exist" Jul 06 22:49:17.051669 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.051646 2566 scope.go:117] "RemoveContainer" containerID="00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed" Jul 06 22:49:17.051893 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:49:17.051873 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed\": container with ID starting with 00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed not found: ID does not exist" containerID="00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed" Jul 06 22:49:17.051966 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.051901 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed"} err="failed to get container status \"00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed\": rpc error: code = NotFound desc = could not find container \"00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed\": container with ID starting with 00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed not found: ID does not exist" Jul 06 22:49:17.051966 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.051924 2566 scope.go:117] "RemoveContainer" containerID="2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0" Jul 06 22:49:17.052177 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:49:17.052160 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0\": container with ID starting with 2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0 not found: ID does not exist" containerID="2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0" Jul 06 22:49:17.052230 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.052183 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0"} err="failed to get container status \"2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0\": rpc error: code = NotFound desc = could not find container \"2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0\": container with ID starting with 2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0 not found: ID does not exist" Jul 06 22:49:17.052230 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.052210 2566 scope.go:117] "RemoveContainer" containerID="7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f" Jul 06 22:49:17.052439 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.052422 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f"} err="failed to get container status \"7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f\": rpc error: code = NotFound desc = could not find container \"7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f\": container with ID starting with 7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f not found: ID does not exist" Jul 06 22:49:17.052481 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.052440 2566 scope.go:117] "RemoveContainer" containerID="4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483" Jul 06 22:49:17.052656 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.052637 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483"} err="failed to get container status \"4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483\": rpc error: code = NotFound desc = could not find container \"4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483\": container with ID starting with 4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483 not found: ID does not exist" Jul 06 22:49:17.052696 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.052657 2566 scope.go:117] "RemoveContainer" containerID="6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520" Jul 06 22:49:17.052867 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.052850 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520"} err="failed to get container status \"6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520\": rpc error: code = NotFound desc = could not find container \"6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520\": container with ID starting with 6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520 not found: ID does not exist" Jul 06 22:49:17.052917 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.052867 2566 scope.go:117] "RemoveContainer" containerID="738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca" Jul 06 22:49:17.053070 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.053051 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca"} err="failed to get container status \"738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca\": rpc error: code = NotFound desc = could not find container \"738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca\": container with ID starting with 738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca not found: ID does not exist" Jul 06 22:49:17.053137 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.053072 2566 scope.go:117] "RemoveContainer" containerID="edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43" Jul 06 22:49:17.053312 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.053295 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43"} err="failed to get container status \"edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43\": rpc error: code = NotFound desc = could not find container \"edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43\": container with ID starting with edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43 not found: ID does not exist" Jul 06 22:49:17.053359 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.053313 2566 scope.go:117] "RemoveContainer" containerID="00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed" Jul 06 22:49:17.053522 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.053504 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed"} err="failed to get container status \"00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed\": rpc error: code = NotFound desc = could not find container \"00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed\": container with ID starting with 00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed not found: ID does not exist" Jul 06 22:49:17.053591 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.053523 2566 scope.go:117] "RemoveContainer" containerID="2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0" Jul 06 22:49:17.053761 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.053741 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0"} err="failed to get container status \"2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0\": rpc error: code = NotFound desc = could not find container \"2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0\": container with ID starting with 2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0 not found: ID does not exist" Jul 06 22:49:17.053830 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.053763 2566 scope.go:117] "RemoveContainer" containerID="7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f" Jul 06 22:49:17.053990 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.053973 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f"} err="failed to get container status \"7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f\": rpc error: code = NotFound desc = could not find container \"7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f\": container with ID starting with 7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f not found: ID does not exist" Jul 06 22:49:17.054037 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.053991 2566 scope.go:117] "RemoveContainer" containerID="4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483" Jul 06 22:49:17.054195 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.054178 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483"} err="failed to get container status \"4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483\": rpc error: code = NotFound desc = could not find container \"4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483\": container with ID starting with 4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483 not found: ID does not exist" Jul 06 22:49:17.054264 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.054197 2566 scope.go:117] "RemoveContainer" containerID="6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520" Jul 06 22:49:17.054395 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.054380 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520"} err="failed to get container status \"6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520\": rpc error: code = NotFound desc = could not find container \"6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520\": container with ID starting with 6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520 not found: ID does not exist" Jul 06 22:49:17.054439 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.054396 2566 scope.go:117] "RemoveContainer" containerID="738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca" Jul 06 22:49:17.054571 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.054554 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca"} err="failed to get container status \"738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca\": rpc error: code = NotFound desc = could not find container \"738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca\": container with ID starting with 738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca not found: ID does not exist" Jul 06 22:49:17.054612 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.054570 2566 scope.go:117] "RemoveContainer" containerID="edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43" Jul 06 22:49:17.054768 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.054752 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43"} err="failed to get container status \"edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43\": rpc error: code = NotFound desc = could not find container \"edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43\": container with ID starting with edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43 not found: ID does not exist" Jul 06 22:49:17.054841 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.054768 2566 scope.go:117] "RemoveContainer" containerID="00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed" Jul 06 22:49:17.055021 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.055004 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed"} err="failed to get container status \"00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed\": rpc error: code = NotFound desc = could not find container \"00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed\": container with ID starting with 00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed not found: ID does not exist" Jul 06 22:49:17.055064 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.055022 2566 scope.go:117] "RemoveContainer" containerID="2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0" Jul 06 22:49:17.055226 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.055212 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0"} err="failed to get container status \"2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0\": rpc error: code = NotFound desc = could not find container \"2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0\": container with ID starting with 2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0 not found: ID does not exist" Jul 06 22:49:17.055263 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.055226 2566 scope.go:117] "RemoveContainer" containerID="7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f" Jul 06 22:49:17.055421 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.055403 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f"} err="failed to get container status \"7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f\": rpc error: code = NotFound desc = could not find container \"7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f\": container with ID starting with 7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f not found: ID does not exist" Jul 06 22:49:17.055460 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.055422 2566 scope.go:117] "RemoveContainer" containerID="4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483" Jul 06 22:49:17.055600 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.055584 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483"} err="failed to get container status \"4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483\": rpc error: code = NotFound desc = could not find container \"4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483\": container with ID starting with 4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483 not found: ID does not exist" Jul 06 22:49:17.055644 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.055600 2566 scope.go:117] "RemoveContainer" containerID="6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520" Jul 06 22:49:17.055796 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.055777 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520"} err="failed to get container status \"6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520\": rpc error: code = NotFound desc = could not find container \"6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520\": container with ID starting with 6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520 not found: ID does not exist" Jul 06 22:49:17.055870 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.055796 2566 scope.go:117] "RemoveContainer" containerID="738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca" Jul 06 22:49:17.056055 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.056038 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca"} err="failed to get container status \"738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca\": rpc error: code = NotFound desc = could not find container \"738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca\": container with ID starting with 738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca not found: ID does not exist" Jul 06 22:49:17.056097 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.056056 2566 scope.go:117] "RemoveContainer" containerID="edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43" Jul 06 22:49:17.056270 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.056249 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43"} err="failed to get container status \"edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43\": rpc error: code = NotFound desc = could not find container \"edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43\": container with ID starting with edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43 not found: ID does not exist" Jul 06 22:49:17.056323 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.056270 2566 scope.go:117] "RemoveContainer" containerID="00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed" Jul 06 22:49:17.056463 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.056447 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed"} err="failed to get container status \"00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed\": rpc error: code = NotFound desc = could not find container \"00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed\": container with ID starting with 00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed not found: ID does not exist" Jul 06 22:49:17.056547 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.056463 2566 scope.go:117] "RemoveContainer" containerID="2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0" Jul 06 22:49:17.056682 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.056665 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0"} err="failed to get container status \"2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0\": rpc error: code = NotFound desc = could not find container \"2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0\": container with ID starting with 2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0 not found: ID does not exist" Jul 06 22:49:17.056722 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.056683 2566 scope.go:117] "RemoveContainer" containerID="7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f" Jul 06 22:49:17.056898 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.056882 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f"} err="failed to get container status \"7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f\": rpc error: code = NotFound desc = could not find container \"7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f\": container with ID starting with 7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f not found: ID does not exist" Jul 06 22:49:17.056935 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.056899 2566 scope.go:117] "RemoveContainer" containerID="4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483" Jul 06 22:49:17.057086 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.057071 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483"} err="failed to get container status \"4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483\": rpc error: code = NotFound desc = could not find container \"4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483\": container with ID starting with 4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483 not found: ID does not exist" Jul 06 22:49:17.057134 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.057086 2566 scope.go:117] "RemoveContainer" containerID="6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520" Jul 06 22:49:17.057272 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.057255 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520"} err="failed to get container status \"6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520\": rpc error: code = NotFound desc = could not find container \"6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520\": container with ID starting with 6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520 not found: ID does not exist" Jul 06 22:49:17.057323 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.057273 2566 scope.go:117] "RemoveContainer" containerID="738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca" Jul 06 22:49:17.057416 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.057401 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca"} err="failed to get container status \"738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca\": rpc error: code = NotFound desc = could not find container \"738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca\": container with ID starting with 738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca not found: ID does not exist" Jul 06 22:49:17.057466 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.057416 2566 scope.go:117] "RemoveContainer" containerID="edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43" Jul 06 22:49:17.057586 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.057564 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43"} err="failed to get container status \"edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43\": rpc error: code = NotFound desc = could not find container \"edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43\": container with ID starting with edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43 not found: ID does not exist" Jul 06 22:49:17.057642 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.057588 2566 scope.go:117] "RemoveContainer" containerID="00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed" Jul 06 22:49:17.057886 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.057864 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed"} err="failed to get container status \"00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed\": rpc error: code = NotFound desc = could not find container \"00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed\": container with ID starting with 00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed not found: ID does not exist" Jul 06 22:49:17.058003 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.057887 2566 scope.go:117] "RemoveContainer" containerID="2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0" Jul 06 22:49:17.058211 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.058159 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0"} err="failed to get container status \"2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0\": rpc error: code = NotFound desc = could not find container \"2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0\": container with ID starting with 2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0 not found: ID does not exist" Jul 06 22:49:17.058211 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.058191 2566 scope.go:117] "RemoveContainer" containerID="7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f" Jul 06 22:49:17.058620 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.058593 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f"} err="failed to get container status \"7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f\": rpc error: code = NotFound desc = could not find container \"7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f\": container with ID starting with 7f23e5b9bef35b9025732c6efc9daea475670770bb07a938bc22e664712d021f not found: ID does not exist" Jul 06 22:49:17.058687 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.058620 2566 scope.go:117] "RemoveContainer" containerID="4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483" Jul 06 22:49:17.058862 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.058844 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483"} err="failed to get container status \"4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483\": rpc error: code = NotFound desc = could not find container \"4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483\": container with ID starting with 4376c7e555d53f016f89987f97b3e873e92fba642b66bb842e238d064a1e5483 not found: ID does not exist" Jul 06 22:49:17.058862 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.058862 2566 scope.go:117] "RemoveContainer" containerID="6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520" Jul 06 22:49:17.059078 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.059046 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520"} err="failed to get container status \"6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520\": rpc error: code = NotFound desc = could not find container \"6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520\": container with ID starting with 6c26735e7a6d0bb718efae6ae3fb226a0658fdaf7a32ff2411713780e6420520 not found: ID does not exist" Jul 06 22:49:17.059078 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.059072 2566 scope.go:117] "RemoveContainer" containerID="738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca" Jul 06 22:49:17.059301 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.059276 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca"} err="failed to get container status \"738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca\": rpc error: code = NotFound desc = could not find container \"738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca\": container with ID starting with 738f6191180218936a9dfd3cf92c1730944ea71178c00842755b62153c7067ca not found: ID does not exist" Jul 06 22:49:17.059351 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.059302 2566 scope.go:117] "RemoveContainer" containerID="edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43" Jul 06 22:49:17.059482 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.059467 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43"} err="failed to get container status \"edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43\": rpc error: code = NotFound desc = could not find container \"edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43\": container with ID starting with edc8480c7b7d2d0bae4bddec4ed81ded0c3cce3429c0e93643e093ca6be51d43 not found: ID does not exist" Jul 06 22:49:17.059543 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.059482 2566 scope.go:117] "RemoveContainer" containerID="00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed" Jul 06 22:49:17.059678 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.059664 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed"} err="failed to get container status \"00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed\": rpc error: code = NotFound desc = could not find container \"00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed\": container with ID starting with 00af9ec494b545d212718c28a65897f37307e07c7967f5ae9c34d8bd15dcdeed not found: ID does not exist" Jul 06 22:49:17.059726 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.059680 2566 scope.go:117] "RemoveContainer" containerID="2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0" Jul 06 22:49:17.059900 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.059881 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0"} err="failed to get container status \"2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0\": rpc error: code = NotFound desc = could not find container \"2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0\": container with ID starting with 2bd38b40de739cd9afa561fb37b81da4a40ec225d0e231573ca31721c4f928c0 not found: ID does not exist" Jul 06 22:49:17.059969 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.059914 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 22:49:17.060164 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.060153 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerName="prometheus" Jul 06 22:49:17.060198 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.060167 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerName="prometheus" Jul 06 22:49:17.060198 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.060177 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerName="kube-rbac-proxy" Jul 06 22:49:17.060198 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.060182 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerName="kube-rbac-proxy" Jul 06 22:49:17.060198 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.060190 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerName="kube-rbac-proxy-web" Jul 06 22:49:17.060198 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.060195 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerName="kube-rbac-proxy-web" Jul 06 22:49:17.060348 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.060212 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerName="config-reloader" Jul 06 22:49:17.060348 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.060218 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerName="config-reloader" Jul 06 22:49:17.060348 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.060228 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerName="init-config-reloader" Jul 06 22:49:17.060348 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.060234 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerName="init-config-reloader" Jul 06 22:49:17.060348 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.060239 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efff2dcd-797f-470d-9bde-befffa596ef9" containerName="registry" Jul 06 22:49:17.060348 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.060243 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="efff2dcd-797f-470d-9bde-befffa596ef9" containerName="registry" Jul 06 22:49:17.060348 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.060250 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerName="kube-rbac-proxy-thanos" Jul 06 22:49:17.060348 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.060255 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerName="kube-rbac-proxy-thanos" Jul 06 22:49:17.060348 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.060264 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerName="thanos-sidecar" Jul 06 22:49:17.060348 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.060269 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerName="thanos-sidecar" Jul 06 22:49:17.060348 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.060314 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="efff2dcd-797f-470d-9bde-befffa596ef9" containerName="registry" Jul 06 22:49:17.060348 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.060322 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerName="kube-rbac-proxy-web" Jul 06 22:49:17.060348 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.060328 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerName="thanos-sidecar" Jul 06 22:49:17.060348 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.060334 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerName="kube-rbac-proxy-thanos" Jul 06 22:49:17.060348 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.060339 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerName="prometheus" Jul 06 22:49:17.060348 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.060343 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerName="kube-rbac-proxy" Jul 06 22:49:17.060348 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.060349 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" containerName="config-reloader" Jul 06 22:49:17.065357 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.065339 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.067732 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.067712 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 22:49:17.067978 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.067961 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 22:49:17.068059 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.067965 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 22:49:17.068115 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.068079 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 22:49:17.068254 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.068118 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 22:49:17.068311 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.068258 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 22:49:17.068452 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.068434 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 22:49:17.068538 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.068441 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 22:49:17.068703 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.068683 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 22:49:17.068861 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.068847 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fq9d374c22b3h\"" Jul 06 22:49:17.069098 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.069081 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 22:49:17.069275 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.069260 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 22:49:17.069364 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.069342 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4wsl4\"" Jul 06 22:49:17.069413 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.069381 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 22:49:17.070459 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.070437 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 22:49:17.075109 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.075092 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 22:49:17.079410 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.079392 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 22:49:17.103498 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.103466 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5763f1af-6772-4ca0-b9bb-483d5cb0cf9c" path="/var/lib/kubelet/pods/5763f1af-6772-4ca0-b9bb-483d5cb0cf9c/volumes" Jul 06 22:49:17.178030 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.178001 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.178208 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.178035 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.178208 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.178058 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.178208 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.178121 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.178208 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.178204 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.178348 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.178225 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-config\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.178348 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.178252 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.178348 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.178272 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.178348 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.178289 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-config-out\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.178348 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.178302 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.178348 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.178332 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.178525 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.178354 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.178525 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.178376 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.178525 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.178393 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.178525 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.178437 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-web-config\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.178525 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.178456 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.178525 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.178475 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9fpj\" (UniqueName: \"kubernetes.io/projected/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-kube-api-access-r9fpj\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.178525 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.178505 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.178723 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.178532 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.178723 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.178550 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.279782 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.279684 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.279782 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.279724 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.279782 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.279741 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.280067 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.279870 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.280067 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.279915 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-config\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.280067 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.279951 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.280067 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.279975 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.287737 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.280312 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-config-out\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.287737 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.280366 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.287737 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.280404 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.287737 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.280429 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.287737 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.280627 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.287737 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.280662 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.287737 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.280705 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-web-config\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.287737 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.280733 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.287737 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.280766 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9fpj\" (UniqueName: \"kubernetes.io/projected/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-kube-api-access-r9fpj\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.287737 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.280869 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.287737 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.280918 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.287737 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.281001 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.287737 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.281187 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.287737 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.281307 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.287737 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.281335 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.287737 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.283397 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-config-out\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.287737 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.284166 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.288670 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.284968 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.288670 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.285032 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.288670 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.285282 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-web-config\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.288670 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.286148 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.288670 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.286398 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.288670 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.288563 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.289469 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.289048 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.290860 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.290834 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.291004 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.290906 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.291075 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.291004 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.291337 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.291307 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.291423 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.291403 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-config\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.291467 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.291451 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.291574 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.291550 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.291765 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.291750 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.293191 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.293171 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9fpj\" (UniqueName: \"kubernetes.io/projected/c05ee026-7ee7-42e7-ab6b-2ffd79af9908-kube-api-access-r9fpj\") pod \"prometheus-k8s-0\" (UID: \"c05ee026-7ee7-42e7-ab6b-2ffd79af9908\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.376393 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.376364 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:17.512767 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:17.512747 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 22:49:17.514708 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:49:17.514679 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc05ee026_7ee7_42e7_ab6b_2ffd79af9908.slice/crio-1b2b0bcfeb1e6cc773ab2bd6e1716b6fb242e7527751a45b04371f67fd4dfe43 WatchSource:0}: Error finding container 1b2b0bcfeb1e6cc773ab2bd6e1716b6fb242e7527751a45b04371f67fd4dfe43: Status 404 returned error can't find the container with id 1b2b0bcfeb1e6cc773ab2bd6e1716b6fb242e7527751a45b04371f67fd4dfe43 Jul 06 22:49:18.005314 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:18.005281 2566 generic.go:356] "Generic (PLEG): container finished" podID="c05ee026-7ee7-42e7-ab6b-2ffd79af9908" containerID="fa61c69de6d92c0d978d98339ec2ea70cf1b910ef6742e78635882e40bd45447" exitCode=0 Jul 06 22:49:18.005758 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:18.005325 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c05ee026-7ee7-42e7-ab6b-2ffd79af9908","Type":"ContainerDied","Data":"fa61c69de6d92c0d978d98339ec2ea70cf1b910ef6742e78635882e40bd45447"} Jul 06 22:49:18.005758 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:18.005390 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c05ee026-7ee7-42e7-ab6b-2ffd79af9908","Type":"ContainerStarted","Data":"1b2b0bcfeb1e6cc773ab2bd6e1716b6fb242e7527751a45b04371f67fd4dfe43"} Jul 06 22:49:19.013709 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:19.013675 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c05ee026-7ee7-42e7-ab6b-2ffd79af9908","Type":"ContainerStarted","Data":"62a9339804278973508ccf6bc50dbe08c08caccb800ccd2b7b71dacf624f2fb8"} Jul 06 22:49:19.014212 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:19.013743 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c05ee026-7ee7-42e7-ab6b-2ffd79af9908","Type":"ContainerStarted","Data":"09e4f42731cefd78c4f8afbb46c800b0db387b411b9bf26428a7c7a4afb5b490"} Jul 06 22:49:19.014212 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:19.013769 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c05ee026-7ee7-42e7-ab6b-2ffd79af9908","Type":"ContainerStarted","Data":"b9c691a76371b2544fd7dc638a8701ac3c0643d86513b2018e0b93907d68e776"} Jul 06 22:49:19.014212 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:19.013797 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c05ee026-7ee7-42e7-ab6b-2ffd79af9908","Type":"ContainerStarted","Data":"ed3704fdfd5fb5a501cd585443f0fa31d90dd4cd510ebb7b9af4cf83fb538a7e"} Jul 06 22:49:19.014212 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:19.013842 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c05ee026-7ee7-42e7-ab6b-2ffd79af9908","Type":"ContainerStarted","Data":"811f4773b9dc7165d8c24013d72264082ffbf8abf4f66fedaaa0fb8ebb05f7a3"} Jul 06 22:49:19.014212 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:19.013869 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c05ee026-7ee7-42e7-ab6b-2ffd79af9908","Type":"ContainerStarted","Data":"16063d17eb2cc3db7b870f2b97c9f83126ce1c18d43bc43e92d021f29851173e"} Jul 06 22:49:19.046085 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:19.046020 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.028214367 podStartE2EDuration="2.04600328s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.788913ms" isStatefulPod=false podCreationTimestamp="2026-07-06 22:49:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:49:19.043712114 +0000 UTC m=+188.509014396" watchObservedRunningTime="2026-07-06 22:49:19.04600328 +0000 UTC m=+188.511305562" Jul 06 22:49:19.440519 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:19.440469 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:49:19.489935 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:19.489897 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:49:19.544638 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:19.544609 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:49:19.597682 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:19.597650 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:49:20.145994 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:20.145958 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:49:20.199071 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:20.199039 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:49:22.376714 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:22.376676 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:49:30.518048 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:30.518016 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:49:30.575033 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:30.574996 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:49:30.634996 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:30.634965 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:49:55.722509 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:49:55.722465 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:17.376787 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:50:17.376748 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:50:17.392910 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:50:17.392878 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:50:17.807262 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:50:17.807175 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:18.256963 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:50:18.256939 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 22:50:25.776965 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:50:25.776932 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:25.823110 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:50:25.823083 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:27.503071 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:50:27.503033 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:27.552130 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:50:27.552091 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:37.728411 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:50:37.728322 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:37.779555 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:50:37.779526 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:38.833023 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:50:38.832990 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:38.886898 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:50:38.886868 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:39.024541 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:50:39.024510 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:39.080593 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:50:39.080560 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:47.349202 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:50:47.349165 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:47.450436 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:50:47.450402 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:47.501156 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:50:47.501119 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:10.922897 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:51:10.922871 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rtzxs_1dc50270-5e71-4a7b-8160-9041cbc18cd9/console-operator/2.log" Jul 06 22:51:10.933226 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:51:10.933205 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rtzxs_1dc50270-5e71-4a7b-8160-9041cbc18cd9/console-operator/2.log" Jul 06 22:51:10.933716 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:51:10.933695 2566 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 22:51:30.879857 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:51:30.879787 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:32.230542 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:51:32.230496 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:52.886825 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:51:52.886764 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:54.254044 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:51:54.254011 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:56.495673 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:51:56.495630 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:56.612151 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:51:56.612113 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:57.639928 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:51:57.639897 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:57.772334 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:51:57.772300 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:58.680396 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:51:58.680343 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:58.773849 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:51:58.773792 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:00.691513 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:00.691480 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:01.066987 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:01.066886 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:03.485871 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:03.485748 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:03.544666 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:03.544627 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:07.853833 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:07.853780 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:09.494766 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:09.494722 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:09.597610 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:09.597573 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:09.877668 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:09.877633 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:16.320074 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:16.320036 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:16.403581 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:16.403548 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:18.193940 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:18.193903 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:21.798924 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:21.798875 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:21.848086 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:21.848049 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:36.434127 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:36.434090 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:36.528265 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:36.528225 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:37.048909 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.048875 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:37.409660 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.409621 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:37.525643 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.525603 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:37.610323 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.610285 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b8c6df956-wd6nm"] Jul 06 22:52:37.613559 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.613536 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-wd6nm" Jul 06 22:52:37.616638 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.616615 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 22:52:37.616994 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.616969 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 22:52:37.617115 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.616977 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 22:52:37.617115 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.617051 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 22:52:37.617115 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.617101 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8grvv\"" Jul 06 22:52:37.638382 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.638351 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b8c6df956-wd6nm"] Jul 06 22:52:37.742331 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.742229 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:37.796885 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.796849 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c157bcaa-c3b0-4113-ac41-630aeb384b62-tmp\") pod \"opendatahub-operator-controller-manager-6b8c6df956-wd6nm\" (UID: \"c157bcaa-c3b0-4113-ac41-630aeb384b62\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-wd6nm" Jul 06 22:52:37.797086 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.796907 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzpnc\" (UniqueName: \"kubernetes.io/projected/c157bcaa-c3b0-4113-ac41-630aeb384b62-kube-api-access-zzpnc\") pod \"opendatahub-operator-controller-manager-6b8c6df956-wd6nm\" (UID: \"c157bcaa-c3b0-4113-ac41-630aeb384b62\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-wd6nm" Jul 06 22:52:37.797086 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.796997 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c157bcaa-c3b0-4113-ac41-630aeb384b62-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b8c6df956-wd6nm\" (UID: \"c157bcaa-c3b0-4113-ac41-630aeb384b62\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-wd6nm" Jul 06 22:52:37.797086 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.797072 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c157bcaa-c3b0-4113-ac41-630aeb384b62-manifests\") pod \"opendatahub-operator-controller-manager-6b8c6df956-wd6nm\" (UID: \"c157bcaa-c3b0-4113-ac41-630aeb384b62\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-wd6nm" Jul 06 22:52:37.797225 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.797098 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c157bcaa-c3b0-4113-ac41-630aeb384b62-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b8c6df956-wd6nm\" (UID: \"c157bcaa-c3b0-4113-ac41-630aeb384b62\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-wd6nm" Jul 06 22:52:37.842483 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.842440 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:37.898503 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.898467 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c157bcaa-c3b0-4113-ac41-630aeb384b62-manifests\") pod \"opendatahub-operator-controller-manager-6b8c6df956-wd6nm\" (UID: \"c157bcaa-c3b0-4113-ac41-630aeb384b62\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-wd6nm" Jul 06 22:52:37.898503 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.898505 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c157bcaa-c3b0-4113-ac41-630aeb384b62-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b8c6df956-wd6nm\" (UID: \"c157bcaa-c3b0-4113-ac41-630aeb384b62\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-wd6nm" Jul 06 22:52:37.898690 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.898541 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c157bcaa-c3b0-4113-ac41-630aeb384b62-tmp\") pod \"opendatahub-operator-controller-manager-6b8c6df956-wd6nm\" (UID: \"c157bcaa-c3b0-4113-ac41-630aeb384b62\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-wd6nm" Jul 06 22:52:37.898690 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.898581 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzpnc\" (UniqueName: \"kubernetes.io/projected/c157bcaa-c3b0-4113-ac41-630aeb384b62-kube-api-access-zzpnc\") pod \"opendatahub-operator-controller-manager-6b8c6df956-wd6nm\" (UID: \"c157bcaa-c3b0-4113-ac41-630aeb384b62\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-wd6nm" Jul 06 22:52:37.898690 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.898605 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c157bcaa-c3b0-4113-ac41-630aeb384b62-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b8c6df956-wd6nm\" (UID: \"c157bcaa-c3b0-4113-ac41-630aeb384b62\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-wd6nm" Jul 06 22:52:37.898941 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.898919 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c157bcaa-c3b0-4113-ac41-630aeb384b62-manifests\") pod \"opendatahub-operator-controller-manager-6b8c6df956-wd6nm\" (UID: \"c157bcaa-c3b0-4113-ac41-630aeb384b62\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-wd6nm" Jul 06 22:52:37.900996 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.900960 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c157bcaa-c3b0-4113-ac41-630aeb384b62-tmp\") pod \"opendatahub-operator-controller-manager-6b8c6df956-wd6nm\" (UID: \"c157bcaa-c3b0-4113-ac41-630aeb384b62\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-wd6nm" Jul 06 22:52:37.901134 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.901062 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c157bcaa-c3b0-4113-ac41-630aeb384b62-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b8c6df956-wd6nm\" (UID: \"c157bcaa-c3b0-4113-ac41-630aeb384b62\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-wd6nm" Jul 06 22:52:37.901244 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.901225 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c157bcaa-c3b0-4113-ac41-630aeb384b62-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b8c6df956-wd6nm\" (UID: \"c157bcaa-c3b0-4113-ac41-630aeb384b62\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-wd6nm" Jul 06 22:52:37.906962 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.906942 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzpnc\" (UniqueName: \"kubernetes.io/projected/c157bcaa-c3b0-4113-ac41-630aeb384b62-kube-api-access-zzpnc\") pod \"opendatahub-operator-controller-manager-6b8c6df956-wd6nm\" (UID: \"c157bcaa-c3b0-4113-ac41-630aeb384b62\") " pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-wd6nm" Jul 06 22:52:37.923944 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.923920 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-wd6nm" Jul 06 22:52:37.942156 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:37.942126 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:38.032131 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:38.032093 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:38.066119 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:38.066088 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b8c6df956-wd6nm"] Jul 06 22:52:38.069988 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:52:38.069958 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc157bcaa_c3b0_4113_ac41_630aeb384b62.slice/crio-f8613bc1d3c31fe089a6d14ab3385697509d8f4112bb439b322d6cbbf9066f42 WatchSource:0}: Error finding container f8613bc1d3c31fe089a6d14ab3385697509d8f4112bb439b322d6cbbf9066f42: Status 404 returned error can't find the container with id f8613bc1d3c31fe089a6d14ab3385697509d8f4112bb439b322d6cbbf9066f42 Jul 06 22:52:38.071825 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:38.071787 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 22:52:38.111861 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:38.111830 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:38.251860 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:38.251829 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:38.352296 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:38.352261 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:38.452404 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:38.452368 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:38.771643 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:38.771553 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-wd6nm" event={"ID":"c157bcaa-c3b0-4113-ac41-630aeb384b62","Type":"ContainerStarted","Data":"f8613bc1d3c31fe089a6d14ab3385697509d8f4112bb439b322d6cbbf9066f42"} Jul 06 22:52:39.675128 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:39.675088 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:39.781018 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:39.780983 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:41.787311 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:41.787276 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-wd6nm" event={"ID":"c157bcaa-c3b0-4113-ac41-630aeb384b62","Type":"ContainerStarted","Data":"6d81205e0743618f17c40e9629eabfcbe49c963f5053190da125a26a06bc8050"} Jul 06 22:52:42.792784 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:42.792753 2566 generic.go:356] "Generic (PLEG): container finished" podID="c157bcaa-c3b0-4113-ac41-630aeb384b62" containerID="6d81205e0743618f17c40e9629eabfcbe49c963f5053190da125a26a06bc8050" exitCode=0 Jul 06 22:52:42.793198 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:42.792853 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-wd6nm" event={"ID":"c157bcaa-c3b0-4113-ac41-630aeb384b62","Type":"ContainerDied","Data":"6d81205e0743618f17c40e9629eabfcbe49c963f5053190da125a26a06bc8050"} Jul 06 22:52:43.798779 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:43.798735 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-wd6nm" event={"ID":"c157bcaa-c3b0-4113-ac41-630aeb384b62","Type":"ContainerStarted","Data":"bb0bea7a419924554152f91d98a74f52c9b2c3c279fd7dcee472c89211cbfa26"} Jul 06 22:52:43.799280 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:43.798861 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-wd6nm" Jul 06 22:52:43.821721 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:43.821667 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-wd6nm" podStartSLOduration=2.557022896 podStartE2EDuration="6.821652471s" totalImagesPullingTime="3.176605284s" totalInitContainerRuntime="1.088024291s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:52:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:52:43.819203015 +0000 UTC m=+393.284505319" watchObservedRunningTime="2026-07-06 22:52:43.821652471 +0000 UTC m=+393.286954753" Jul 06 22:52:54.805286 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:54.805255 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b8c6df956-wd6nm" Jul 06 22:52:57.063569 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:57.063505 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:57.333709 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:57.333627 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:57.683756 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:57.683726 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-698448cf7f-7954g"] Jul 06 22:52:57.687779 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:57.687739 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:57.694232 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:57.694213 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-698448cf7f-7954g" Jul 06 22:52:57.700635 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:57.700616 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 06 22:52:57.700747 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:57.700650 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 22:52:57.701621 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:57.701595 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 22:52:57.701728 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:57.701594 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 22:52:57.701787 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:57.701728 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6lb2d\"" Jul 06 22:52:57.703120 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:57.703096 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-698448cf7f-7954g"] Jul 06 22:52:57.746126 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:57.746102 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93d3f7da-04ee-4255-8496-d55852f55c45-tls-certs\") pod \"kube-auth-proxy-698448cf7f-7954g\" (UID: \"93d3f7da-04ee-4255-8496-d55852f55c45\") " pod="openshift-ingress/kube-auth-proxy-698448cf7f-7954g" Jul 06 22:52:57.746252 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:57.746143 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93d3f7da-04ee-4255-8496-d55852f55c45-tmp\") pod \"kube-auth-proxy-698448cf7f-7954g\" (UID: \"93d3f7da-04ee-4255-8496-d55852f55c45\") " pod="openshift-ingress/kube-auth-proxy-698448cf7f-7954g" Jul 06 22:52:57.746252 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:57.746176 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk8c6\" (UniqueName: \"kubernetes.io/projected/93d3f7da-04ee-4255-8496-d55852f55c45-kube-api-access-dk8c6\") pod \"kube-auth-proxy-698448cf7f-7954g\" (UID: \"93d3f7da-04ee-4255-8496-d55852f55c45\") " pod="openshift-ingress/kube-auth-proxy-698448cf7f-7954g" Jul 06 22:52:57.846040 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:57.846002 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:57.847035 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:57.847015 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93d3f7da-04ee-4255-8496-d55852f55c45-tls-certs\") pod \"kube-auth-proxy-698448cf7f-7954g\" (UID: \"93d3f7da-04ee-4255-8496-d55852f55c45\") " pod="openshift-ingress/kube-auth-proxy-698448cf7f-7954g" Jul 06 22:52:57.847098 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:57.847053 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93d3f7da-04ee-4255-8496-d55852f55c45-tmp\") pod \"kube-auth-proxy-698448cf7f-7954g\" (UID: \"93d3f7da-04ee-4255-8496-d55852f55c45\") " pod="openshift-ingress/kube-auth-proxy-698448cf7f-7954g" Jul 06 22:52:57.847098 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:57.847090 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk8c6\" (UniqueName: \"kubernetes.io/projected/93d3f7da-04ee-4255-8496-d55852f55c45-kube-api-access-dk8c6\") pod \"kube-auth-proxy-698448cf7f-7954g\" (UID: \"93d3f7da-04ee-4255-8496-d55852f55c45\") " pod="openshift-ingress/kube-auth-proxy-698448cf7f-7954g" Jul 06 22:52:57.849289 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:57.849260 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93d3f7da-04ee-4255-8496-d55852f55c45-tmp\") pod \"kube-auth-proxy-698448cf7f-7954g\" (UID: \"93d3f7da-04ee-4255-8496-d55852f55c45\") " pod="openshift-ingress/kube-auth-proxy-698448cf7f-7954g" Jul 06 22:52:57.849487 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:57.849471 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93d3f7da-04ee-4255-8496-d55852f55c45-tls-certs\") pod \"kube-auth-proxy-698448cf7f-7954g\" (UID: \"93d3f7da-04ee-4255-8496-d55852f55c45\") " pod="openshift-ingress/kube-auth-proxy-698448cf7f-7954g" Jul 06 22:52:57.886609 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:57.886574 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk8c6\" (UniqueName: \"kubernetes.io/projected/93d3f7da-04ee-4255-8496-d55852f55c45-kube-api-access-dk8c6\") pod \"kube-auth-proxy-698448cf7f-7954g\" (UID: \"93d3f7da-04ee-4255-8496-d55852f55c45\") " pod="openshift-ingress/kube-auth-proxy-698448cf7f-7954g" Jul 06 22:52:58.003557 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:58.003486 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-698448cf7f-7954g" Jul 06 22:52:58.132283 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:58.132243 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:58.157581 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:58.157548 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-698448cf7f-7954g"] Jul 06 22:52:58.160736 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:52:58.160707 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93d3f7da_04ee_4255_8496_d55852f55c45.slice/crio-82a8d423532b358bc603bd0cf50ee1420be0b9a671a498cda3aecdaac9b61728 WatchSource:0}: Error finding container 82a8d423532b358bc603bd0cf50ee1420be0b9a671a498cda3aecdaac9b61728: Status 404 returned error can't find the container with id 82a8d423532b358bc603bd0cf50ee1420be0b9a671a498cda3aecdaac9b61728 Jul 06 22:52:58.363239 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:58.363202 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:58.505619 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:58.505578 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:58.863799 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:58.863766 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-698448cf7f-7954g" event={"ID":"93d3f7da-04ee-4255-8496-d55852f55c45","Type":"ContainerStarted","Data":"82a8d423532b358bc603bd0cf50ee1420be0b9a671a498cda3aecdaac9b61728"} Jul 06 22:52:59.447370 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:59.447334 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:59.621017 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:59.620979 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:59.827746 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:59.827654 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:59.922782 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:52:59.922738 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:00.873396 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:00.873360 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-698448cf7f-7954g" event={"ID":"93d3f7da-04ee-4255-8496-d55852f55c45","Type":"ContainerStarted","Data":"93493836cfc8dfe5f2e1d4d65d0383fc6a8b2d0c49e770a0713ad52163c80302"} Jul 06 22:53:00.889642 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:00.889594 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-698448cf7f-7954g" podStartSLOduration=1.924328606 podStartE2EDuration="3.88957888s" totalImagesPullingTime="1.965250274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:53:00.888984243 +0000 UTC m=+410.354286542" watchObservedRunningTime="2026-07-06 22:53:00.88957888 +0000 UTC m=+410.354881161" Jul 06 22:53:00.931920 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:00.931887 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:04.411988 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:04.411945 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:04.543520 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:04.543484 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:05.445423 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.445387 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq"] Jul 06 22:53:05.448564 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.448545 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.451792 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.451774 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-xvs2h\"" Jul 06 22:53:05.451887 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.451842 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 22:53:05.466736 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.466463 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq"] Jul 06 22:53:05.503456 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.503425 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:05.509389 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.509362 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6bfr\" (UniqueName: \"kubernetes.io/projected/027735e3-200c-4e72-927c-89d4e8962d31-kube-api-access-n6bfr\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782vsrq\" (UID: \"027735e3-200c-4e72-927c-89d4e8962d31\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.509503 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.509394 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/027735e3-200c-4e72-927c-89d4e8962d31-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782vsrq\" (UID: \"027735e3-200c-4e72-927c-89d4e8962d31\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.509503 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.509416 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/027735e3-200c-4e72-927c-89d4e8962d31-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782vsrq\" (UID: \"027735e3-200c-4e72-927c-89d4e8962d31\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.509612 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.509504 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/027735e3-200c-4e72-927c-89d4e8962d31-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782vsrq\" (UID: \"027735e3-200c-4e72-927c-89d4e8962d31\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.509612 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.509522 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/027735e3-200c-4e72-927c-89d4e8962d31-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782vsrq\" (UID: \"027735e3-200c-4e72-927c-89d4e8962d31\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.509612 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.509540 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/027735e3-200c-4e72-927c-89d4e8962d31-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782vsrq\" (UID: \"027735e3-200c-4e72-927c-89d4e8962d31\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.509612 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.509586 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/027735e3-200c-4e72-927c-89d4e8962d31-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782vsrq\" (UID: \"027735e3-200c-4e72-927c-89d4e8962d31\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.509897 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.509616 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/027735e3-200c-4e72-927c-89d4e8962d31-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782vsrq\" (UID: \"027735e3-200c-4e72-927c-89d4e8962d31\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.509897 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.509632 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/027735e3-200c-4e72-927c-89d4e8962d31-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782vsrq\" (UID: \"027735e3-200c-4e72-927c-89d4e8962d31\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.610369 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.610332 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/027735e3-200c-4e72-927c-89d4e8962d31-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782vsrq\" (UID: \"027735e3-200c-4e72-927c-89d4e8962d31\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.610369 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.610368 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/027735e3-200c-4e72-927c-89d4e8962d31-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782vsrq\" (UID: \"027735e3-200c-4e72-927c-89d4e8962d31\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.610595 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.610399 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/027735e3-200c-4e72-927c-89d4e8962d31-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782vsrq\" (UID: \"027735e3-200c-4e72-927c-89d4e8962d31\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.610595 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.610433 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/027735e3-200c-4e72-927c-89d4e8962d31-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782vsrq\" (UID: \"027735e3-200c-4e72-927c-89d4e8962d31\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.610595 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.610470 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/027735e3-200c-4e72-927c-89d4e8962d31-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782vsrq\" (UID: \"027735e3-200c-4e72-927c-89d4e8962d31\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.610595 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.610575 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/027735e3-200c-4e72-927c-89d4e8962d31-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782vsrq\" (UID: \"027735e3-200c-4e72-927c-89d4e8962d31\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.610798 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.610667 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6bfr\" (UniqueName: \"kubernetes.io/projected/027735e3-200c-4e72-927c-89d4e8962d31-kube-api-access-n6bfr\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782vsrq\" (UID: \"027735e3-200c-4e72-927c-89d4e8962d31\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.610798 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.610698 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/027735e3-200c-4e72-927c-89d4e8962d31-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782vsrq\" (UID: \"027735e3-200c-4e72-927c-89d4e8962d31\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.610798 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.610725 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/027735e3-200c-4e72-927c-89d4e8962d31-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782vsrq\" (UID: \"027735e3-200c-4e72-927c-89d4e8962d31\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.610991 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.610970 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/027735e3-200c-4e72-927c-89d4e8962d31-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782vsrq\" (UID: \"027735e3-200c-4e72-927c-89d4e8962d31\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.611101 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.611077 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/027735e3-200c-4e72-927c-89d4e8962d31-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782vsrq\" (UID: \"027735e3-200c-4e72-927c-89d4e8962d31\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.611258 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.611231 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/027735e3-200c-4e72-927c-89d4e8962d31-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782vsrq\" (UID: \"027735e3-200c-4e72-927c-89d4e8962d31\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.611352 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.611231 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/027735e3-200c-4e72-927c-89d4e8962d31-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782vsrq\" (UID: \"027735e3-200c-4e72-927c-89d4e8962d31\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.611352 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.611276 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/027735e3-200c-4e72-927c-89d4e8962d31-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782vsrq\" (UID: \"027735e3-200c-4e72-927c-89d4e8962d31\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.612770 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.612752 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/027735e3-200c-4e72-927c-89d4e8962d31-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782vsrq\" (UID: \"027735e3-200c-4e72-927c-89d4e8962d31\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.613321 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.613306 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/027735e3-200c-4e72-927c-89d4e8962d31-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782vsrq\" (UID: \"027735e3-200c-4e72-927c-89d4e8962d31\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.632973 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.632948 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/027735e3-200c-4e72-927c-89d4e8962d31-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782vsrq\" (UID: \"027735e3-200c-4e72-927c-89d4e8962d31\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.633098 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.633082 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6bfr\" (UniqueName: \"kubernetes.io/projected/027735e3-200c-4e72-927c-89d4e8962d31-kube-api-access-n6bfr\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6782vsrq\" (UID: \"027735e3-200c-4e72-927c-89d4e8962d31\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.759349 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.759265 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:05.777060 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.777032 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:05.928827 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:05.928766 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq"] Jul 06 22:53:05.932657 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:53:05.932632 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod027735e3_200c_4e72_927c_89d4e8962d31.slice/crio-d5e39cbbca105b3bc63cb974b16926a59575a3366dcdacbc8ac0e877d6709e55 WatchSource:0}: Error finding container d5e39cbbca105b3bc63cb974b16926a59575a3366dcdacbc8ac0e877d6709e55: Status 404 returned error can't find the container with id d5e39cbbca105b3bc63cb974b16926a59575a3366dcdacbc8ac0e877d6709e55 Jul 06 22:53:06.057304 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:06.057213 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:06.069357 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:06.069334 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-55f7b57db4-ql7qf"] Jul 06 22:53:06.073525 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:06.073510 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-ql7qf" Jul 06 22:53:06.077837 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:06.077800 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 22:53:06.077837 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:06.077825 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:53:06.078017 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:06.077910 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 22:53:06.078017 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:06.077913 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ctqwn\"" Jul 06 22:53:06.078107 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:06.078093 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 22:53:06.078602 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:06.078584 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 22:53:06.088242 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:06.088223 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55f7b57db4-ql7qf"] Jul 06 22:53:06.114959 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:06.114940 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8561d135-3eb5-4900-999f-501ad99c2532-metrics-cert\") pod \"lws-controller-manager-55f7b57db4-ql7qf\" (UID: \"8561d135-3eb5-4900-999f-501ad99c2532\") " pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-ql7qf" Jul 06 22:53:06.115047 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:06.114999 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtx4w\" (UniqueName: \"kubernetes.io/projected/8561d135-3eb5-4900-999f-501ad99c2532-kube-api-access-dtx4w\") pod \"lws-controller-manager-55f7b57db4-ql7qf\" (UID: \"8561d135-3eb5-4900-999f-501ad99c2532\") " pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-ql7qf" Jul 06 22:53:06.115105 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:06.115073 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8561d135-3eb5-4900-999f-501ad99c2532-cert\") pod \"lws-controller-manager-55f7b57db4-ql7qf\" (UID: \"8561d135-3eb5-4900-999f-501ad99c2532\") " pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-ql7qf" Jul 06 22:53:06.115167 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:06.115104 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8561d135-3eb5-4900-999f-501ad99c2532-manager-config\") pod \"lws-controller-manager-55f7b57db4-ql7qf\" (UID: \"8561d135-3eb5-4900-999f-501ad99c2532\") " pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-ql7qf" Jul 06 22:53:06.219549 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:06.219512 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8561d135-3eb5-4900-999f-501ad99c2532-metrics-cert\") pod \"lws-controller-manager-55f7b57db4-ql7qf\" (UID: \"8561d135-3eb5-4900-999f-501ad99c2532\") " pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-ql7qf" Jul 06 22:53:06.219726 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:06.219592 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtx4w\" (UniqueName: \"kubernetes.io/projected/8561d135-3eb5-4900-999f-501ad99c2532-kube-api-access-dtx4w\") pod \"lws-controller-manager-55f7b57db4-ql7qf\" (UID: \"8561d135-3eb5-4900-999f-501ad99c2532\") " pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-ql7qf" Jul 06 22:53:06.219726 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:06.219650 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8561d135-3eb5-4900-999f-501ad99c2532-cert\") pod \"lws-controller-manager-55f7b57db4-ql7qf\" (UID: \"8561d135-3eb5-4900-999f-501ad99c2532\") " pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-ql7qf" Jul 06 22:53:06.219726 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:06.219682 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8561d135-3eb5-4900-999f-501ad99c2532-manager-config\") pod \"lws-controller-manager-55f7b57db4-ql7qf\" (UID: \"8561d135-3eb5-4900-999f-501ad99c2532\") " pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-ql7qf" Jul 06 22:53:06.220487 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:06.220459 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8561d135-3eb5-4900-999f-501ad99c2532-manager-config\") pod \"lws-controller-manager-55f7b57db4-ql7qf\" (UID: \"8561d135-3eb5-4900-999f-501ad99c2532\") " pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-ql7qf" Jul 06 22:53:06.222077 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:06.222052 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8561d135-3eb5-4900-999f-501ad99c2532-cert\") pod \"lws-controller-manager-55f7b57db4-ql7qf\" (UID: \"8561d135-3eb5-4900-999f-501ad99c2532\") " pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-ql7qf" Jul 06 22:53:06.222192 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:06.222117 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8561d135-3eb5-4900-999f-501ad99c2532-metrics-cert\") pod \"lws-controller-manager-55f7b57db4-ql7qf\" (UID: \"8561d135-3eb5-4900-999f-501ad99c2532\") " pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-ql7qf" Jul 06 22:53:06.229631 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:06.229612 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtx4w\" (UniqueName: \"kubernetes.io/projected/8561d135-3eb5-4900-999f-501ad99c2532-kube-api-access-dtx4w\") pod \"lws-controller-manager-55f7b57db4-ql7qf\" (UID: \"8561d135-3eb5-4900-999f-501ad99c2532\") " pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-ql7qf" Jul 06 22:53:06.383650 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:06.383619 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-ql7qf" Jul 06 22:53:06.523114 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:06.523088 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55f7b57db4-ql7qf"] Jul 06 22:53:06.525704 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:53:06.525678 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8561d135_3eb5_4900_999f_501ad99c2532.slice/crio-4e592daf4503f00558bbd2ed0edfddf56cef95c8a3e1225cb2c93a3d20bee3fd WatchSource:0}: Error finding container 4e592daf4503f00558bbd2ed0edfddf56cef95c8a3e1225cb2c93a3d20bee3fd: Status 404 returned error can't find the container with id 4e592daf4503f00558bbd2ed0edfddf56cef95c8a3e1225cb2c93a3d20bee3fd Jul 06 22:53:06.906626 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:06.906585 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" event={"ID":"027735e3-200c-4e72-927c-89d4e8962d31","Type":"ContainerStarted","Data":"d5e39cbbca105b3bc63cb974b16926a59575a3366dcdacbc8ac0e877d6709e55"} Jul 06 22:53:06.908761 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:06.908731 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-ql7qf" event={"ID":"8561d135-3eb5-4900-999f-501ad99c2532","Type":"ContainerStarted","Data":"4e592daf4503f00558bbd2ed0edfddf56cef95c8a3e1225cb2c93a3d20bee3fd"} Jul 06 22:53:09.698340 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:09.698301 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:53:09.698638 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:09.698380 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:53:09.698638 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:09.698412 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:53:09.923690 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:09.923636 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" event={"ID":"027735e3-200c-4e72-927c-89d4e8962d31","Type":"ContainerStarted","Data":"3195f922cf6eafebe8fe059256cd68f59d313cc80c1ac82f82b651bbdacbe9e0"} Jul 06 22:53:09.925383 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:09.925350 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-ql7qf" event={"ID":"8561d135-3eb5-4900-999f-501ad99c2532","Type":"ContainerStarted","Data":"943fed3a7eff3e11a46ba795d67dcef70fdec77503ecbb065c7873c2efa9cba9"} Jul 06 22:53:09.925536 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:09.925457 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-ql7qf" Jul 06 22:53:09.962183 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:09.962093 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" podStartSLOduration=1.198517659 podStartE2EDuration="4.962074313s" totalImagesPullingTime="3.763556654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:53:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:53:09.961902275 +0000 UTC m=+419.427204557" watchObservedRunningTime="2026-07-06 22:53:09.962074313 +0000 UTC m=+419.427376593" Jul 06 22:53:10.760366 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:10.760331 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:10.765731 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:10.765701 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:10.796766 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:10.796719 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:10.847664 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:10.847596 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-ql7qf" podStartSLOduration=1.6794830379999999 podStartE2EDuration="4.847573537s" totalImagesPullingTime="3.168090499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:53:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:53:09.999991581 +0000 UTC m=+419.465293875" watchObservedRunningTime="2026-07-06 22:53:10.847573537 +0000 UTC m=+420.312875819" Jul 06 22:53:10.931031 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:10.930996 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:10.932042 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:10.932020 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6782vsrq" Jul 06 22:53:11.032487 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:11.032409 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:11.208409 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:11.208370 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:11.351705 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:11.351668 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:14.206500 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:14.206463 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:20.932964 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:20.932936 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-55f7b57db4-ql7qf" Jul 06 22:53:23.691845 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:23.691792 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:23.792421 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:23.792384 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:45.318123 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:45.318027 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:58.585968 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:58.585931 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:58.676067 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:58.676033 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:58.774249 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:53:58.774213 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:22.608216 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:22.608180 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:22.664658 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:22.664625 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:22.760361 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:22.760331 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:22.861072 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:22.860997 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:23.346287 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:23.346260 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:23.400374 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:23.400345 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:24.773393 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:24.773356 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:26.933706 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:26.933667 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:27.567268 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:27.567234 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:28.630195 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:28.630163 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:28.741772 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:28.741733 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:32.230737 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:32.230700 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:33.117037 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:33.117003 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:33.216071 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:33.216041 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:33.327527 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:33.327488 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:34.747115 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:34.747078 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:35.023863 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:35.023753 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:37.188265 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:37.188231 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:37.352891 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:37.352858 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:39.831634 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:39.831596 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:42.858159 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:42.858118 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:42.997631 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:42.997584 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:43.385714 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:43.385675 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:43.534891 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:43.534857 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:48.237068 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:48.237031 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:48.331322 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:48.331278 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:48.776230 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:48.776190 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:48.869765 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:48.869725 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:51.905741 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:51.905703 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:52.084665 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:52.084630 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:52.296409 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:52.296323 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:52.398631 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:52.398594 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:55.723056 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:55.723011 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:55.822880 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:55.822843 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:58.426316 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:58.426276 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:58.899665 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:58.899635 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxcwz"] Jul 06 22:54:58.902085 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:58.902069 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxcwz" Jul 06 22:54:58.905558 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:58.905535 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 22:54:58.905655 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:58.905538 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nsvrd\"" Jul 06 22:54:58.906173 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:58.906157 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 22:54:58.920528 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:58.920508 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxcwz"] Jul 06 22:54:58.975111 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:58.975062 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv8sg\" (UniqueName: \"kubernetes.io/projected/faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb-kube-api-access-wv8sg\") pod \"kuadrant-operator-controller-manager-55467d9f7-lxcwz\" (UID: \"faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxcwz" Jul 06 22:54:58.975288 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:58.975188 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-lxcwz\" (UID: \"faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxcwz" Jul 06 22:54:59.076227 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:59.076187 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-lxcwz\" (UID: \"faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxcwz" Jul 06 22:54:59.076440 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:59.076250 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv8sg\" (UniqueName: \"kubernetes.io/projected/faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb-kube-api-access-wv8sg\") pod \"kuadrant-operator-controller-manager-55467d9f7-lxcwz\" (UID: \"faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxcwz" Jul 06 22:54:59.076589 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:59.076568 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-lxcwz\" (UID: \"faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxcwz" Jul 06 22:54:59.088408 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:59.088371 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv8sg\" (UniqueName: \"kubernetes.io/projected/faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb-kube-api-access-wv8sg\") pod \"kuadrant-operator-controller-manager-55467d9f7-lxcwz\" (UID: \"faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxcwz" Jul 06 22:54:59.146504 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:59.146462 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxcwz"] Jul 06 22:54:59.146911 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:59.146887 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxcwz" Jul 06 22:54:59.149496 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:59.149090 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxcwz"] Jul 06 22:54:59.173850 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:59.173791 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-trnn8"] Jul 06 22:54:59.180393 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:59.180368 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-trnn8" Jul 06 22:54:59.199383 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:59.199349 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-trnn8"] Jul 06 22:54:59.254016 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:59.253979 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:59.278165 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:59.278130 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d35b58bc-f82a-4db0-8ab7-477ff37b4d41-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-trnn8\" (UID: \"d35b58bc-f82a-4db0-8ab7-477ff37b4d41\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-trnn8" Jul 06 22:54:59.278165 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:59.278166 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjhjz\" (UniqueName: \"kubernetes.io/projected/d35b58bc-f82a-4db0-8ab7-477ff37b4d41-kube-api-access-gjhjz\") pod \"kuadrant-operator-controller-manager-55467d9f7-trnn8\" (UID: \"d35b58bc-f82a-4db0-8ab7-477ff37b4d41\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-trnn8" Jul 06 22:54:59.379585 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:59.379555 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d35b58bc-f82a-4db0-8ab7-477ff37b4d41-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-trnn8\" (UID: \"d35b58bc-f82a-4db0-8ab7-477ff37b4d41\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-trnn8" Jul 06 22:54:59.379838 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:59.379589 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjhjz\" (UniqueName: \"kubernetes.io/projected/d35b58bc-f82a-4db0-8ab7-477ff37b4d41-kube-api-access-gjhjz\") pod \"kuadrant-operator-controller-manager-55467d9f7-trnn8\" (UID: \"d35b58bc-f82a-4db0-8ab7-477ff37b4d41\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-trnn8" Jul 06 22:54:59.379944 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:59.379926 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d35b58bc-f82a-4db0-8ab7-477ff37b4d41-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-trnn8\" (UID: \"d35b58bc-f82a-4db0-8ab7-477ff37b4d41\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-trnn8" Jul 06 22:54:59.393700 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:59.393673 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjhjz\" (UniqueName: \"kubernetes.io/projected/d35b58bc-f82a-4db0-8ab7-477ff37b4d41-kube-api-access-gjhjz\") pod \"kuadrant-operator-controller-manager-55467d9f7-trnn8\" (UID: \"d35b58bc-f82a-4db0-8ab7-477ff37b4d41\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-trnn8" Jul 06 22:54:59.491926 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:59.491803 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-trnn8" Jul 06 22:54:59.633878 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:54:59.633834 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-trnn8"] Jul 06 22:54:59.636418 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:54:59.636391 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd35b58bc_f82a_4db0_8ab7_477ff37b4d41.slice/crio-6be29e41f0bb4f524593f7365583ff6fb5b035ce8bfa79b642007a0b1f2b051e WatchSource:0}: Error finding container 6be29e41f0bb4f524593f7365583ff6fb5b035ce8bfa79b642007a0b1f2b051e: Status 404 returned error can't find the container with id 6be29e41f0bb4f524593f7365583ff6fb5b035ce8bfa79b642007a0b1f2b051e Jul 06 22:55:00.391966 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:00.391928 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-trnn8" event={"ID":"d35b58bc-f82a-4db0-8ab7-477ff37b4d41","Type":"ContainerStarted","Data":"6be29e41f0bb4f524593f7365583ff6fb5b035ce8bfa79b642007a0b1f2b051e"} Jul 06 22:55:01.702128 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:55:01.702086 2566 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-lxcwz_kuadrant-system_faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb_0(8e363a773ffb3d78f810ad18e8ec19b2971adfde2ba51daf2abdad3579e3b9ed): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-lxcwz to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Jul 06 22:55:01.702398 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:55:01.702152 2566 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-lxcwz_kuadrant-system_faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb_0(8e363a773ffb3d78f810ad18e8ec19b2971adfde2ba51daf2abdad3579e3b9ed): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-lxcwz to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxcwz" Jul 06 22:55:02.402650 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:02.402563 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxcwz" Jul 06 22:55:02.410455 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:02.410431 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxcwz" Jul 06 22:55:02.413053 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:55:02.413016 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-lxcwz\" is forbidden: User \"system:node:ip-10-0-131-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-21.ec2.internal' and this object" podUID="faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxcwz" Jul 06 22:55:02.506491 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:02.506458 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wv8sg\" (UniqueName: \"kubernetes.io/projected/faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb-kube-api-access-wv8sg\") pod \"faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb\" (UID: \"faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb\") " Jul 06 22:55:02.506649 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:02.506529 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb-extensions-socket-volume\") pod \"faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb\" (UID: \"faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb\") " Jul 06 22:55:02.506840 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:02.506799 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb" (UID: "faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:55:02.508527 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:02.508507 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb-kube-api-access-wv8sg" (OuterVolumeSpecName: "kube-api-access-wv8sg") pod "faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb" (UID: "faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb"). InnerVolumeSpecName "kube-api-access-wv8sg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:55:02.607959 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:02.607927 2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb-extensions-socket-volume\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:55:02.607959 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:02.607956 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wv8sg\" (UniqueName: \"kubernetes.io/projected/faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb-kube-api-access-wv8sg\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:55:03.105133 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:03.105100 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb" path="/var/lib/kubelet/pods/faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb/volumes" Jul 06 22:55:03.407587 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:03.407500 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxcwz" Jul 06 22:55:03.412610 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:55:03.412576 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-lxcwz\" is forbidden: User \"system:node:ip-10-0-131-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-21.ec2.internal' and this object" podUID="faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxcwz" Jul 06 22:55:04.412986 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:04.412948 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-trnn8" event={"ID":"d35b58bc-f82a-4db0-8ab7-477ff37b4d41","Type":"ContainerStarted","Data":"65a256b6ebfae5e86529e37e498e782058acf8f4e755ee543faeb6bd8240b59f"} Jul 06 22:55:04.413437 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:04.413028 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-trnn8" Jul 06 22:55:04.437951 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:04.437905 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-trnn8" podStartSLOduration=0.820133159 podStartE2EDuration="5.43788717s" totalImagesPullingTime="4.617754011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:54:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:55:04.435782574 +0000 UTC m=+533.901084856" watchObservedRunningTime="2026-07-06 22:55:04.43788717 +0000 UTC m=+533.903189451" Jul 06 22:55:04.439021 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:55:04.438996 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-lxcwz\" is forbidden: User \"system:node:ip-10-0-131-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-21.ec2.internal' and this object" podUID="faa47d9b-b1fa-4cfc-9e8a-cb37a6a57eeb" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lxcwz" Jul 06 22:55:15.419865 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:15.419835 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-trnn8" Jul 06 22:55:15.728842 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:15.728738 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zrqpt"] Jul 06 22:55:15.732641 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:15.732618 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zrqpt" Jul 06 22:55:15.750079 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:15.750051 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zrqpt"] Jul 06 22:55:15.825257 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:15.825220 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8878178-567f-4052-a4b5-bd6afe7f02a1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zrqpt\" (UID: \"a8878178-567f-4052-a4b5-bd6afe7f02a1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zrqpt" Jul 06 22:55:15.825257 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:15.825253 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjmfq\" (UniqueName: \"kubernetes.io/projected/a8878178-567f-4052-a4b5-bd6afe7f02a1-kube-api-access-pjmfq\") pod \"kuadrant-operator-controller-manager-86878c769f-zrqpt\" (UID: \"a8878178-567f-4052-a4b5-bd6afe7f02a1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zrqpt" Jul 06 22:55:15.925698 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:15.925666 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8878178-567f-4052-a4b5-bd6afe7f02a1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zrqpt\" (UID: \"a8878178-567f-4052-a4b5-bd6afe7f02a1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zrqpt" Jul 06 22:55:15.925698 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:15.925699 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjmfq\" (UniqueName: \"kubernetes.io/projected/a8878178-567f-4052-a4b5-bd6afe7f02a1-kube-api-access-pjmfq\") pod \"kuadrant-operator-controller-manager-86878c769f-zrqpt\" (UID: \"a8878178-567f-4052-a4b5-bd6afe7f02a1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zrqpt" Jul 06 22:55:15.926065 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:15.926046 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8878178-567f-4052-a4b5-bd6afe7f02a1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zrqpt\" (UID: \"a8878178-567f-4052-a4b5-bd6afe7f02a1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zrqpt" Jul 06 22:55:15.934195 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:15.934170 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjmfq\" (UniqueName: \"kubernetes.io/projected/a8878178-567f-4052-a4b5-bd6afe7f02a1-kube-api-access-pjmfq\") pod \"kuadrant-operator-controller-manager-86878c769f-zrqpt\" (UID: \"a8878178-567f-4052-a4b5-bd6afe7f02a1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zrqpt" Jul 06 22:55:16.043246 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:16.043173 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zrqpt" Jul 06 22:55:16.175241 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:16.175204 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zrqpt"] Jul 06 22:55:16.177480 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:55:16.177454 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8878178_567f_4052_a4b5_bd6afe7f02a1.slice/crio-ae57d8ebbd632e2b114ebbee8331dd32a2bebb5f81086bcdeab42b5a830a2a5e WatchSource:0}: Error finding container ae57d8ebbd632e2b114ebbee8331dd32a2bebb5f81086bcdeab42b5a830a2a5e: Status 404 returned error can't find the container with id ae57d8ebbd632e2b114ebbee8331dd32a2bebb5f81086bcdeab42b5a830a2a5e Jul 06 22:55:16.464726 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:16.464689 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zrqpt" event={"ID":"a8878178-567f-4052-a4b5-bd6afe7f02a1","Type":"ContainerStarted","Data":"8eb7e75da75b267f215c58914454376c4826f271747085729b1da3ce788ad548"} Jul 06 22:55:16.465137 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:16.464750 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zrqpt" event={"ID":"a8878178-567f-4052-a4b5-bd6afe7f02a1","Type":"ContainerStarted","Data":"ae57d8ebbd632e2b114ebbee8331dd32a2bebb5f81086bcdeab42b5a830a2a5e"} Jul 06 22:55:16.465137 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:16.464789 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zrqpt" Jul 06 22:55:16.485856 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:16.485801 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zrqpt" podStartSLOduration=1.48578902 podStartE2EDuration="1.48578902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:55:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:55:16.484526962 +0000 UTC m=+545.949829257" watchObservedRunningTime="2026-07-06 22:55:16.48578902 +0000 UTC m=+545.951091301" Jul 06 22:55:19.423584 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:19.423515 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:20.268154 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:20.268119 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:27.471839 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:27.471795 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zrqpt" Jul 06 22:55:27.527141 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:27.527108 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-trnn8"] Jul 06 22:55:27.527364 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:27.527341 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-trnn8" podUID="d35b58bc-f82a-4db0-8ab7-477ff37b4d41" containerName="manager" containerID="cri-o://65a256b6ebfae5e86529e37e498e782058acf8f4e755ee543faeb6bd8240b59f" gracePeriod=10 Jul 06 22:55:27.773208 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:27.773182 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-trnn8" Jul 06 22:55:27.821452 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:27.821422 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d35b58bc-f82a-4db0-8ab7-477ff37b4d41-extensions-socket-volume\") pod \"d35b58bc-f82a-4db0-8ab7-477ff37b4d41\" (UID: \"d35b58bc-f82a-4db0-8ab7-477ff37b4d41\") " Jul 06 22:55:27.821452 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:27.821452 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjhjz\" (UniqueName: \"kubernetes.io/projected/d35b58bc-f82a-4db0-8ab7-477ff37b4d41-kube-api-access-gjhjz\") pod \"d35b58bc-f82a-4db0-8ab7-477ff37b4d41\" (UID: \"d35b58bc-f82a-4db0-8ab7-477ff37b4d41\") " Jul 06 22:55:27.821881 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:27.821854 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d35b58bc-f82a-4db0-8ab7-477ff37b4d41-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d35b58bc-f82a-4db0-8ab7-477ff37b4d41" (UID: "d35b58bc-f82a-4db0-8ab7-477ff37b4d41"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:55:27.823581 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:27.823558 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d35b58bc-f82a-4db0-8ab7-477ff37b4d41-kube-api-access-gjhjz" (OuterVolumeSpecName: "kube-api-access-gjhjz") pod "d35b58bc-f82a-4db0-8ab7-477ff37b4d41" (UID: "d35b58bc-f82a-4db0-8ab7-477ff37b4d41"). InnerVolumeSpecName "kube-api-access-gjhjz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:55:27.922368 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:27.922345 2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d35b58bc-f82a-4db0-8ab7-477ff37b4d41-extensions-socket-volume\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:55:27.922368 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:27.922365 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjhjz\" (UniqueName: \"kubernetes.io/projected/d35b58bc-f82a-4db0-8ab7-477ff37b4d41-kube-api-access-gjhjz\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:55:28.523269 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:28.523238 2566 generic.go:356] "Generic (PLEG): container finished" podID="d35b58bc-f82a-4db0-8ab7-477ff37b4d41" containerID="65a256b6ebfae5e86529e37e498e782058acf8f4e755ee543faeb6bd8240b59f" exitCode=0 Jul 06 22:55:28.523726 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:28.523281 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-trnn8" Jul 06 22:55:28.523726 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:28.523326 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-trnn8" event={"ID":"d35b58bc-f82a-4db0-8ab7-477ff37b4d41","Type":"ContainerDied","Data":"65a256b6ebfae5e86529e37e498e782058acf8f4e755ee543faeb6bd8240b59f"} Jul 06 22:55:28.523726 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:28.523387 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-trnn8" event={"ID":"d35b58bc-f82a-4db0-8ab7-477ff37b4d41","Type":"ContainerDied","Data":"6be29e41f0bb4f524593f7365583ff6fb5b035ce8bfa79b642007a0b1f2b051e"} Jul 06 22:55:28.523726 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:28.523423 2566 scope.go:117] "RemoveContainer" containerID="65a256b6ebfae5e86529e37e498e782058acf8f4e755ee543faeb6bd8240b59f" Jul 06 22:55:28.532106 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:28.531925 2566 scope.go:117] "RemoveContainer" containerID="65a256b6ebfae5e86529e37e498e782058acf8f4e755ee543faeb6bd8240b59f" Jul 06 22:55:28.532197 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:55:28.532179 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65a256b6ebfae5e86529e37e498e782058acf8f4e755ee543faeb6bd8240b59f\": container with ID starting with 65a256b6ebfae5e86529e37e498e782058acf8f4e755ee543faeb6bd8240b59f not found: ID does not exist" containerID="65a256b6ebfae5e86529e37e498e782058acf8f4e755ee543faeb6bd8240b59f" Jul 06 22:55:28.532239 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:28.532205 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65a256b6ebfae5e86529e37e498e782058acf8f4e755ee543faeb6bd8240b59f"} err="failed to get container status \"65a256b6ebfae5e86529e37e498e782058acf8f4e755ee543faeb6bd8240b59f\": rpc error: code = NotFound desc = could not find container \"65a256b6ebfae5e86529e37e498e782058acf8f4e755ee543faeb6bd8240b59f\": container with ID starting with 65a256b6ebfae5e86529e37e498e782058acf8f4e755ee543faeb6bd8240b59f not found: ID does not exist" Jul 06 22:55:28.554865 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:28.554828 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-trnn8"] Jul 06 22:55:28.560136 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:28.560117 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-trnn8"] Jul 06 22:55:29.104030 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:29.104001 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d35b58bc-f82a-4db0-8ab7-477ff37b4d41" path="/var/lib/kubelet/pods/d35b58bc-f82a-4db0-8ab7-477ff37b4d41/volumes" Jul 06 22:55:31.791374 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:31.791340 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:31.929329 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:31.929290 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:45.986590 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:45.986550 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:46.077920 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:46.077883 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:46.140044 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:46.140013 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:46.812678 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:46.812642 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:46.913054 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:46.913008 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:46.953114 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:46.953083 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-tgjlf"] Jul 06 22:55:46.953403 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:46.953392 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d35b58bc-f82a-4db0-8ab7-477ff37b4d41" containerName="manager" Jul 06 22:55:46.953445 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:46.953405 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d35b58bc-f82a-4db0-8ab7-477ff37b4d41" containerName="manager" Jul 06 22:55:46.953482 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:46.953469 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d35b58bc-f82a-4db0-8ab7-477ff37b4d41" containerName="manager" Jul 06 22:55:46.955545 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:46.955528 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tgjlf" Jul 06 22:55:46.958135 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:46.958117 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xwbh5\"" Jul 06 22:55:46.962744 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:46.962724 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tgjlf"] Jul 06 22:55:47.074424 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:47.074332 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvgjm\" (UniqueName: \"kubernetes.io/projected/767813f6-15ef-446a-b02d-9bd03099a6b3-kube-api-access-jvgjm\") pod \"authorino-75d556bd77-tgjlf\" (UID: \"767813f6-15ef-446a-b02d-9bd03099a6b3\") " pod="kuadrant-system/authorino-75d556bd77-tgjlf" Jul 06 22:55:47.175625 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:47.175587 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvgjm\" (UniqueName: \"kubernetes.io/projected/767813f6-15ef-446a-b02d-9bd03099a6b3-kube-api-access-jvgjm\") pod \"authorino-75d556bd77-tgjlf\" (UID: \"767813f6-15ef-446a-b02d-9bd03099a6b3\") " pod="kuadrant-system/authorino-75d556bd77-tgjlf" Jul 06 22:55:47.183757 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:47.183731 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvgjm\" (UniqueName: \"kubernetes.io/projected/767813f6-15ef-446a-b02d-9bd03099a6b3-kube-api-access-jvgjm\") pod \"authorino-75d556bd77-tgjlf\" (UID: \"767813f6-15ef-446a-b02d-9bd03099a6b3\") " pod="kuadrant-system/authorino-75d556bd77-tgjlf" Jul 06 22:55:47.265573 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:47.265535 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tgjlf" Jul 06 22:55:47.414183 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:47.414152 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tgjlf"] Jul 06 22:55:47.417660 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:55:47.417630 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod767813f6_15ef_446a_b02d_9bd03099a6b3.slice/crio-7336b557772183d859fc77a0f82e3cc5defb7497b77abd3229e41536fa57b759 WatchSource:0}: Error finding container 7336b557772183d859fc77a0f82e3cc5defb7497b77abd3229e41536fa57b759: Status 404 returned error can't find the container with id 7336b557772183d859fc77a0f82e3cc5defb7497b77abd3229e41536fa57b759 Jul 06 22:55:47.606719 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:47.606634 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tgjlf" event={"ID":"767813f6-15ef-446a-b02d-9bd03099a6b3","Type":"ContainerStarted","Data":"7336b557772183d859fc77a0f82e3cc5defb7497b77abd3229e41536fa57b759"} Jul 06 22:55:50.622745 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:50.622711 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tgjlf" event={"ID":"767813f6-15ef-446a-b02d-9bd03099a6b3","Type":"ContainerStarted","Data":"bea59f1b3842f8ee723e1e0d97d3f530a6ac50de64be512d35590b678d949c97"} Jul 06 22:55:50.638074 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:55:50.638026 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-tgjlf" podStartSLOduration=1.7744250049999999 podStartE2EDuration="4.638010201s" totalImagesPullingTime="2.863585196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:55:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:55:50.636604269 +0000 UTC m=+580.101906550" watchObservedRunningTime="2026-07-06 22:55:50.638010201 +0000 UTC m=+580.103312483" Jul 06 22:56:03.184015 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:03.183979 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:10.953395 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:10.953369 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rtzxs_1dc50270-5e71-4a7b-8160-9041cbc18cd9/console-operator/2.log" Jul 06 22:56:10.960399 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:10.960375 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rtzxs_1dc50270-5e71-4a7b-8160-9041cbc18cd9/console-operator/2.log" Jul 06 22:56:14.996600 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:14.996566 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:15.351329 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:15.351298 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:15.712896 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:15.712791 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7ccfdff89-pqkrd"] Jul 06 22:56:15.717440 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:15.717417 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ccfdff89-pqkrd" Jul 06 22:56:15.719908 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:15.719887 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 06 22:56:15.723404 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:15.723376 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7ccfdff89-pqkrd"] Jul 06 22:56:15.831330 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:15.831293 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2gvw\" (UniqueName: \"kubernetes.io/projected/d9925cc6-271d-4c12-96eb-759363fd1065-kube-api-access-r2gvw\") pod \"authorino-7ccfdff89-pqkrd\" (UID: \"d9925cc6-271d-4c12-96eb-759363fd1065\") " pod="kuadrant-system/authorino-7ccfdff89-pqkrd" Jul 06 22:56:15.831501 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:15.831398 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d9925cc6-271d-4c12-96eb-759363fd1065-tls-cert\") pod \"authorino-7ccfdff89-pqkrd\" (UID: \"d9925cc6-271d-4c12-96eb-759363fd1065\") " pod="kuadrant-system/authorino-7ccfdff89-pqkrd" Jul 06 22:56:15.932439 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:15.932402 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2gvw\" (UniqueName: \"kubernetes.io/projected/d9925cc6-271d-4c12-96eb-759363fd1065-kube-api-access-r2gvw\") pod \"authorino-7ccfdff89-pqkrd\" (UID: \"d9925cc6-271d-4c12-96eb-759363fd1065\") " pod="kuadrant-system/authorino-7ccfdff89-pqkrd" Jul 06 22:56:15.932625 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:15.932504 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d9925cc6-271d-4c12-96eb-759363fd1065-tls-cert\") pod \"authorino-7ccfdff89-pqkrd\" (UID: \"d9925cc6-271d-4c12-96eb-759363fd1065\") " pod="kuadrant-system/authorino-7ccfdff89-pqkrd" Jul 06 22:56:15.934904 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:15.934881 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d9925cc6-271d-4c12-96eb-759363fd1065-tls-cert\") pod \"authorino-7ccfdff89-pqkrd\" (UID: \"d9925cc6-271d-4c12-96eb-759363fd1065\") " pod="kuadrant-system/authorino-7ccfdff89-pqkrd" Jul 06 22:56:15.940244 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:15.940219 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2gvw\" (UniqueName: \"kubernetes.io/projected/d9925cc6-271d-4c12-96eb-759363fd1065-kube-api-access-r2gvw\") pod \"authorino-7ccfdff89-pqkrd\" (UID: \"d9925cc6-271d-4c12-96eb-759363fd1065\") " pod="kuadrant-system/authorino-7ccfdff89-pqkrd" Jul 06 22:56:16.027396 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:16.027317 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ccfdff89-pqkrd" Jul 06 22:56:16.158855 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:16.158800 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7ccfdff89-pqkrd"] Jul 06 22:56:16.161696 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:56:16.161667 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9925cc6_271d_4c12_96eb_759363fd1065.slice/crio-5c0cdc1d59be94c7045dd031ec918165d3fb8f455acea0164c8ba7854f0b99ba WatchSource:0}: Error finding container 5c0cdc1d59be94c7045dd031ec918165d3fb8f455acea0164c8ba7854f0b99ba: Status 404 returned error can't find the container with id 5c0cdc1d59be94c7045dd031ec918165d3fb8f455acea0164c8ba7854f0b99ba Jul 06 22:56:16.739634 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:16.739602 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ccfdff89-pqkrd" event={"ID":"d9925cc6-271d-4c12-96eb-759363fd1065","Type":"ContainerStarted","Data":"76acca0186a614f6fe3d04513f61fcafdda12c0830710f14f08b68c85d996b22"} Jul 06 22:56:16.739823 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:16.739647 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ccfdff89-pqkrd" event={"ID":"d9925cc6-271d-4c12-96eb-759363fd1065","Type":"ContainerStarted","Data":"5c0cdc1d59be94c7045dd031ec918165d3fb8f455acea0164c8ba7854f0b99ba"} Jul 06 22:56:16.754556 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:16.754508 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7ccfdff89-pqkrd" podStartSLOduration=1.359079967 podStartE2EDuration="1.754493333s" totalImagesPullingTime="395.413366ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:56:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:56:16.754032882 +0000 UTC m=+606.219335158" watchObservedRunningTime="2026-07-06 22:56:16.754493333 +0000 UTC m=+606.219795615" Jul 06 22:56:16.778999 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:16.778969 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tgjlf"] Jul 06 22:56:16.779184 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:16.779161 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-tgjlf" podUID="767813f6-15ef-446a-b02d-9bd03099a6b3" containerName="authorino" containerID="cri-o://bea59f1b3842f8ee723e1e0d97d3f530a6ac50de64be512d35590b678d949c97" gracePeriod=30 Jul 06 22:56:17.032971 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:17.032945 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tgjlf" Jul 06 22:56:17.142124 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:17.142089 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvgjm\" (UniqueName: \"kubernetes.io/projected/767813f6-15ef-446a-b02d-9bd03099a6b3-kube-api-access-jvgjm\") pod \"767813f6-15ef-446a-b02d-9bd03099a6b3\" (UID: \"767813f6-15ef-446a-b02d-9bd03099a6b3\") " Jul 06 22:56:17.144165 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:17.144139 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/767813f6-15ef-446a-b02d-9bd03099a6b3-kube-api-access-jvgjm" (OuterVolumeSpecName: "kube-api-access-jvgjm") pod "767813f6-15ef-446a-b02d-9bd03099a6b3" (UID: "767813f6-15ef-446a-b02d-9bd03099a6b3"). InnerVolumeSpecName "kube-api-access-jvgjm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:56:17.242749 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:17.242711 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvgjm\" (UniqueName: \"kubernetes.io/projected/767813f6-15ef-446a-b02d-9bd03099a6b3-kube-api-access-jvgjm\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:56:17.745285 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:17.745250 2566 generic.go:356] "Generic (PLEG): container finished" podID="767813f6-15ef-446a-b02d-9bd03099a6b3" containerID="bea59f1b3842f8ee723e1e0d97d3f530a6ac50de64be512d35590b678d949c97" exitCode=0 Jul 06 22:56:17.745457 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:17.745319 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tgjlf" Jul 06 22:56:17.745457 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:17.745338 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tgjlf" event={"ID":"767813f6-15ef-446a-b02d-9bd03099a6b3","Type":"ContainerDied","Data":"bea59f1b3842f8ee723e1e0d97d3f530a6ac50de64be512d35590b678d949c97"} Jul 06 22:56:17.745457 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:17.745382 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tgjlf" event={"ID":"767813f6-15ef-446a-b02d-9bd03099a6b3","Type":"ContainerDied","Data":"7336b557772183d859fc77a0f82e3cc5defb7497b77abd3229e41536fa57b759"} Jul 06 22:56:17.745457 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:17.745400 2566 scope.go:117] "RemoveContainer" containerID="bea59f1b3842f8ee723e1e0d97d3f530a6ac50de64be512d35590b678d949c97" Jul 06 22:56:17.754367 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:17.754352 2566 scope.go:117] "RemoveContainer" containerID="bea59f1b3842f8ee723e1e0d97d3f530a6ac50de64be512d35590b678d949c97" Jul 06 22:56:17.754581 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:56:17.754562 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bea59f1b3842f8ee723e1e0d97d3f530a6ac50de64be512d35590b678d949c97\": container with ID starting with bea59f1b3842f8ee723e1e0d97d3f530a6ac50de64be512d35590b678d949c97 not found: ID does not exist" containerID="bea59f1b3842f8ee723e1e0d97d3f530a6ac50de64be512d35590b678d949c97" Jul 06 22:56:17.754634 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:17.754589 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bea59f1b3842f8ee723e1e0d97d3f530a6ac50de64be512d35590b678d949c97"} err="failed to get container status \"bea59f1b3842f8ee723e1e0d97d3f530a6ac50de64be512d35590b678d949c97\": rpc error: code = NotFound desc = could not find container \"bea59f1b3842f8ee723e1e0d97d3f530a6ac50de64be512d35590b678d949c97\": container with ID starting with bea59f1b3842f8ee723e1e0d97d3f530a6ac50de64be512d35590b678d949c97 not found: ID does not exist" Jul 06 22:56:17.765942 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:17.765916 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tgjlf"] Jul 06 22:56:17.769104 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:17.769084 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tgjlf"] Jul 06 22:56:19.107066 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:19.107036 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="767813f6-15ef-446a-b02d-9bd03099a6b3" path="/var/lib/kubelet/pods/767813f6-15ef-446a-b02d-9bd03099a6b3/volumes" Jul 06 22:56:20.986235 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:20.986206 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:21.077441 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:21.077406 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:21.133261 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:21.133233 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:21.308145 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:21.308058 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:24.380288 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:24.380245 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:24.478197 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:24.478160 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:59.672925 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:56:59.672888 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:00.971725 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:00.971692 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:10.909704 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:10.909669 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:11.007133 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:11.007096 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:16.189556 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:16.189516 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:37.763432 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:37.763386 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:55.745680 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.745644 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9"] Jul 06 22:57:55.746070 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.745986 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="767813f6-15ef-446a-b02d-9bd03099a6b3" containerName="authorino" Jul 06 22:57:55.746070 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.745998 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="767813f6-15ef-446a-b02d-9bd03099a6b3" containerName="authorino" Jul 06 22:57:55.746070 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.746071 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="767813f6-15ef-446a-b02d-9bd03099a6b3" containerName="authorino" Jul 06 22:57:55.749077 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.749060 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9" Jul 06 22:57:55.751698 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.751674 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 22:57:55.752752 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.752730 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xcwzz\"" Jul 06 22:57:55.752881 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.752769 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 22:57:55.753030 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.753015 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 06 22:57:55.757238 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.757217 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9"] Jul 06 22:57:55.765992 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.765957 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:55.821382 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.821352 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fb39043-0151-4e6e-a6d9-f492f122a3f5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bv7g9\" (UID: \"7fb39043-0151-4e6e-a6d9-f492f122a3f5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9" Jul 06 22:57:55.821586 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.821385 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ctfj\" (UniqueName: \"kubernetes.io/projected/7fb39043-0151-4e6e-a6d9-f492f122a3f5-kube-api-access-7ctfj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bv7g9\" (UID: \"7fb39043-0151-4e6e-a6d9-f492f122a3f5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9" Jul 06 22:57:55.821586 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.821413 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fb39043-0151-4e6e-a6d9-f492f122a3f5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bv7g9\" (UID: \"7fb39043-0151-4e6e-a6d9-f492f122a3f5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9" Jul 06 22:57:55.821586 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.821431 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fb39043-0151-4e6e-a6d9-f492f122a3f5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bv7g9\" (UID: \"7fb39043-0151-4e6e-a6d9-f492f122a3f5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9" Jul 06 22:57:55.821586 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.821503 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fb39043-0151-4e6e-a6d9-f492f122a3f5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bv7g9\" (UID: \"7fb39043-0151-4e6e-a6d9-f492f122a3f5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9" Jul 06 22:57:55.821586 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.821544 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fb39043-0151-4e6e-a6d9-f492f122a3f5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bv7g9\" (UID: \"7fb39043-0151-4e6e-a6d9-f492f122a3f5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9" Jul 06 22:57:55.922654 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.922616 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fb39043-0151-4e6e-a6d9-f492f122a3f5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bv7g9\" (UID: \"7fb39043-0151-4e6e-a6d9-f492f122a3f5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9" Jul 06 22:57:55.922654 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.922655 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ctfj\" (UniqueName: \"kubernetes.io/projected/7fb39043-0151-4e6e-a6d9-f492f122a3f5-kube-api-access-7ctfj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bv7g9\" (UID: \"7fb39043-0151-4e6e-a6d9-f492f122a3f5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9" Jul 06 22:57:55.922965 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.922681 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fb39043-0151-4e6e-a6d9-f492f122a3f5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bv7g9\" (UID: \"7fb39043-0151-4e6e-a6d9-f492f122a3f5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9" Jul 06 22:57:55.922965 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.922698 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fb39043-0151-4e6e-a6d9-f492f122a3f5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bv7g9\" (UID: \"7fb39043-0151-4e6e-a6d9-f492f122a3f5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9" Jul 06 22:57:55.922965 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.922725 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fb39043-0151-4e6e-a6d9-f492f122a3f5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bv7g9\" (UID: \"7fb39043-0151-4e6e-a6d9-f492f122a3f5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9" Jul 06 22:57:55.922965 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.922742 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fb39043-0151-4e6e-a6d9-f492f122a3f5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bv7g9\" (UID: \"7fb39043-0151-4e6e-a6d9-f492f122a3f5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9" Jul 06 22:57:55.923160 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.923139 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fb39043-0151-4e6e-a6d9-f492f122a3f5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bv7g9\" (UID: \"7fb39043-0151-4e6e-a6d9-f492f122a3f5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9" Jul 06 22:57:55.923226 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.923192 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fb39043-0151-4e6e-a6d9-f492f122a3f5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bv7g9\" (UID: \"7fb39043-0151-4e6e-a6d9-f492f122a3f5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9" Jul 06 22:57:55.923277 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.923226 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fb39043-0151-4e6e-a6d9-f492f122a3f5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bv7g9\" (UID: \"7fb39043-0151-4e6e-a6d9-f492f122a3f5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9" Jul 06 22:57:55.925040 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.925022 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fb39043-0151-4e6e-a6d9-f492f122a3f5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bv7g9\" (UID: \"7fb39043-0151-4e6e-a6d9-f492f122a3f5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9" Jul 06 22:57:55.925291 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.925276 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fb39043-0151-4e6e-a6d9-f492f122a3f5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bv7g9\" (UID: \"7fb39043-0151-4e6e-a6d9-f492f122a3f5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9" Jul 06 22:57:55.930527 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:55.930497 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ctfj\" (UniqueName: \"kubernetes.io/projected/7fb39043-0151-4e6e-a6d9-f492f122a3f5-kube-api-access-7ctfj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bv7g9\" (UID: \"7fb39043-0151-4e6e-a6d9-f492f122a3f5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9" Jul 06 22:57:56.060093 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:56.060005 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9" Jul 06 22:57:56.196436 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:56.196387 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9"] Jul 06 22:57:56.198999 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:57:56.198971 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fb39043_0151_4e6e_a6d9_f492f122a3f5.slice/crio-c87c62022dcd9d1436069d68620246442c87682d2a5595ca8d1b996d46d843ad WatchSource:0}: Error finding container c87c62022dcd9d1436069d68620246442c87682d2a5595ca8d1b996d46d843ad: Status 404 returned error can't find the container with id c87c62022dcd9d1436069d68620246442c87682d2a5595ca8d1b996d46d843ad Jul 06 22:57:56.200198 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:56.200181 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 22:57:57.193301 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:57.193260 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9" event={"ID":"7fb39043-0151-4e6e-a6d9-f492f122a3f5","Type":"ContainerStarted","Data":"c87c62022dcd9d1436069d68620246442c87682d2a5595ca8d1b996d46d843ad"} Jul 06 22:57:58.208680 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:58.208640 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9" event={"ID":"7fb39043-0151-4e6e-a6d9-f492f122a3f5","Type":"ContainerStarted","Data":"184311e9857cdb3b9e442a9f235ca88e8f879f07badbe9dac22a48069025dea3"} Jul 06 22:57:58.227218 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:57:58.227158 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9" podStartSLOduration=2.193608464 podStartE2EDuration="3.227141173s" totalImagesPullingTime="1.033532709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:57:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:57:58.224888604 +0000 UTC m=+707.690190883" watchObservedRunningTime="2026-07-06 22:57:58.227141173 +0000 UTC m=+707.692443462" Jul 06 22:58:06.060381 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:06.060279 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9" Jul 06 22:58:06.060381 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:06.060355 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9" Jul 06 22:58:06.072925 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:06.072894 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9" Jul 06 22:58:06.260437 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:06.260409 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bv7g9" Jul 06 22:58:26.831209 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:26.831172 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6"] Jul 06 22:58:26.837667 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:26.837643 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6" Jul 06 22:58:26.841323 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:26.841299 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 06 22:58:26.842235 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:26.842213 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6"] Jul 06 22:58:26.865270 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:26.865244 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:26.987863 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:26.987837 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f18c2d5-ac49-455d-ab36-aa2b4945ead2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6\" (UID: \"4f18c2d5-ac49-455d-ab36-aa2b4945ead2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6" Jul 06 22:58:26.988015 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:26.987889 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f18c2d5-ac49-455d-ab36-aa2b4945ead2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6\" (UID: \"4f18c2d5-ac49-455d-ab36-aa2b4945ead2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6" Jul 06 22:58:26.988058 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:26.987999 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn48w\" (UniqueName: \"kubernetes.io/projected/4f18c2d5-ac49-455d-ab36-aa2b4945ead2-kube-api-access-kn48w\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6\" (UID: \"4f18c2d5-ac49-455d-ab36-aa2b4945ead2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6" Jul 06 22:58:26.988058 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:26.988046 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f18c2d5-ac49-455d-ab36-aa2b4945ead2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6\" (UID: \"4f18c2d5-ac49-455d-ab36-aa2b4945ead2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6" Jul 06 22:58:26.988125 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:26.988113 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f18c2d5-ac49-455d-ab36-aa2b4945ead2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6\" (UID: \"4f18c2d5-ac49-455d-ab36-aa2b4945ead2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6" Jul 06 22:58:26.988164 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:26.988141 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f18c2d5-ac49-455d-ab36-aa2b4945ead2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6\" (UID: \"4f18c2d5-ac49-455d-ab36-aa2b4945ead2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6" Jul 06 22:58:27.089140 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:27.089061 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn48w\" (UniqueName: \"kubernetes.io/projected/4f18c2d5-ac49-455d-ab36-aa2b4945ead2-kube-api-access-kn48w\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6\" (UID: \"4f18c2d5-ac49-455d-ab36-aa2b4945ead2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6" Jul 06 22:58:27.089140 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:27.089099 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f18c2d5-ac49-455d-ab36-aa2b4945ead2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6\" (UID: \"4f18c2d5-ac49-455d-ab36-aa2b4945ead2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6" Jul 06 22:58:27.089140 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:27.089131 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f18c2d5-ac49-455d-ab36-aa2b4945ead2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6\" (UID: \"4f18c2d5-ac49-455d-ab36-aa2b4945ead2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6" Jul 06 22:58:27.089399 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:27.089224 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f18c2d5-ac49-455d-ab36-aa2b4945ead2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6\" (UID: \"4f18c2d5-ac49-455d-ab36-aa2b4945ead2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6" Jul 06 22:58:27.089399 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:27.089281 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f18c2d5-ac49-455d-ab36-aa2b4945ead2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6\" (UID: \"4f18c2d5-ac49-455d-ab36-aa2b4945ead2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6" Jul 06 22:58:27.089399 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:27.089320 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f18c2d5-ac49-455d-ab36-aa2b4945ead2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6\" (UID: \"4f18c2d5-ac49-455d-ab36-aa2b4945ead2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6" Jul 06 22:58:27.089563 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:27.089495 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f18c2d5-ac49-455d-ab36-aa2b4945ead2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6\" (UID: \"4f18c2d5-ac49-455d-ab36-aa2b4945ead2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6" Jul 06 22:58:27.089642 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:27.089617 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f18c2d5-ac49-455d-ab36-aa2b4945ead2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6\" (UID: \"4f18c2d5-ac49-455d-ab36-aa2b4945ead2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6" Jul 06 22:58:27.089685 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:27.089646 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f18c2d5-ac49-455d-ab36-aa2b4945ead2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6\" (UID: \"4f18c2d5-ac49-455d-ab36-aa2b4945ead2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6" Jul 06 22:58:27.091372 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:27.091350 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f18c2d5-ac49-455d-ab36-aa2b4945ead2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6\" (UID: \"4f18c2d5-ac49-455d-ab36-aa2b4945ead2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6" Jul 06 22:58:27.091577 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:27.091557 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f18c2d5-ac49-455d-ab36-aa2b4945ead2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6\" (UID: \"4f18c2d5-ac49-455d-ab36-aa2b4945ead2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6" Jul 06 22:58:27.096531 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:27.096509 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn48w\" (UniqueName: \"kubernetes.io/projected/4f18c2d5-ac49-455d-ab36-aa2b4945ead2-kube-api-access-kn48w\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6\" (UID: \"4f18c2d5-ac49-455d-ab36-aa2b4945ead2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6" Jul 06 22:58:27.149989 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:27.149962 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6" Jul 06 22:58:27.280533 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:27.280510 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6"] Jul 06 22:58:27.282743 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:58:27.282716 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f18c2d5_ac49_455d_ab36_aa2b4945ead2.slice/crio-5b2e8c383faced14f2af62187b93dcce5ff34a6e0536b240ca3cadcd0e2c19f2 WatchSource:0}: Error finding container 5b2e8c383faced14f2af62187b93dcce5ff34a6e0536b240ca3cadcd0e2c19f2: Status 404 returned error can't find the container with id 5b2e8c383faced14f2af62187b93dcce5ff34a6e0536b240ca3cadcd0e2c19f2 Jul 06 22:58:27.339220 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:27.339144 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6" event={"ID":"4f18c2d5-ac49-455d-ab36-aa2b4945ead2","Type":"ContainerStarted","Data":"5b2e8c383faced14f2af62187b93dcce5ff34a6e0536b240ca3cadcd0e2c19f2"} Jul 06 22:58:28.346520 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:28.346486 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6" event={"ID":"4f18c2d5-ac49-455d-ab36-aa2b4945ead2","Type":"ContainerStarted","Data":"c702af2c9727fdea74f28d042f1d163642b83bdad882063b4c8a4b6d78755963"} Jul 06 22:58:28.370866 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:28.370789 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6" podStartSLOduration=2.174857971 podStartE2EDuration="2.370773318s" totalImagesPullingTime="195.915347ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:58:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:58:28.369217374 +0000 UTC m=+737.834519677" watchObservedRunningTime="2026-07-06 22:58:28.370773318 +0000 UTC m=+737.836075599" Jul 06 22:58:37.150537 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:37.150507 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6" Jul 06 22:58:37.150943 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:37.150561 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6" Jul 06 22:58:37.163081 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:37.163062 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6" Jul 06 22:58:37.398132 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:37.398104 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6" Jul 06 22:58:41.934761 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:41.934728 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl"] Jul 06 22:58:41.937644 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:41.937625 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl" Jul 06 22:58:41.940268 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:41.940249 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 06 22:58:41.946667 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:41.946642 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl"] Jul 06 22:58:41.962095 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:41.962064 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:42.024336 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:42.024294 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb22e6dc-298b-4cfc-8e94-3604b10d1a0c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-btpgl\" (UID: \"cb22e6dc-298b-4cfc-8e94-3604b10d1a0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl" Jul 06 22:58:42.024336 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:42.024341 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb22e6dc-298b-4cfc-8e94-3604b10d1a0c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-btpgl\" (UID: \"cb22e6dc-298b-4cfc-8e94-3604b10d1a0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl" Jul 06 22:58:42.024554 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:42.024362 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwh56\" (UniqueName: \"kubernetes.io/projected/cb22e6dc-298b-4cfc-8e94-3604b10d1a0c-kube-api-access-cwh56\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-btpgl\" (UID: \"cb22e6dc-298b-4cfc-8e94-3604b10d1a0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl" Jul 06 22:58:42.024554 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:42.024460 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb22e6dc-298b-4cfc-8e94-3604b10d1a0c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-btpgl\" (UID: \"cb22e6dc-298b-4cfc-8e94-3604b10d1a0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl" Jul 06 22:58:42.024554 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:42.024493 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb22e6dc-298b-4cfc-8e94-3604b10d1a0c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-btpgl\" (UID: \"cb22e6dc-298b-4cfc-8e94-3604b10d1a0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl" Jul 06 22:58:42.024554 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:42.024520 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb22e6dc-298b-4cfc-8e94-3604b10d1a0c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-btpgl\" (UID: \"cb22e6dc-298b-4cfc-8e94-3604b10d1a0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl" Jul 06 22:58:42.125171 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:42.125133 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb22e6dc-298b-4cfc-8e94-3604b10d1a0c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-btpgl\" (UID: \"cb22e6dc-298b-4cfc-8e94-3604b10d1a0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl" Jul 06 22:58:42.125171 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:42.125171 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb22e6dc-298b-4cfc-8e94-3604b10d1a0c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-btpgl\" (UID: \"cb22e6dc-298b-4cfc-8e94-3604b10d1a0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl" Jul 06 22:58:42.125434 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:42.125187 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwh56\" (UniqueName: \"kubernetes.io/projected/cb22e6dc-298b-4cfc-8e94-3604b10d1a0c-kube-api-access-cwh56\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-btpgl\" (UID: \"cb22e6dc-298b-4cfc-8e94-3604b10d1a0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl" Jul 06 22:58:42.125434 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:42.125239 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb22e6dc-298b-4cfc-8e94-3604b10d1a0c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-btpgl\" (UID: \"cb22e6dc-298b-4cfc-8e94-3604b10d1a0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl" Jul 06 22:58:42.125434 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:42.125261 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb22e6dc-298b-4cfc-8e94-3604b10d1a0c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-btpgl\" (UID: \"cb22e6dc-298b-4cfc-8e94-3604b10d1a0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl" Jul 06 22:58:42.125434 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:42.125277 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb22e6dc-298b-4cfc-8e94-3604b10d1a0c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-btpgl\" (UID: \"cb22e6dc-298b-4cfc-8e94-3604b10d1a0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl" Jul 06 22:58:42.125647 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:42.125598 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb22e6dc-298b-4cfc-8e94-3604b10d1a0c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-btpgl\" (UID: \"cb22e6dc-298b-4cfc-8e94-3604b10d1a0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl" Jul 06 22:58:42.125647 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:42.125626 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb22e6dc-298b-4cfc-8e94-3604b10d1a0c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-btpgl\" (UID: \"cb22e6dc-298b-4cfc-8e94-3604b10d1a0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl" Jul 06 22:58:42.125730 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:42.125651 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb22e6dc-298b-4cfc-8e94-3604b10d1a0c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-btpgl\" (UID: \"cb22e6dc-298b-4cfc-8e94-3604b10d1a0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl" Jul 06 22:58:42.127596 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:42.127569 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb22e6dc-298b-4cfc-8e94-3604b10d1a0c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-btpgl\" (UID: \"cb22e6dc-298b-4cfc-8e94-3604b10d1a0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl" Jul 06 22:58:42.127727 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:42.127708 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb22e6dc-298b-4cfc-8e94-3604b10d1a0c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-btpgl\" (UID: \"cb22e6dc-298b-4cfc-8e94-3604b10d1a0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl" Jul 06 22:58:42.134078 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:42.134055 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwh56\" (UniqueName: \"kubernetes.io/projected/cb22e6dc-298b-4cfc-8e94-3604b10d1a0c-kube-api-access-cwh56\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-btpgl\" (UID: \"cb22e6dc-298b-4cfc-8e94-3604b10d1a0c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl" Jul 06 22:58:42.249941 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:42.249859 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl" Jul 06 22:58:42.383772 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:42.383739 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl"] Jul 06 22:58:42.386933 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:58:42.386895 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb22e6dc_298b_4cfc_8e94_3604b10d1a0c.slice/crio-2e1ac8200a2a333687ededf68d7f75ae678a36dd23bd1d412fa78a5ded98eedb WatchSource:0}: Error finding container 2e1ac8200a2a333687ededf68d7f75ae678a36dd23bd1d412fa78a5ded98eedb: Status 404 returned error can't find the container with id 2e1ac8200a2a333687ededf68d7f75ae678a36dd23bd1d412fa78a5ded98eedb Jul 06 22:58:42.409716 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:42.409684 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl" event={"ID":"cb22e6dc-298b-4cfc-8e94-3604b10d1a0c","Type":"ContainerStarted","Data":"2e1ac8200a2a333687ededf68d7f75ae678a36dd23bd1d412fa78a5ded98eedb"} Jul 06 22:58:43.415500 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:43.415464 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl" event={"ID":"cb22e6dc-298b-4cfc-8e94-3604b10d1a0c","Type":"ContainerStarted","Data":"58d5a7f152bbdfe81cc7643a04fe0e10ebd17973ef35919c801582b15add83f5"} Jul 06 22:58:43.435208 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:43.435144 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl" podStartSLOduration=2.239580773 podStartE2EDuration="2.435121913s" totalImagesPullingTime="195.54114ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:58:43.432957884 +0000 UTC m=+752.898260167" watchObservedRunningTime="2026-07-06 22:58:43.435121913 +0000 UTC m=+752.900424195" Jul 06 22:58:44.946461 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:44.946425 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27"] Jul 06 22:58:44.949760 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:44.949742 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27" Jul 06 22:58:44.952201 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:44.952180 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 06 22:58:44.960388 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:44.960356 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27"] Jul 06 22:58:44.973446 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:44.973419 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:45.051610 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:45.051577 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b13c0c2-9b49-4cba-b50b-4264fdbd47d2-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27\" (UID: \"0b13c0c2-9b49-4cba-b50b-4264fdbd47d2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27" Jul 06 22:58:45.051788 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:45.051621 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b13c0c2-9b49-4cba-b50b-4264fdbd47d2-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27\" (UID: \"0b13c0c2-9b49-4cba-b50b-4264fdbd47d2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27" Jul 06 22:58:45.051788 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:45.051645 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sksbm\" (UniqueName: \"kubernetes.io/projected/0b13c0c2-9b49-4cba-b50b-4264fdbd47d2-kube-api-access-sksbm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27\" (UID: \"0b13c0c2-9b49-4cba-b50b-4264fdbd47d2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27" Jul 06 22:58:45.051788 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:45.051705 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b13c0c2-9b49-4cba-b50b-4264fdbd47d2-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27\" (UID: \"0b13c0c2-9b49-4cba-b50b-4264fdbd47d2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27" Jul 06 22:58:45.051788 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:45.051726 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b13c0c2-9b49-4cba-b50b-4264fdbd47d2-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27\" (UID: \"0b13c0c2-9b49-4cba-b50b-4264fdbd47d2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27" Jul 06 22:58:45.051788 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:45.051761 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b13c0c2-9b49-4cba-b50b-4264fdbd47d2-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27\" (UID: \"0b13c0c2-9b49-4cba-b50b-4264fdbd47d2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27" Jul 06 22:58:45.152821 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:45.152767 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b13c0c2-9b49-4cba-b50b-4264fdbd47d2-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27\" (UID: \"0b13c0c2-9b49-4cba-b50b-4264fdbd47d2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27" Jul 06 22:58:45.152995 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:45.152838 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b13c0c2-9b49-4cba-b50b-4264fdbd47d2-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27\" (UID: \"0b13c0c2-9b49-4cba-b50b-4264fdbd47d2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27" Jul 06 22:58:45.152995 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:45.152858 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sksbm\" (UniqueName: \"kubernetes.io/projected/0b13c0c2-9b49-4cba-b50b-4264fdbd47d2-kube-api-access-sksbm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27\" (UID: \"0b13c0c2-9b49-4cba-b50b-4264fdbd47d2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27" Jul 06 22:58:45.152995 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:45.152885 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b13c0c2-9b49-4cba-b50b-4264fdbd47d2-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27\" (UID: \"0b13c0c2-9b49-4cba-b50b-4264fdbd47d2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27" Jul 06 22:58:45.152995 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:45.152899 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b13c0c2-9b49-4cba-b50b-4264fdbd47d2-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27\" (UID: \"0b13c0c2-9b49-4cba-b50b-4264fdbd47d2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27" Jul 06 22:58:45.152995 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:45.152934 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b13c0c2-9b49-4cba-b50b-4264fdbd47d2-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27\" (UID: \"0b13c0c2-9b49-4cba-b50b-4264fdbd47d2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27" Jul 06 22:58:45.153281 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:45.153257 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b13c0c2-9b49-4cba-b50b-4264fdbd47d2-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27\" (UID: \"0b13c0c2-9b49-4cba-b50b-4264fdbd47d2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27" Jul 06 22:58:45.153341 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:45.153276 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b13c0c2-9b49-4cba-b50b-4264fdbd47d2-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27\" (UID: \"0b13c0c2-9b49-4cba-b50b-4264fdbd47d2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27" Jul 06 22:58:45.153341 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:45.153321 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b13c0c2-9b49-4cba-b50b-4264fdbd47d2-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27\" (UID: \"0b13c0c2-9b49-4cba-b50b-4264fdbd47d2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27" Jul 06 22:58:45.155176 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:45.155146 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b13c0c2-9b49-4cba-b50b-4264fdbd47d2-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27\" (UID: \"0b13c0c2-9b49-4cba-b50b-4264fdbd47d2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27" Jul 06 22:58:45.155382 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:45.155361 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b13c0c2-9b49-4cba-b50b-4264fdbd47d2-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27\" (UID: \"0b13c0c2-9b49-4cba-b50b-4264fdbd47d2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27" Jul 06 22:58:45.165378 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:45.165355 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sksbm\" (UniqueName: \"kubernetes.io/projected/0b13c0c2-9b49-4cba-b50b-4264fdbd47d2-kube-api-access-sksbm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27\" (UID: \"0b13c0c2-9b49-4cba-b50b-4264fdbd47d2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27" Jul 06 22:58:45.259318 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:45.259230 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27" Jul 06 22:58:45.393112 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:45.393087 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27"] Jul 06 22:58:45.396340 ip-10-0-131-21 kubenswrapper[2566]: W0706 22:58:45.396299 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b13c0c2_9b49_4cba_b50b_4264fdbd47d2.slice/crio-b62ea04fdbd8932ac7788bd1e8476bf5a6168774c48ea98c31fdf9571bdbb7e0 WatchSource:0}: Error finding container b62ea04fdbd8932ac7788bd1e8476bf5a6168774c48ea98c31fdf9571bdbb7e0: Status 404 returned error can't find the container with id b62ea04fdbd8932ac7788bd1e8476bf5a6168774c48ea98c31fdf9571bdbb7e0 Jul 06 22:58:45.426959 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:45.426908 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27" event={"ID":"0b13c0c2-9b49-4cba-b50b-4264fdbd47d2","Type":"ContainerStarted","Data":"b62ea04fdbd8932ac7788bd1e8476bf5a6168774c48ea98c31fdf9571bdbb7e0"} Jul 06 22:58:46.433697 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:46.433658 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27" event={"ID":"0b13c0c2-9b49-4cba-b50b-4264fdbd47d2","Type":"ContainerStarted","Data":"17ba98dc46e1b1ddea7e683db32adf3b55a1f0e2fc6e533506f3871cf6459f43"} Jul 06 22:58:46.452698 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:46.452647 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27" podStartSLOduration=2.27208303 podStartE2EDuration="2.452629313s" totalImagesPullingTime="180.546283ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:58:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:58:46.451247593 +0000 UTC m=+755.916549875" watchObservedRunningTime="2026-07-06 22:58:46.452629313 +0000 UTC m=+755.917931594" Jul 06 22:58:52.250923 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:52.250887 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl" Jul 06 22:58:52.251437 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:52.250953 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl" Jul 06 22:58:52.263787 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:52.263759 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl" Jul 06 22:58:52.476093 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:52.476061 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-btpgl" Jul 06 22:58:55.259461 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:55.259425 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27" Jul 06 22:58:55.259907 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:55.259480 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27" Jul 06 22:58:55.272195 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:55.272166 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27" Jul 06 22:58:55.489346 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:58:55.489318 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27" Jul 06 22:59:41.421102 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:59:41.421016 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:41.474925 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:59:41.474899 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:57.774838 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:59:57.774789 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7ccfdff89-pqkrd"] Jul 06 22:59:57.775239 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:59:57.774975 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7ccfdff89-pqkrd" podUID="d9925cc6-271d-4c12-96eb-759363fd1065" containerName="authorino" containerID="cri-o://76acca0186a614f6fe3d04513f61fcafdda12c0830710f14f08b68c85d996b22" gracePeriod=30 Jul 06 22:59:58.027906 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:59:58.027847 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ccfdff89-pqkrd" Jul 06 22:59:58.114121 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:59:58.114090 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2gvw\" (UniqueName: \"kubernetes.io/projected/d9925cc6-271d-4c12-96eb-759363fd1065-kube-api-access-r2gvw\") pod \"d9925cc6-271d-4c12-96eb-759363fd1065\" (UID: \"d9925cc6-271d-4c12-96eb-759363fd1065\") " Jul 06 22:59:58.114121 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:59:58.114123 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d9925cc6-271d-4c12-96eb-759363fd1065-tls-cert\") pod \"d9925cc6-271d-4c12-96eb-759363fd1065\" (UID: \"d9925cc6-271d-4c12-96eb-759363fd1065\") " Jul 06 22:59:58.116277 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:59:58.116240 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9925cc6-271d-4c12-96eb-759363fd1065-kube-api-access-r2gvw" (OuterVolumeSpecName: "kube-api-access-r2gvw") pod "d9925cc6-271d-4c12-96eb-759363fd1065" (UID: "d9925cc6-271d-4c12-96eb-759363fd1065"). InnerVolumeSpecName "kube-api-access-r2gvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:59:58.125646 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:59:58.125621 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9925cc6-271d-4c12-96eb-759363fd1065-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d9925cc6-271d-4c12-96eb-759363fd1065" (UID: "d9925cc6-271d-4c12-96eb-759363fd1065"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:59:58.214984 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:59:58.214949 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2gvw\" (UniqueName: \"kubernetes.io/projected/d9925cc6-271d-4c12-96eb-759363fd1065-kube-api-access-r2gvw\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:59:58.214984 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:59:58.214976 2566 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d9925cc6-271d-4c12-96eb-759363fd1065-tls-cert\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 22:59:58.288838 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:59:58.288747 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:58.384846 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:59:58.384787 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:58.768045 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:59:58.768010 2566 generic.go:356] "Generic (PLEG): container finished" podID="d9925cc6-271d-4c12-96eb-759363fd1065" containerID="76acca0186a614f6fe3d04513f61fcafdda12c0830710f14f08b68c85d996b22" exitCode=0 Jul 06 22:59:58.768227 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:59:58.768056 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ccfdff89-pqkrd" Jul 06 22:59:58.768227 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:59:58.768093 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ccfdff89-pqkrd" event={"ID":"d9925cc6-271d-4c12-96eb-759363fd1065","Type":"ContainerDied","Data":"76acca0186a614f6fe3d04513f61fcafdda12c0830710f14f08b68c85d996b22"} Jul 06 22:59:58.768227 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:59:58.768136 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ccfdff89-pqkrd" event={"ID":"d9925cc6-271d-4c12-96eb-759363fd1065","Type":"ContainerDied","Data":"5c0cdc1d59be94c7045dd031ec918165d3fb8f455acea0164c8ba7854f0b99ba"} Jul 06 22:59:58.768227 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:59:58.768156 2566 scope.go:117] "RemoveContainer" containerID="76acca0186a614f6fe3d04513f61fcafdda12c0830710f14f08b68c85d996b22" Jul 06 22:59:58.777096 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:59:58.776933 2566 scope.go:117] "RemoveContainer" containerID="76acca0186a614f6fe3d04513f61fcafdda12c0830710f14f08b68c85d996b22" Jul 06 22:59:58.777313 ip-10-0-131-21 kubenswrapper[2566]: E0706 22:59:58.777187 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76acca0186a614f6fe3d04513f61fcafdda12c0830710f14f08b68c85d996b22\": container with ID starting with 76acca0186a614f6fe3d04513f61fcafdda12c0830710f14f08b68c85d996b22 not found: ID does not exist" containerID="76acca0186a614f6fe3d04513f61fcafdda12c0830710f14f08b68c85d996b22" Jul 06 22:59:58.777313 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:59:58.777212 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76acca0186a614f6fe3d04513f61fcafdda12c0830710f14f08b68c85d996b22"} err="failed to get container status \"76acca0186a614f6fe3d04513f61fcafdda12c0830710f14f08b68c85d996b22\": rpc error: code = NotFound desc = could not find container \"76acca0186a614f6fe3d04513f61fcafdda12c0830710f14f08b68c85d996b22\": container with ID starting with 76acca0186a614f6fe3d04513f61fcafdda12c0830710f14f08b68c85d996b22 not found: ID does not exist" Jul 06 22:59:58.788912 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:59:58.788891 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7ccfdff89-pqkrd"] Jul 06 22:59:58.794667 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:59:58.794648 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7ccfdff89-pqkrd"] Jul 06 22:59:59.105460 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:59:59.105429 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9925cc6-271d-4c12-96eb-759363fd1065" path="/var/lib/kubelet/pods/d9925cc6-271d-4c12-96eb-759363fd1065/volumes" Jul 06 22:59:59.421416 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:59:59.421324 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:59.524165 ip-10-0-131-21 kubenswrapper[2566]: I0706 22:59:59.524127 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:01:09.125666 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:01:09.125579 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:01:10.750967 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:01:10.750934 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:01:10.979366 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:01:10.979334 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rtzxs_1dc50270-5e71-4a7b-8160-9041cbc18cd9/console-operator/2.log" Jul 06 23:01:10.986010 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:01:10.985983 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rtzxs_1dc50270-5e71-4a7b-8160-9041cbc18cd9/console-operator/2.log" Jul 06 23:01:16.658240 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:01:16.658195 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:01:38.922787 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:01:38.922747 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:01:46.842150 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:01:46.842110 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:01:51.374369 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:01:51.374325 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:01:51.533439 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:01:51.533409 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:01:51.635588 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:01:51.635508 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:01:57.142885 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:01:57.142844 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:01:57.200993 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:01:57.200960 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:01:57.271352 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:01:57.271316 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:01:57.947241 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:01:57.947195 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:01:58.049361 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:01:58.049318 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:02:03.177521 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:02:03.177471 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:02:06.899430 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:02:06.899390 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:02:39.093697 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:02:39.093611 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:02:39.209898 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:02:39.209864 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:03:04.665132 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:03:04.665095 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:03:04.715529 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:03:04.715475 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:04:55.719659 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:04:55.719594 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:04:55.807097 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:04:55.807064 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:05:52.769218 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:05:52.769122 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:05:52.822963 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:05:52.822927 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:05:54.911382 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:05:54.911349 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zrqpt"] Jul 06 23:05:54.911984 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:05:54.911544 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zrqpt" podUID="a8878178-567f-4052-a4b5-bd6afe7f02a1" containerName="manager" containerID="cri-o://8eb7e75da75b267f215c58914454376c4826f271747085729b1da3ce788ad548" gracePeriod=10 Jul 06 23:05:57.470623 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:05:57.470576 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zrqpt" podUID="a8878178-567f-4052-a4b5-bd6afe7f02a1" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.29:8081/readyz\": dial tcp 10.132.0.29:8081: connect: connection refused" Jul 06 23:05:58.065769 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:05:58.065741 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zrqpt" Jul 06 23:05:58.244060 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:05:58.243982 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8878178-567f-4052-a4b5-bd6afe7f02a1-extensions-socket-volume\") pod \"a8878178-567f-4052-a4b5-bd6afe7f02a1\" (UID: \"a8878178-567f-4052-a4b5-bd6afe7f02a1\") " Jul 06 23:05:58.244060 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:05:58.244038 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjmfq\" (UniqueName: \"kubernetes.io/projected/a8878178-567f-4052-a4b5-bd6afe7f02a1-kube-api-access-pjmfq\") pod \"a8878178-567f-4052-a4b5-bd6afe7f02a1\" (UID: \"a8878178-567f-4052-a4b5-bd6afe7f02a1\") " Jul 06 23:05:58.244418 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:05:58.244387 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8878178-567f-4052-a4b5-bd6afe7f02a1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a8878178-567f-4052-a4b5-bd6afe7f02a1" (UID: "a8878178-567f-4052-a4b5-bd6afe7f02a1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:05:58.246269 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:05:58.246236 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8878178-567f-4052-a4b5-bd6afe7f02a1-kube-api-access-pjmfq" (OuterVolumeSpecName: "kube-api-access-pjmfq") pod "a8878178-567f-4052-a4b5-bd6afe7f02a1" (UID: "a8878178-567f-4052-a4b5-bd6afe7f02a1"). InnerVolumeSpecName "kube-api-access-pjmfq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:05:58.345298 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:05:58.345259 2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8878178-567f-4052-a4b5-bd6afe7f02a1-extensions-socket-volume\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:05:58.345298 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:05:58.345288 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjmfq\" (UniqueName: \"kubernetes.io/projected/a8878178-567f-4052-a4b5-bd6afe7f02a1-kube-api-access-pjmfq\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:05:58.416939 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:05:58.416902 2566 generic.go:356] "Generic (PLEG): container finished" podID="a8878178-567f-4052-a4b5-bd6afe7f02a1" containerID="8eb7e75da75b267f215c58914454376c4826f271747085729b1da3ce788ad548" exitCode=0 Jul 06 23:05:58.417125 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:05:58.416959 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zrqpt" Jul 06 23:05:58.417125 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:05:58.416982 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zrqpt" event={"ID":"a8878178-567f-4052-a4b5-bd6afe7f02a1","Type":"ContainerDied","Data":"8eb7e75da75b267f215c58914454376c4826f271747085729b1da3ce788ad548"} Jul 06 23:05:58.417125 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:05:58.417033 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zrqpt" event={"ID":"a8878178-567f-4052-a4b5-bd6afe7f02a1","Type":"ContainerDied","Data":"ae57d8ebbd632e2b114ebbee8331dd32a2bebb5f81086bcdeab42b5a830a2a5e"} Jul 06 23:05:58.417125 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:05:58.417054 2566 scope.go:117] "RemoveContainer" containerID="8eb7e75da75b267f215c58914454376c4826f271747085729b1da3ce788ad548" Jul 06 23:05:58.426745 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:05:58.426726 2566 scope.go:117] "RemoveContainer" containerID="8eb7e75da75b267f215c58914454376c4826f271747085729b1da3ce788ad548" Jul 06 23:05:58.427027 ip-10-0-131-21 kubenswrapper[2566]: E0706 23:05:58.427007 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eb7e75da75b267f215c58914454376c4826f271747085729b1da3ce788ad548\": container with ID starting with 8eb7e75da75b267f215c58914454376c4826f271747085729b1da3ce788ad548 not found: ID does not exist" containerID="8eb7e75da75b267f215c58914454376c4826f271747085729b1da3ce788ad548" Jul 06 23:05:58.427130 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:05:58.427037 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eb7e75da75b267f215c58914454376c4826f271747085729b1da3ce788ad548"} err="failed to get container status \"8eb7e75da75b267f215c58914454376c4826f271747085729b1da3ce788ad548\": rpc error: code = NotFound desc = could not find container \"8eb7e75da75b267f215c58914454376c4826f271747085729b1da3ce788ad548\": container with ID starting with 8eb7e75da75b267f215c58914454376c4826f271747085729b1da3ce788ad548 not found: ID does not exist" Jul 06 23:05:58.449065 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:05:58.449034 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zrqpt"] Jul 06 23:05:58.451251 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:05:58.451229 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zrqpt"] Jul 06 23:05:59.105175 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:05:59.105147 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8878178-567f-4052-a4b5-bd6afe7f02a1" path="/var/lib/kubelet/pods/a8878178-567f-4052-a4b5-bd6afe7f02a1/volumes" Jul 06 23:06:11.010521 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:06:11.010490 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rtzxs_1dc50270-5e71-4a7b-8160-9041cbc18cd9/console-operator/2.log" Jul 06 23:06:11.012902 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:06:11.012877 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rtzxs_1dc50270-5e71-4a7b-8160-9041cbc18cd9/console-operator/2.log" Jul 06 23:06:56.029596 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:06:56.029556 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6k9wq"] Jul 06 23:06:56.032067 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:06:56.030065 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9925cc6-271d-4c12-96eb-759363fd1065" containerName="authorino" Jul 06 23:06:56.032067 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:06:56.030085 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9925cc6-271d-4c12-96eb-759363fd1065" containerName="authorino" Jul 06 23:06:56.032067 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:06:56.030100 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8878178-567f-4052-a4b5-bd6afe7f02a1" containerName="manager" Jul 06 23:06:56.032067 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:06:56.030108 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8878178-567f-4052-a4b5-bd6afe7f02a1" containerName="manager" Jul 06 23:06:56.032067 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:06:56.030177 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8878178-567f-4052-a4b5-bd6afe7f02a1" containerName="manager" Jul 06 23:06:56.032067 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:06:56.030189 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9925cc6-271d-4c12-96eb-759363fd1065" containerName="authorino" Jul 06 23:06:56.033010 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:06:56.032991 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6k9wq" Jul 06 23:06:56.035683 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:06:56.035657 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 23:06:56.035837 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:06:56.035688 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nsvrd\"" Jul 06 23:06:56.035837 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:06:56.035759 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 23:06:56.047083 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:06:56.047060 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6k9wq"] Jul 06 23:06:56.056459 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:06:56.056428 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zczbs\" (UniqueName: \"kubernetes.io/projected/227eac5e-d012-4acb-ab98-97357f30ddaa-kube-api-access-zczbs\") pod \"kuadrant-operator-controller-manager-86878c769f-6k9wq\" (UID: \"227eac5e-d012-4acb-ab98-97357f30ddaa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6k9wq" Jul 06 23:06:56.056582 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:06:56.056475 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/227eac5e-d012-4acb-ab98-97357f30ddaa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6k9wq\" (UID: \"227eac5e-d012-4acb-ab98-97357f30ddaa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6k9wq" Jul 06 23:06:56.157932 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:06:56.157893 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zczbs\" (UniqueName: \"kubernetes.io/projected/227eac5e-d012-4acb-ab98-97357f30ddaa-kube-api-access-zczbs\") pod \"kuadrant-operator-controller-manager-86878c769f-6k9wq\" (UID: \"227eac5e-d012-4acb-ab98-97357f30ddaa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6k9wq" Jul 06 23:06:56.158111 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:06:56.157936 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/227eac5e-d012-4acb-ab98-97357f30ddaa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6k9wq\" (UID: \"227eac5e-d012-4acb-ab98-97357f30ddaa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6k9wq" Jul 06 23:06:56.158377 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:06:56.158357 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/227eac5e-d012-4acb-ab98-97357f30ddaa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6k9wq\" (UID: \"227eac5e-d012-4acb-ab98-97357f30ddaa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6k9wq" Jul 06 23:06:56.167512 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:06:56.167488 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zczbs\" (UniqueName: \"kubernetes.io/projected/227eac5e-d012-4acb-ab98-97357f30ddaa-kube-api-access-zczbs\") pod \"kuadrant-operator-controller-manager-86878c769f-6k9wq\" (UID: \"227eac5e-d012-4acb-ab98-97357f30ddaa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6k9wq" Jul 06 23:06:56.342835 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:06:56.342792 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6k9wq" Jul 06 23:06:56.478339 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:06:56.478318 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6k9wq"] Jul 06 23:06:56.481256 ip-10-0-131-21 kubenswrapper[2566]: W0706 23:06:56.481222 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod227eac5e_d012_4acb_ab98_97357f30ddaa.slice/crio-2630d4f017b5b083ef22068008ccd209a27630c04a63cf44f02633055cf18eec WatchSource:0}: Error finding container 2630d4f017b5b083ef22068008ccd209a27630c04a63cf44f02633055cf18eec: Status 404 returned error can't find the container with id 2630d4f017b5b083ef22068008ccd209a27630c04a63cf44f02633055cf18eec Jul 06 23:06:56.680075 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:06:56.679977 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6k9wq" event={"ID":"227eac5e-d012-4acb-ab98-97357f30ddaa","Type":"ContainerStarted","Data":"3b4d68a255c707dad99cb366ca01304b22dfd142ad426a912e4ac1292adf64d8"} Jul 06 23:06:56.680075 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:06:56.680033 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6k9wq" event={"ID":"227eac5e-d012-4acb-ab98-97357f30ddaa","Type":"ContainerStarted","Data":"2630d4f017b5b083ef22068008ccd209a27630c04a63cf44f02633055cf18eec"} Jul 06 23:06:56.680323 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:06:56.680077 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6k9wq" Jul 06 23:06:56.697652 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:06:56.697603 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6k9wq" podStartSLOduration=0.697587734 podStartE2EDuration="697.587734ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:06:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:06:56.696380017 +0000 UTC m=+1246.161682299" watchObservedRunningTime="2026-07-06 23:06:56.697587734 +0000 UTC m=+1246.162890015" Jul 06 23:07:07.687020 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:07:07.686939 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6k9wq" Jul 06 23:07:21.339717 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:07:21.339666 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:08:29.559622 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:08:29.559584 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:08:29.659371 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:08:29.659333 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:11:11.040363 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:11:11.040332 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rtzxs_1dc50270-5e71-4a7b-8160-9041cbc18cd9/console-operator/2.log" Jul 06 23:11:11.041743 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:11:11.041722 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rtzxs_1dc50270-5e71-4a7b-8160-9041cbc18cd9/console-operator/2.log" Jul 06 23:12:36.522798 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:12:36.522759 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:12:43.099361 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:12:43.099310 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:12:51.357282 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:12:51.357243 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:12:56.420081 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:12:56.420042 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:12:59.200738 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:12:59.200696 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:12:59.375244 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:12:59.375213 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:12:59.838344 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:12:59.838311 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:05.290638 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:05.290554 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:05.396539 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:05.396502 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:05.507773 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:05.507744 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:05.567579 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:05.567476 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:06.707679 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:06.707615 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:06.859713 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:06.859679 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:06.934698 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:06.934671 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:07.417974 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:07.417935 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:07.518698 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:07.518663 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:09.625124 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:09.625094 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:11.678173 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:11.678135 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:11.869324 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:11.869285 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:12.025737 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:12.025649 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:12.159186 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:12.159151 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:13.531446 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:13.531409 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:15.783521 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:15.783437 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:17.202119 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:17.202085 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:17.785834 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:17.785784 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:17.857244 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:17.857217 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:18.007169 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:18.007132 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:18.108991 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:18.108959 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:19.190411 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:19.190372 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:19.282124 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:19.282092 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:19.357689 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:19.357651 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:19.748224 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:19.748190 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:19.847052 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:19.847025 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:20.029623 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:20.029540 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:21.174228 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:21.174198 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:24.220951 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:24.220919 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:24.563032 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:24.562956 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:30.315927 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:30.315891 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:30.417511 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:30.417475 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:32.127017 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:32.126987 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:35.968903 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:35.968873 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:36.034647 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:36.034617 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:36.175676 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:36.175643 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:36.238026 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:36.237939 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:37.260519 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:37.260490 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:37.360141 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:37.360106 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:37.472480 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:37.472450 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:37.809346 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:37.809315 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:37.915067 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:37.915033 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:38.016376 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:38.016344 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:39.315940 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:39.315889 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:41.698835 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:41.698777 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:41.905402 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:41.905369 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:42.005599 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:42.005506 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:42.109108 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:42.109069 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:43.565273 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:43.565245 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:47.569119 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:47.569089 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:47.628193 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:47.628151 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:48.034614 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:48.034572 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:48.134886 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:48.134845 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:48.234777 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:48.234742 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:49.606044 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:49.606002 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:55.160101 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:55.160068 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:55.224913 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:55.224877 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:55.306357 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:55.306325 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:55.403275 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:55.403247 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:55.499198 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:55.499095 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:13:55.849510 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:13:55.849478 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:14:21.834834 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:14:21.834788 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:14:27.576668 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:14:27.576624 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:14:27.677395 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:14:27.677369 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:14:27.777270 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:14:27.777238 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:14:43.653140 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:14:43.653045 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:14:49.332803 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:14:49.332767 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:14:49.512373 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:14:49.512341 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:14:49.611799 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:14:49.611768 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:00.064191 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:00.064146 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:00.895082 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:00.895054 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:06.685367 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:06.685332 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:06.749993 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:06.749952 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:06.901550 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:06.901511 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:07.002402 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:07.002310 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:07.773496 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:07.773462 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:07.874234 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:07.874198 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:07.976761 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:07.976721 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:09.547830 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:09.547766 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:15.573994 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:15.573959 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:15.638723 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:15.638694 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:16.260522 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:16.260484 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:21.930927 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:21.930893 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:22.031102 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:22.031070 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:22.173529 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:22.173495 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:22.465795 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:22.465764 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:22.578514 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:22.578474 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:25.145501 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:25.145463 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:25.240403 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:25.240370 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:25.354307 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:25.354242 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:25.444306 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:25.444218 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:25.733549 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:25.733464 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:25.833965 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:25.833932 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:29.636963 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:29.636928 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:30.357746 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:30.357705 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:30.457840 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:30.457794 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:30.731326 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:30.731239 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:36.454338 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:36.454301 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:36.557769 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:36.557716 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:36.957130 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:36.957093 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:37.309254 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:37.309160 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:37.409102 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:37.409066 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:42.854451 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:42.854417 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:43.057919 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:43.057888 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:43.120300 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:43.120215 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:43.315313 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:43.315281 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:43.438783 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:43.438699 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:43.536866 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:43.536825 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:43.666141 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:43.666105 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:49.311636 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:49.311607 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:49.415017 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:49.414981 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:49.511852 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:49.511796 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:49.659155 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:49.659129 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:55.248867 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:55.248835 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:15:55.311727 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:15:55.311694 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:16:02.004709 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:02.004673 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:16:02.326188 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:02.326082 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:16:02.451029 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:02.450994 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:16:05.373701 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:05.373667 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:16:05.472947 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:05.472916 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:16:05.572670 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:05.572641 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:16:06.005389 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:06.005355 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:16:06.108945 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:06.108908 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:16:09.859940 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:09.859910 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:16:11.068924 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:11.068892 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rtzxs_1dc50270-5e71-4a7b-8160-9041cbc18cd9/console-operator/2.log" Jul 06 23:16:11.069370 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:11.069297 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rtzxs_1dc50270-5e71-4a7b-8160-9041cbc18cd9/console-operator/2.log" Jul 06 23:16:25.027071 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:25.027025 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh"] Jul 06 23:16:25.030625 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:25.030599 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" Jul 06 23:16:25.033063 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:25.033034 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-93d8da3f\"/\"kube-root-ca.crt\"" Jul 06 23:16:25.033985 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:25.033965 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-93d8da3f\"/\"openshift-service-ca.crt\"" Jul 06 23:16:25.034107 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:25.034050 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-93d8da3f\"/\"default-dockercfg-5vdd2\"" Jul 06 23:16:25.034107 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:25.034069 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-93d8da3f\"/\"e2e-lifecycle-model-93d8da3f-kserve-self-signed-certs\"" Jul 06 23:16:25.041086 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:25.041061 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh"] Jul 06 23:16:25.052266 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:25.052237 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:16:25.070702 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:25.070666 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea774baa-5cca-484a-af44-c0466d5cac9f-home\") pod \"e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh\" (UID: \"ea774baa-5cca-484a-af44-c0466d5cac9f\") " pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" Jul 06 23:16:25.070702 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:25.070705 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea774baa-5cca-484a-af44-c0466d5cac9f-dshm\") pod \"e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh\" (UID: \"ea774baa-5cca-484a-af44-c0466d5cac9f\") " pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" Jul 06 23:16:25.070972 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:25.070791 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea774baa-5cca-484a-af44-c0466d5cac9f-tmp-dir\") pod \"e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh\" (UID: \"ea774baa-5cca-484a-af44-c0466d5cac9f\") " pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" Jul 06 23:16:25.070972 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:25.070892 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdjn9\" (UniqueName: \"kubernetes.io/projected/ea774baa-5cca-484a-af44-c0466d5cac9f-kube-api-access-bdjn9\") pod \"e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh\" (UID: \"ea774baa-5cca-484a-af44-c0466d5cac9f\") " pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" Jul 06 23:16:25.070972 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:25.070928 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea774baa-5cca-484a-af44-c0466d5cac9f-tls-certs\") pod \"e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh\" (UID: \"ea774baa-5cca-484a-af44-c0466d5cac9f\") " pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" Jul 06 23:16:25.070972 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:25.070964 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea774baa-5cca-484a-af44-c0466d5cac9f-model-cache\") pod \"e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh\" (UID: \"ea774baa-5cca-484a-af44-c0466d5cac9f\") " pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" Jul 06 23:16:25.171637 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:25.171600 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea774baa-5cca-484a-af44-c0466d5cac9f-dshm\") pod \"e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh\" (UID: \"ea774baa-5cca-484a-af44-c0466d5cac9f\") " pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" Jul 06 23:16:25.171855 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:25.171661 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea774baa-5cca-484a-af44-c0466d5cac9f-tmp-dir\") pod \"e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh\" (UID: \"ea774baa-5cca-484a-af44-c0466d5cac9f\") " pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" Jul 06 23:16:25.171855 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:25.171833 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdjn9\" (UniqueName: \"kubernetes.io/projected/ea774baa-5cca-484a-af44-c0466d5cac9f-kube-api-access-bdjn9\") pod \"e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh\" (UID: \"ea774baa-5cca-484a-af44-c0466d5cac9f\") " pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" Jul 06 23:16:25.171991 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:25.171878 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea774baa-5cca-484a-af44-c0466d5cac9f-tls-certs\") pod \"e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh\" (UID: \"ea774baa-5cca-484a-af44-c0466d5cac9f\") " pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" Jul 06 23:16:25.171991 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:25.171917 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea774baa-5cca-484a-af44-c0466d5cac9f-model-cache\") pod \"e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh\" (UID: \"ea774baa-5cca-484a-af44-c0466d5cac9f\") " pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" Jul 06 23:16:25.171991 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:25.171945 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea774baa-5cca-484a-af44-c0466d5cac9f-home\") pod \"e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh\" (UID: \"ea774baa-5cca-484a-af44-c0466d5cac9f\") " pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" Jul 06 23:16:25.172161 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:25.172145 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea774baa-5cca-484a-af44-c0466d5cac9f-tmp-dir\") pod \"e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh\" (UID: \"ea774baa-5cca-484a-af44-c0466d5cac9f\") " pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" Jul 06 23:16:25.172274 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:25.172254 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea774baa-5cca-484a-af44-c0466d5cac9f-home\") pod \"e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh\" (UID: \"ea774baa-5cca-484a-af44-c0466d5cac9f\") " pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" Jul 06 23:16:25.172352 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:25.172300 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea774baa-5cca-484a-af44-c0466d5cac9f-model-cache\") pod \"e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh\" (UID: \"ea774baa-5cca-484a-af44-c0466d5cac9f\") " pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" Jul 06 23:16:25.173977 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:25.173950 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea774baa-5cca-484a-af44-c0466d5cac9f-dshm\") pod \"e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh\" (UID: \"ea774baa-5cca-484a-af44-c0466d5cac9f\") " pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" Jul 06 23:16:25.174431 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:25.174411 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea774baa-5cca-484a-af44-c0466d5cac9f-tls-certs\") pod \"e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh\" (UID: \"ea774baa-5cca-484a-af44-c0466d5cac9f\") " pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" Jul 06 23:16:25.181304 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:25.181279 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdjn9\" (UniqueName: \"kubernetes.io/projected/ea774baa-5cca-484a-af44-c0466d5cac9f-kube-api-access-bdjn9\") pod \"e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh\" (UID: \"ea774baa-5cca-484a-af44-c0466d5cac9f\") " pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" Jul 06 23:16:25.341471 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:25.341361 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" Jul 06 23:16:25.476040 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:25.475993 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh"] Jul 06 23:16:25.478511 ip-10-0-131-21 kubenswrapper[2566]: W0706 23:16:25.478466 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea774baa_5cca_484a_af44_c0466d5cac9f.slice/crio-ddeab5d2a563fab92ace7e93f76d2c4d0be9d98c9b65724177f31776cc3a3b4f WatchSource:0}: Error finding container ddeab5d2a563fab92ace7e93f76d2c4d0be9d98c9b65724177f31776cc3a3b4f: Status 404 returned error can't find the container with id ddeab5d2a563fab92ace7e93f76d2c4d0be9d98c9b65724177f31776cc3a3b4f Jul 06 23:16:26.254731 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:26.254697 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" event={"ID":"ea774baa-5cca-484a-af44-c0466d5cac9f","Type":"ContainerStarted","Data":"9e939e6c0951ce64d67d103339f583dded8273271ffd9c52554c9e281912d12e"} Jul 06 23:16:26.255151 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:26.254739 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" event={"ID":"ea774baa-5cca-484a-af44-c0466d5cac9f","Type":"ContainerStarted","Data":"ddeab5d2a563fab92ace7e93f76d2c4d0be9d98c9b65724177f31776cc3a3b4f"} Jul 06 23:16:26.270175 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:26.270092 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" podStartSLOduration=1.270073591 podStartE2EDuration="1.270073591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:16:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:16:26.269081477 +0000 UTC m=+1815.734383763" watchObservedRunningTime="2026-07-06 23:16:26.270073591 +0000 UTC m=+1815.735375879" Jul 06 23:16:33.499832 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:33.499773 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:16:33.603386 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:33.603358 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:16:35.341542 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:35.341500 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" Jul 06 23:16:35.341955 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:35.341558 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" Jul 06 23:16:35.354252 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:35.354221 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" Jul 06 23:16:36.310991 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:36.310957 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" Jul 06 23:16:47.329497 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:47.329460 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:16:47.764860 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:47.764799 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:16:47.866561 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:47.866525 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:16:48.008154 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:48.008121 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:16:53.414876 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:53.414836 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:16:58.400623 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:58.400587 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh"] Jul 06 23:16:58.444268 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:16:58.444238 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:17:13.424706 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:13.424668 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" podUID="ea774baa-5cca-484a-af44-c0466d5cac9f" containerName="main" containerID="cri-o://9e939e6c0951ce64d67d103339f583dded8273271ffd9c52554c9e281912d12e" gracePeriod=45 Jul 06 23:17:13.669431 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:13.669406 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" Jul 06 23:17:13.721547 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:13.721464 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea774baa-5cca-484a-af44-c0466d5cac9f-dshm\") pod \"ea774baa-5cca-484a-af44-c0466d5cac9f\" (UID: \"ea774baa-5cca-484a-af44-c0466d5cac9f\") " Jul 06 23:17:13.721547 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:13.721532 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea774baa-5cca-484a-af44-c0466d5cac9f-home\") pod \"ea774baa-5cca-484a-af44-c0466d5cac9f\" (UID: \"ea774baa-5cca-484a-af44-c0466d5cac9f\") " Jul 06 23:17:13.721744 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:13.721550 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea774baa-5cca-484a-af44-c0466d5cac9f-tmp-dir\") pod \"ea774baa-5cca-484a-af44-c0466d5cac9f\" (UID: \"ea774baa-5cca-484a-af44-c0466d5cac9f\") " Jul 06 23:17:13.721744 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:13.721572 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea774baa-5cca-484a-af44-c0466d5cac9f-tls-certs\") pod \"ea774baa-5cca-484a-af44-c0466d5cac9f\" (UID: \"ea774baa-5cca-484a-af44-c0466d5cac9f\") " Jul 06 23:17:13.721744 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:13.721647 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdjn9\" (UniqueName: \"kubernetes.io/projected/ea774baa-5cca-484a-af44-c0466d5cac9f-kube-api-access-bdjn9\") pod \"ea774baa-5cca-484a-af44-c0466d5cac9f\" (UID: \"ea774baa-5cca-484a-af44-c0466d5cac9f\") " Jul 06 23:17:13.721744 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:13.721666 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea774baa-5cca-484a-af44-c0466d5cac9f-model-cache\") pod \"ea774baa-5cca-484a-af44-c0466d5cac9f\" (UID: \"ea774baa-5cca-484a-af44-c0466d5cac9f\") " Jul 06 23:17:13.721982 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:13.721849 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea774baa-5cca-484a-af44-c0466d5cac9f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ea774baa-5cca-484a-af44-c0466d5cac9f" (UID: "ea774baa-5cca-484a-af44-c0466d5cac9f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:17:13.721982 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:13.721865 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea774baa-5cca-484a-af44-c0466d5cac9f-home" (OuterVolumeSpecName: "home") pod "ea774baa-5cca-484a-af44-c0466d5cac9f" (UID: "ea774baa-5cca-484a-af44-c0466d5cac9f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:17:13.722097 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:13.722045 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea774baa-5cca-484a-af44-c0466d5cac9f-model-cache" (OuterVolumeSpecName: "model-cache") pod "ea774baa-5cca-484a-af44-c0466d5cac9f" (UID: "ea774baa-5cca-484a-af44-c0466d5cac9f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:17:13.722278 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:13.722257 2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea774baa-5cca-484a-af44-c0466d5cac9f-home\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:17:13.722368 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:13.722281 2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea774baa-5cca-484a-af44-c0466d5cac9f-tmp-dir\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:17:13.722368 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:13.722294 2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea774baa-5cca-484a-af44-c0466d5cac9f-model-cache\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:17:13.723623 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:13.723601 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea774baa-5cca-484a-af44-c0466d5cac9f-dshm" (OuterVolumeSpecName: "dshm") pod "ea774baa-5cca-484a-af44-c0466d5cac9f" (UID: "ea774baa-5cca-484a-af44-c0466d5cac9f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:17:13.723725 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:13.723706 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea774baa-5cca-484a-af44-c0466d5cac9f-kube-api-access-bdjn9" (OuterVolumeSpecName: "kube-api-access-bdjn9") pod "ea774baa-5cca-484a-af44-c0466d5cac9f" (UID: "ea774baa-5cca-484a-af44-c0466d5cac9f"). InnerVolumeSpecName "kube-api-access-bdjn9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:17:13.724079 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:13.724062 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea774baa-5cca-484a-af44-c0466d5cac9f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ea774baa-5cca-484a-af44-c0466d5cac9f" (UID: "ea774baa-5cca-484a-af44-c0466d5cac9f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:17:13.823398 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:13.823363 2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea774baa-5cca-484a-af44-c0466d5cac9f-tls-certs\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:17:13.823398 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:13.823394 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdjn9\" (UniqueName: \"kubernetes.io/projected/ea774baa-5cca-484a-af44-c0466d5cac9f-kube-api-access-bdjn9\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:17:13.823398 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:13.823403 2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea774baa-5cca-484a-af44-c0466d5cac9f-dshm\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:17:14.480029 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:14.479993 2566 generic.go:356] "Generic (PLEG): container finished" podID="ea774baa-5cca-484a-af44-c0466d5cac9f" containerID="9e939e6c0951ce64d67d103339f583dded8273271ffd9c52554c9e281912d12e" exitCode=0 Jul 06 23:17:14.480520 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:14.480036 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" Jul 06 23:17:14.480520 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:14.480080 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" event={"ID":"ea774baa-5cca-484a-af44-c0466d5cac9f","Type":"ContainerDied","Data":"9e939e6c0951ce64d67d103339f583dded8273271ffd9c52554c9e281912d12e"} Jul 06 23:17:14.480520 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:14.480134 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh" event={"ID":"ea774baa-5cca-484a-af44-c0466d5cac9f","Type":"ContainerDied","Data":"ddeab5d2a563fab92ace7e93f76d2c4d0be9d98c9b65724177f31776cc3a3b4f"} Jul 06 23:17:14.480520 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:14.480160 2566 scope.go:117] "RemoveContainer" containerID="9e939e6c0951ce64d67d103339f583dded8273271ffd9c52554c9e281912d12e" Jul 06 23:17:14.491451 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:14.491432 2566 scope.go:117] "RemoveContainer" containerID="9e939e6c0951ce64d67d103339f583dded8273271ffd9c52554c9e281912d12e" Jul 06 23:17:14.491690 ip-10-0-131-21 kubenswrapper[2566]: E0706 23:17:14.491671 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e939e6c0951ce64d67d103339f583dded8273271ffd9c52554c9e281912d12e\": container with ID starting with 9e939e6c0951ce64d67d103339f583dded8273271ffd9c52554c9e281912d12e not found: ID does not exist" containerID="9e939e6c0951ce64d67d103339f583dded8273271ffd9c52554c9e281912d12e" Jul 06 23:17:14.491743 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:14.491699 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e939e6c0951ce64d67d103339f583dded8273271ffd9c52554c9e281912d12e"} err="failed to get container status \"9e939e6c0951ce64d67d103339f583dded8273271ffd9c52554c9e281912d12e\": rpc error: code = NotFound desc = could not find container \"9e939e6c0951ce64d67d103339f583dded8273271ffd9c52554c9e281912d12e\": container with ID starting with 9e939e6c0951ce64d67d103339f583dded8273271ffd9c52554c9e281912d12e not found: ID does not exist" Jul 06 23:17:14.501288 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:14.501261 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh"] Jul 06 23:17:14.507277 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:14.507255 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-93d8da3f/e2e-lifecycle-model-93d8da3f-kserve-7cc6b7b84c-wv7nh"] Jul 06 23:17:15.104840 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:15.104793 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea774baa-5cca-484a-af44-c0466d5cac9f" path="/var/lib/kubelet/pods/ea774baa-5cca-484a-af44-c0466d5cac9f/volumes" Jul 06 23:17:34.622007 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:34.621979 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:17:35.561380 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:35.561317 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:17:37.743045 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:37.743014 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:17:40.678433 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:40.678403 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:17:40.735680 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:40.735649 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:17:40.939288 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:40.939195 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:17:41.163996 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:41.163966 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:17:42.244122 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:42.244089 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:17:42.324868 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:42.324832 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:17:42.424632 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:42.424594 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:17:43.131902 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:43.131869 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:17:43.231593 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:43.231513 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:17:43.331193 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:43.331161 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:17:44.696139 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:44.696112 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:17:50.387758 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:50.387714 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:17:50.488166 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:50.488131 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:17:51.069116 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:51.069081 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:17:54.787752 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:54.787718 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:17:54.844318 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:54.844263 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:17:56.830419 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:56.830391 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:17:56.897384 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:56.897340 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:17:56.978300 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:56.978273 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:17:57.078533 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:17:57.078501 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:07.547869 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:07.547826 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:07.886033 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:07.886006 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:28.852959 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:28.852923 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:34.490031 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:34.489985 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:34.589945 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:34.589904 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:34.830344 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:34.830245 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:35.211093 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:35.211059 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:35.659348 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:35.659319 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:38.154444 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:38.154370 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:38.248553 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:38.248512 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:38.374943 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:38.374913 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:38.782726 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:38.782691 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:38.883111 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:38.883078 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:38.982866 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:38.982832 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:42.645016 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:42.644982 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:42.979224 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:42.979118 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:43.347211 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.347183 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c"] Jul 06 23:18:43.347520 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.347508 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea774baa-5cca-484a-af44-c0466d5cac9f" containerName="main" Jul 06 23:18:43.347578 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.347521 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea774baa-5cca-484a-af44-c0466d5cac9f" containerName="main" Jul 06 23:18:43.347616 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.347591 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea774baa-5cca-484a-af44-c0466d5cac9f" containerName="main" Jul 06 23:18:43.350627 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.350609 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.353083 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.353063 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-639686-openshift-default-dockercfg-h2g2p\"" Jul 06 23:18:43.363772 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.363754 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c"] Jul 06 23:18:43.375505 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.375478 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:43.440579 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.440543 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/689dd657-33c2-435b-aeab-dbdd5c441a7a-istiod-ca-cert\") pod \"e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.440749 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.440579 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmw48\" (UniqueName: \"kubernetes.io/projected/689dd657-33c2-435b-aeab-dbdd5c441a7a-kube-api-access-rmw48\") pod \"e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.440749 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.440660 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/689dd657-33c2-435b-aeab-dbdd5c441a7a-istio-token\") pod \"e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.440749 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.440709 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-workload-socket\") pod \"e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.440749 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.440737 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-workload-certs\") pod \"e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.440989 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.440767 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-credential-socket\") pod \"e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.440989 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.440833 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-istio-data\") pod \"e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.440989 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.440878 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-istio-envoy\") pod \"e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.440989 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.440912 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/689dd657-33c2-435b-aeab-dbdd5c441a7a-istio-podinfo\") pod \"e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.541298 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.541262 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/689dd657-33c2-435b-aeab-dbdd5c441a7a-istio-token\") pod \"e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.541499 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.541327 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-workload-socket\") pod \"e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.541499 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.541357 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-workload-certs\") pod \"e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.541499 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.541381 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-credential-socket\") pod \"e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.541499 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.541407 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-istio-data\") pod \"e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.541499 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.541451 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-istio-envoy\") pod \"e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.541499 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.541485 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/689dd657-33c2-435b-aeab-dbdd5c441a7a-istio-podinfo\") pod \"e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.541833 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.541520 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/689dd657-33c2-435b-aeab-dbdd5c441a7a-istiod-ca-cert\") pod \"e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.541833 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.541549 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmw48\" (UniqueName: \"kubernetes.io/projected/689dd657-33c2-435b-aeab-dbdd5c441a7a-kube-api-access-rmw48\") pod \"e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.541833 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.541719 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-workload-socket\") pod \"e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.542010 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.541864 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-credential-socket\") pod \"e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.542010 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.541929 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-istio-data\") pod \"e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.542114 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.542077 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-workload-certs\") pod \"e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.542330 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.542307 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/689dd657-33c2-435b-aeab-dbdd5c441a7a-istiod-ca-cert\") pod \"e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.543190 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.543163 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:43.544023 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.544002 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-istio-envoy\") pod \"e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.544302 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.544274 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/689dd657-33c2-435b-aeab-dbdd5c441a7a-istio-podinfo\") pod \"e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.552305 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.552274 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/689dd657-33c2-435b-aeab-dbdd5c441a7a-istio-token\") pod \"e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.553266 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.553248 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmw48\" (UniqueName: \"kubernetes.io/projected/689dd657-33c2-435b-aeab-dbdd5c441a7a-kube-api-access-rmw48\") pod \"e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.661179 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.661093 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:43.817855 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.817827 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c"] Jul 06 23:18:43.819227 ip-10-0-131-21 kubenswrapper[2566]: W0706 23:18:43.819200 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod689dd657_33c2_435b_aeab_dbdd5c441a7a.slice/crio-997a55b820a698c13adb1a1ba62c91e00a3061698d629540d0988120488bedb7 WatchSource:0}: Error finding container 997a55b820a698c13adb1a1ba62c91e00a3061698d629540d0988120488bedb7: Status 404 returned error can't find the container with id 997a55b820a698c13adb1a1ba62c91e00a3061698d629540d0988120488bedb7 Jul 06 23:18:43.821227 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.821194 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:18:43.821296 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.821261 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:18:43.821337 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.821296 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:18:43.891138 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.891109 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" event={"ID":"689dd657-33c2-435b-aeab-dbdd5c441a7a","Type":"ContainerStarted","Data":"ca47641cd4f7d7f8ac2c52b4423e5085b30b05e4012558f6f733fbd4c7b871bc"} Jul 06 23:18:43.891409 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.891165 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" event={"ID":"689dd657-33c2-435b-aeab-dbdd5c441a7a","Type":"ContainerStarted","Data":"997a55b820a698c13adb1a1ba62c91e00a3061698d629540d0988120488bedb7"} Jul 06 23:18:43.934637 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:43.933717 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" podStartSLOduration=0.933695815 podStartE2EDuration="933.695815ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:18:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:18:43.933475279 +0000 UTC m=+1953.398777562" watchObservedRunningTime="2026-07-06 23:18:43.933695815 +0000 UTC m=+1953.398998098" Jul 06 23:18:44.661974 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:44.661937 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:44.666712 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:44.666687 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:44.896181 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:44.896152 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:44.897240 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:44.897216 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:18:45.825726 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:45.825691 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:45.913674 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:45.913646 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:45.982728 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:45.982697 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:46.292158 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:46.292129 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:46.481390 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:46.481359 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:46.582533 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:46.582453 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:50.321315 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:50.321284 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:55.344421 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.341147 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g"] Jul 06 23:18:55.345492 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.345467 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" Jul 06 23:18:55.349154 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.349112 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-056fae\"/\"default-dockercfg-2g2mc\"" Jul 06 23:18:55.349154 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.349131 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-056fae\"/\"kube-root-ca.crt\"" Jul 06 23:18:55.349356 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.349178 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-056fae\"/\"openshift-service-ca.crt\"" Jul 06 23:18:55.349356 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.349256 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-056fae\"/\"test-model-056fae-kserve-self-signed-certs\"" Jul 06 23:18:55.356590 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.356470 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g"] Jul 06 23:18:55.378673 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.378634 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:55.457156 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.457117 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ca85a23-66ab-4f94-8b07-283d2f009cd2-dshm\") pod \"test-model-056fae-kserve-db4bf77f5-ww46g\" (UID: \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\") " pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" Jul 06 23:18:55.457356 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.457170 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ca85a23-66ab-4f94-8b07-283d2f009cd2-tls-certs\") pod \"test-model-056fae-kserve-db4bf77f5-ww46g\" (UID: \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\") " pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" Jul 06 23:18:55.457356 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.457190 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb66p\" (UniqueName: \"kubernetes.io/projected/7ca85a23-66ab-4f94-8b07-283d2f009cd2-kube-api-access-zb66p\") pod \"test-model-056fae-kserve-db4bf77f5-ww46g\" (UID: \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\") " pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" Jul 06 23:18:55.457356 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.457296 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ca85a23-66ab-4f94-8b07-283d2f009cd2-model-cache\") pod \"test-model-056fae-kserve-db4bf77f5-ww46g\" (UID: \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\") " pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" Jul 06 23:18:55.457356 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.457334 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ca85a23-66ab-4f94-8b07-283d2f009cd2-home\") pod \"test-model-056fae-kserve-db4bf77f5-ww46g\" (UID: \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\") " pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" Jul 06 23:18:55.457356 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.457352 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ca85a23-66ab-4f94-8b07-283d2f009cd2-tmp-dir\") pod \"test-model-056fae-kserve-db4bf77f5-ww46g\" (UID: \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\") " pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" Jul 06 23:18:55.558595 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.558557 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ca85a23-66ab-4f94-8b07-283d2f009cd2-dshm\") pod \"test-model-056fae-kserve-db4bf77f5-ww46g\" (UID: \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\") " pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" Jul 06 23:18:55.558595 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.558607 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ca85a23-66ab-4f94-8b07-283d2f009cd2-tls-certs\") pod \"test-model-056fae-kserve-db4bf77f5-ww46g\" (UID: \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\") " pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" Jul 06 23:18:55.558897 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.558624 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb66p\" (UniqueName: \"kubernetes.io/projected/7ca85a23-66ab-4f94-8b07-283d2f009cd2-kube-api-access-zb66p\") pod \"test-model-056fae-kserve-db4bf77f5-ww46g\" (UID: \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\") " pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" Jul 06 23:18:55.558897 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.558655 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ca85a23-66ab-4f94-8b07-283d2f009cd2-model-cache\") pod \"test-model-056fae-kserve-db4bf77f5-ww46g\" (UID: \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\") " pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" Jul 06 23:18:55.558897 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.558676 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ca85a23-66ab-4f94-8b07-283d2f009cd2-home\") pod \"test-model-056fae-kserve-db4bf77f5-ww46g\" (UID: \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\") " pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" Jul 06 23:18:55.558897 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.558689 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ca85a23-66ab-4f94-8b07-283d2f009cd2-tmp-dir\") pod \"test-model-056fae-kserve-db4bf77f5-ww46g\" (UID: \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\") " pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" Jul 06 23:18:55.559132 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.559110 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ca85a23-66ab-4f94-8b07-283d2f009cd2-tmp-dir\") pod \"test-model-056fae-kserve-db4bf77f5-ww46g\" (UID: \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\") " pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" Jul 06 23:18:55.559186 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.559164 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ca85a23-66ab-4f94-8b07-283d2f009cd2-model-cache\") pod \"test-model-056fae-kserve-db4bf77f5-ww46g\" (UID: \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\") " pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" Jul 06 23:18:55.559245 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.559229 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ca85a23-66ab-4f94-8b07-283d2f009cd2-home\") pod \"test-model-056fae-kserve-db4bf77f5-ww46g\" (UID: \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\") " pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" Jul 06 23:18:55.561499 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.561477 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ca85a23-66ab-4f94-8b07-283d2f009cd2-dshm\") pod \"test-model-056fae-kserve-db4bf77f5-ww46g\" (UID: \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\") " pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" Jul 06 23:18:55.561643 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.561625 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ca85a23-66ab-4f94-8b07-283d2f009cd2-tls-certs\") pod \"test-model-056fae-kserve-db4bf77f5-ww46g\" (UID: \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\") " pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" Jul 06 23:18:55.567163 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.567139 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb66p\" (UniqueName: \"kubernetes.io/projected/7ca85a23-66ab-4f94-8b07-283d2f009cd2-kube-api-access-zb66p\") pod \"test-model-056fae-kserve-db4bf77f5-ww46g\" (UID: \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\") " pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" Jul 06 23:18:55.657886 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.657766 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" Jul 06 23:18:55.813309 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.813285 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g"] Jul 06 23:18:55.836043 ip-10-0-131-21 kubenswrapper[2566]: W0706 23:18:55.835901 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ca85a23_66ab_4f94_8b07_283d2f009cd2.slice/crio-c4c5b70f4c9606096267518923696daa4e0a08083659d18f130e286863990d9e WatchSource:0}: Error finding container c4c5b70f4c9606096267518923696daa4e0a08083659d18f130e286863990d9e: Status 404 returned error can't find the container with id c4c5b70f4c9606096267518923696daa4e0a08083659d18f130e286863990d9e Jul 06 23:18:55.955223 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.955181 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" event={"ID":"7ca85a23-66ab-4f94-8b07-283d2f009cd2","Type":"ContainerStarted","Data":"8c4363c37d8823ce5d75b0c7d8507876967b72f5bcd360a60363683492e63d4c"} Jul 06 23:18:55.955223 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.955230 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" event={"ID":"7ca85a23-66ab-4f94-8b07-283d2f009cd2","Type":"ContainerStarted","Data":"c4c5b70f4c9606096267518923696daa4e0a08083659d18f130e286863990d9e"} Jul 06 23:18:55.973828 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:55.973762 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" podStartSLOduration=0.973745893 podStartE2EDuration="973.745893ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:18:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:18:55.972167262 +0000 UTC m=+1965.437469568" watchObservedRunningTime="2026-07-06 23:18:55.973745893 +0000 UTC m=+1965.439048175" Jul 06 23:18:59.791883 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:59.791780 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:59.892532 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:59.892485 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:18:59.897659 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:59.897633 2566 patch_prober.go:28] interesting pod/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jul 06 23:18:59.897799 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:59.897684 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" podUID="689dd657-33c2-435b-aeab-dbdd5c441a7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jul 06 23:18:59.975037 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:59.975007 2566 generic.go:356] "Generic (PLEG): container finished" podID="689dd657-33c2-435b-aeab-dbdd5c441a7a" containerID="ca47641cd4f7d7f8ac2c52b4423e5085b30b05e4012558f6f733fbd4c7b871bc" exitCode=0 Jul 06 23:18:59.975215 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:59.975082 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" event={"ID":"689dd657-33c2-435b-aeab-dbdd5c441a7a","Type":"ContainerDied","Data":"ca47641cd4f7d7f8ac2c52b4423e5085b30b05e4012558f6f733fbd4c7b871bc"} Jul 06 23:18:59.975517 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:59.975501 2566 scope.go:117] "RemoveContainer" containerID="ca47641cd4f7d7f8ac2c52b4423e5085b30b05e4012558f6f733fbd4c7b871bc" Jul 06 23:18:59.976533 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:59.976501 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:18:59.976657 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:59.976584 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:18:59.976657 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:18:59.976633 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:19:00.981411 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:00.981381 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" event={"ID":"689dd657-33c2-435b-aeab-dbdd5c441a7a","Type":"ContainerStarted","Data":"85a75d09eb23d36af04b05200d157194810b2746786b8cba34abf723c3cef8c4"} Jul 06 23:19:01.661756 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:01.661717 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:19:01.662014 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:01.661991 2566 patch_prober.go:28] interesting pod/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jul 06 23:19:01.662106 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:01.662050 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" podUID="689dd657-33c2-435b-aeab-dbdd5c441a7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jul 06 23:19:02.661766 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:02.661680 2566 patch_prober.go:28] interesting pod/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jul 06 23:19:02.661766 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:02.661738 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" podUID="689dd657-33c2-435b-aeab-dbdd5c441a7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jul 06 23:19:03.662275 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:03.662238 2566 patch_prober.go:28] interesting pod/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jul 06 23:19:03.662673 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:03.662294 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" podUID="689dd657-33c2-435b-aeab-dbdd5c441a7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jul 06 23:19:04.661969 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:04.661932 2566 patch_prober.go:28] interesting pod/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jul 06 23:19:04.662156 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:04.661984 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" podUID="689dd657-33c2-435b-aeab-dbdd5c441a7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jul 06 23:19:05.658334 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:05.658296 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" Jul 06 23:19:05.658847 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:05.658354 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" Jul 06 23:19:05.665646 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:05.665619 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:19:05.666075 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:05.666058 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:19:05.666767 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:05.666749 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:19:05.677594 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:05.677570 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" Jul 06 23:19:06.015661 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:06.015578 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" Jul 06 23:19:08.110119 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:08.110085 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:19:08.207596 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:08.207567 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:19:22.416483 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:22.416446 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:19:48.821229 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:48.821194 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g"] Jul 06 23:19:48.843488 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:48.843454 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:19:49.730290 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:49.730255 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:19:49.896056 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:49.896011 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:19:50.312771 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:50.312724 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:19:50.437802 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:50.437755 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:19:50.538785 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:50.538756 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:19:50.685107 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:50.685068 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:19:54.588421 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:54.588377 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:19:55.387147 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:19:55.387107 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:03.841535 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:03.841460 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" podUID="7ca85a23-66ab-4f94-8b07-283d2f009cd2" containerName="main" containerID="cri-o://8c4363c37d8823ce5d75b0c7d8507876967b72f5bcd360a60363683492e63d4c" gracePeriod=45 Jul 06 23:20:04.088375 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:04.088350 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" Jul 06 23:20:04.216976 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:04.216935 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ca85a23-66ab-4f94-8b07-283d2f009cd2-model-cache\") pod \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\" (UID: \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\") " Jul 06 23:20:04.217179 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:04.217006 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ca85a23-66ab-4f94-8b07-283d2f009cd2-tls-certs\") pod \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\" (UID: \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\") " Jul 06 23:20:04.217179 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:04.217049 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zb66p\" (UniqueName: \"kubernetes.io/projected/7ca85a23-66ab-4f94-8b07-283d2f009cd2-kube-api-access-zb66p\") pod \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\" (UID: \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\") " Jul 06 23:20:04.217179 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:04.217168 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ca85a23-66ab-4f94-8b07-283d2f009cd2-dshm\") pod \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\" (UID: \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\") " Jul 06 23:20:04.217364 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:04.217190 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ca85a23-66ab-4f94-8b07-283d2f009cd2-tmp-dir\") pod \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\" (UID: \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\") " Jul 06 23:20:04.217364 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:04.217209 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ca85a23-66ab-4f94-8b07-283d2f009cd2-model-cache" (OuterVolumeSpecName: "model-cache") pod "7ca85a23-66ab-4f94-8b07-283d2f009cd2" (UID: "7ca85a23-66ab-4f94-8b07-283d2f009cd2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:20:04.217364 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:04.217218 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ca85a23-66ab-4f94-8b07-283d2f009cd2-home\") pod \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\" (UID: \"7ca85a23-66ab-4f94-8b07-283d2f009cd2\") " Jul 06 23:20:04.217520 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:04.217481 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ca85a23-66ab-4f94-8b07-283d2f009cd2-home" (OuterVolumeSpecName: "home") pod "7ca85a23-66ab-4f94-8b07-283d2f009cd2" (UID: "7ca85a23-66ab-4f94-8b07-283d2f009cd2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:20:04.217625 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:04.217597 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ca85a23-66ab-4f94-8b07-283d2f009cd2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7ca85a23-66ab-4f94-8b07-283d2f009cd2" (UID: "7ca85a23-66ab-4f94-8b07-283d2f009cd2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:20:04.217706 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:04.217690 2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ca85a23-66ab-4f94-8b07-283d2f009cd2-model-cache\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:20:04.217765 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:04.217710 2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ca85a23-66ab-4f94-8b07-283d2f009cd2-tmp-dir\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:20:04.217765 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:04.217723 2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ca85a23-66ab-4f94-8b07-283d2f009cd2-home\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:20:04.219439 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:04.219413 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ca85a23-66ab-4f94-8b07-283d2f009cd2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7ca85a23-66ab-4f94-8b07-283d2f009cd2" (UID: "7ca85a23-66ab-4f94-8b07-283d2f009cd2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:20:04.219552 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:04.219494 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ca85a23-66ab-4f94-8b07-283d2f009cd2-kube-api-access-zb66p" (OuterVolumeSpecName: "kube-api-access-zb66p") pod "7ca85a23-66ab-4f94-8b07-283d2f009cd2" (UID: "7ca85a23-66ab-4f94-8b07-283d2f009cd2"). InnerVolumeSpecName "kube-api-access-zb66p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:20:04.219699 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:04.219682 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ca85a23-66ab-4f94-8b07-283d2f009cd2-dshm" (OuterVolumeSpecName: "dshm") pod "7ca85a23-66ab-4f94-8b07-283d2f009cd2" (UID: "7ca85a23-66ab-4f94-8b07-283d2f009cd2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:20:04.278909 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:04.278875 2566 generic.go:356] "Generic (PLEG): container finished" podID="7ca85a23-66ab-4f94-8b07-283d2f009cd2" containerID="8c4363c37d8823ce5d75b0c7d8507876967b72f5bcd360a60363683492e63d4c" exitCode=0 Jul 06 23:20:04.279076 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:04.278922 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" Jul 06 23:20:04.279076 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:04.278929 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" event={"ID":"7ca85a23-66ab-4f94-8b07-283d2f009cd2","Type":"ContainerDied","Data":"8c4363c37d8823ce5d75b0c7d8507876967b72f5bcd360a60363683492e63d4c"} Jul 06 23:20:04.279076 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:04.278965 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g" event={"ID":"7ca85a23-66ab-4f94-8b07-283d2f009cd2","Type":"ContainerDied","Data":"c4c5b70f4c9606096267518923696daa4e0a08083659d18f130e286863990d9e"} Jul 06 23:20:04.279076 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:04.278982 2566 scope.go:117] "RemoveContainer" containerID="8c4363c37d8823ce5d75b0c7d8507876967b72f5bcd360a60363683492e63d4c" Jul 06 23:20:04.287707 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:04.287690 2566 scope.go:117] "RemoveContainer" containerID="8c4363c37d8823ce5d75b0c7d8507876967b72f5bcd360a60363683492e63d4c" Jul 06 23:20:04.288045 ip-10-0-131-21 kubenswrapper[2566]: E0706 23:20:04.288026 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c4363c37d8823ce5d75b0c7d8507876967b72f5bcd360a60363683492e63d4c\": container with ID starting with 8c4363c37d8823ce5d75b0c7d8507876967b72f5bcd360a60363683492e63d4c not found: ID does not exist" containerID="8c4363c37d8823ce5d75b0c7d8507876967b72f5bcd360a60363683492e63d4c" Jul 06 23:20:04.288112 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:04.288054 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c4363c37d8823ce5d75b0c7d8507876967b72f5bcd360a60363683492e63d4c"} err="failed to get container status \"8c4363c37d8823ce5d75b0c7d8507876967b72f5bcd360a60363683492e63d4c\": rpc error: code = NotFound desc = could not find container \"8c4363c37d8823ce5d75b0c7d8507876967b72f5bcd360a60363683492e63d4c\": container with ID starting with 8c4363c37d8823ce5d75b0c7d8507876967b72f5bcd360a60363683492e63d4c not found: ID does not exist" Jul 06 23:20:04.299262 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:04.299240 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g"] Jul 06 23:20:04.302843 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:04.302823 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-056fae/test-model-056fae-kserve-db4bf77f5-ww46g"] Jul 06 23:20:04.318679 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:04.318659 2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ca85a23-66ab-4f94-8b07-283d2f009cd2-dshm\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:20:04.318752 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:04.318685 2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ca85a23-66ab-4f94-8b07-283d2f009cd2-tls-certs\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:20:04.318752 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:04.318702 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zb66p\" (UniqueName: \"kubernetes.io/projected/7ca85a23-66ab-4f94-8b07-283d2f009cd2-kube-api-access-zb66p\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:20:05.106045 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:05.106005 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ca85a23-66ab-4f94-8b07-283d2f009cd2" path="/var/lib/kubelet/pods/7ca85a23-66ab-4f94-8b07-283d2f009cd2/volumes" Jul 06 23:20:32.211086 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:32.211045 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:32.491080 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:32.490944 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:32.726860 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:32.726825 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:32.890525 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:32.890495 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:33.389041 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:33.388995 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:33.540900 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:33.540868 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:33.643167 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:33.643082 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:33.803102 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:33.803077 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:39.728416 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:39.728381 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:39.829107 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:39.829074 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:39.973916 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:39.973883 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c"] Jul 06 23:20:39.974162 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:39.974140 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" podUID="689dd657-33c2-435b-aeab-dbdd5c441a7a" containerName="istio-proxy" containerID="cri-o://85a75d09eb23d36af04b05200d157194810b2746786b8cba34abf723c3cef8c4" gracePeriod=30 Jul 06 23:20:40.000952 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:40.000872 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:40.228043 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:40.228010 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:40.550062 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:40.550018 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:40.911033 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:40.910994 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:41.108681 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:41.108651 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:43.748739 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:43.748678 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:43.841844 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:43.841796 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:43.937977 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:43.937951 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:44.487653 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:44.487617 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:44.587777 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:44.587745 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:45.225956 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.225929 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:20:45.363745 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.363718 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-istio-data\") pod \"689dd657-33c2-435b-aeab-dbdd5c441a7a\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " Jul 06 23:20:45.363996 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.363752 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-istio-envoy\") pod \"689dd657-33c2-435b-aeab-dbdd5c441a7a\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " Jul 06 23:20:45.363996 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.363789 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/689dd657-33c2-435b-aeab-dbdd5c441a7a-istio-token\") pod \"689dd657-33c2-435b-aeab-dbdd5c441a7a\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " Jul 06 23:20:45.363996 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.363823 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-workload-certs\") pod \"689dd657-33c2-435b-aeab-dbdd5c441a7a\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " Jul 06 23:20:45.363996 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.363928 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmw48\" (UniqueName: \"kubernetes.io/projected/689dd657-33c2-435b-aeab-dbdd5c441a7a-kube-api-access-rmw48\") pod \"689dd657-33c2-435b-aeab-dbdd5c441a7a\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " Jul 06 23:20:45.363996 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.363973 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/689dd657-33c2-435b-aeab-dbdd5c441a7a-istio-podinfo\") pod \"689dd657-33c2-435b-aeab-dbdd5c441a7a\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " Jul 06 23:20:45.364277 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.364040 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-credential-socket\") pod \"689dd657-33c2-435b-aeab-dbdd5c441a7a\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " Jul 06 23:20:45.364277 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.364060 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/689dd657-33c2-435b-aeab-dbdd5c441a7a-istiod-ca-cert\") pod \"689dd657-33c2-435b-aeab-dbdd5c441a7a\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " Jul 06 23:20:45.364277 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.364090 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-workload-socket\") pod \"689dd657-33c2-435b-aeab-dbdd5c441a7a\" (UID: \"689dd657-33c2-435b-aeab-dbdd5c441a7a\") " Jul 06 23:20:45.364277 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.364132 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "689dd657-33c2-435b-aeab-dbdd5c441a7a" (UID: "689dd657-33c2-435b-aeab-dbdd5c441a7a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:20:45.364488 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.364371 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "689dd657-33c2-435b-aeab-dbdd5c441a7a" (UID: "689dd657-33c2-435b-aeab-dbdd5c441a7a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:20:45.364549 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.364485 2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-credential-socket\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:20:45.364549 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.364505 2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-workload-certs\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:20:45.364745 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.364723 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "689dd657-33c2-435b-aeab-dbdd5c441a7a" (UID: "689dd657-33c2-435b-aeab-dbdd5c441a7a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:20:45.364832 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.364745 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/689dd657-33c2-435b-aeab-dbdd5c441a7a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "689dd657-33c2-435b-aeab-dbdd5c441a7a" (UID: "689dd657-33c2-435b-aeab-dbdd5c441a7a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:20:45.364832 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.364772 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-istio-data" (OuterVolumeSpecName: "istio-data") pod "689dd657-33c2-435b-aeab-dbdd5c441a7a" (UID: "689dd657-33c2-435b-aeab-dbdd5c441a7a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:20:45.366241 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.366210 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/689dd657-33c2-435b-aeab-dbdd5c441a7a-kube-api-access-rmw48" (OuterVolumeSpecName: "kube-api-access-rmw48") pod "689dd657-33c2-435b-aeab-dbdd5c441a7a" (UID: "689dd657-33c2-435b-aeab-dbdd5c441a7a"). InnerVolumeSpecName "kube-api-access-rmw48". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:20:45.366350 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.366251 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "689dd657-33c2-435b-aeab-dbdd5c441a7a" (UID: "689dd657-33c2-435b-aeab-dbdd5c441a7a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:20:45.366350 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.366257 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/689dd657-33c2-435b-aeab-dbdd5c441a7a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "689dd657-33c2-435b-aeab-dbdd5c441a7a" (UID: "689dd657-33c2-435b-aeab-dbdd5c441a7a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 23:20:45.366350 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.366307 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/689dd657-33c2-435b-aeab-dbdd5c441a7a-istio-token" (OuterVolumeSpecName: "istio-token") pod "689dd657-33c2-435b-aeab-dbdd5c441a7a" (UID: "689dd657-33c2-435b-aeab-dbdd5c441a7a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:20:45.465343 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.465311 2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/689dd657-33c2-435b-aeab-dbdd5c441a7a-istio-token\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:20:45.465343 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.465338 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmw48\" (UniqueName: \"kubernetes.io/projected/689dd657-33c2-435b-aeab-dbdd5c441a7a-kube-api-access-rmw48\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:20:45.465343 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.465348 2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/689dd657-33c2-435b-aeab-dbdd5c441a7a-istio-podinfo\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:20:45.465572 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.465356 2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/689dd657-33c2-435b-aeab-dbdd5c441a7a-istiod-ca-cert\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:20:45.465572 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.465364 2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-workload-socket\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:20:45.465572 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.465372 2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-istio-data\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:20:45.465572 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.465380 2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/689dd657-33c2-435b-aeab-dbdd5c441a7a-istio-envoy\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:20:45.474743 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.474716 2566 generic.go:356] "Generic (PLEG): container finished" podID="689dd657-33c2-435b-aeab-dbdd5c441a7a" containerID="85a75d09eb23d36af04b05200d157194810b2746786b8cba34abf723c3cef8c4" exitCode=0 Jul 06 23:20:45.474922 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.474762 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" event={"ID":"689dd657-33c2-435b-aeab-dbdd5c441a7a","Type":"ContainerDied","Data":"85a75d09eb23d36af04b05200d157194810b2746786b8cba34abf723c3cef8c4"} Jul 06 23:20:45.474922 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.474766 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" Jul 06 23:20:45.474922 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.474803 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c" event={"ID":"689dd657-33c2-435b-aeab-dbdd5c441a7a","Type":"ContainerDied","Data":"997a55b820a698c13adb1a1ba62c91e00a3061698d629540d0988120488bedb7"} Jul 06 23:20:45.474922 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.474834 2566 scope.go:117] "RemoveContainer" containerID="85a75d09eb23d36af04b05200d157194810b2746786b8cba34abf723c3cef8c4" Jul 06 23:20:45.484344 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.484326 2566 scope.go:117] "RemoveContainer" containerID="ca47641cd4f7d7f8ac2c52b4423e5085b30b05e4012558f6f733fbd4c7b871bc" Jul 06 23:20:45.492247 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.492227 2566 scope.go:117] "RemoveContainer" containerID="85a75d09eb23d36af04b05200d157194810b2746786b8cba34abf723c3cef8c4" Jul 06 23:20:45.492513 ip-10-0-131-21 kubenswrapper[2566]: E0706 23:20:45.492494 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85a75d09eb23d36af04b05200d157194810b2746786b8cba34abf723c3cef8c4\": container with ID starting with 85a75d09eb23d36af04b05200d157194810b2746786b8cba34abf723c3cef8c4 not found: ID does not exist" containerID="85a75d09eb23d36af04b05200d157194810b2746786b8cba34abf723c3cef8c4" Jul 06 23:20:45.492600 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.492523 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85a75d09eb23d36af04b05200d157194810b2746786b8cba34abf723c3cef8c4"} err="failed to get container status \"85a75d09eb23d36af04b05200d157194810b2746786b8cba34abf723c3cef8c4\": rpc error: code = NotFound desc = could not find container \"85a75d09eb23d36af04b05200d157194810b2746786b8cba34abf723c3cef8c4\": container with ID starting with 85a75d09eb23d36af04b05200d157194810b2746786b8cba34abf723c3cef8c4 not found: ID does not exist" Jul 06 23:20:45.492600 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.492540 2566 scope.go:117] "RemoveContainer" containerID="ca47641cd4f7d7f8ac2c52b4423e5085b30b05e4012558f6f733fbd4c7b871bc" Jul 06 23:20:45.492789 ip-10-0-131-21 kubenswrapper[2566]: E0706 23:20:45.492773 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca47641cd4f7d7f8ac2c52b4423e5085b30b05e4012558f6f733fbd4c7b871bc\": container with ID starting with ca47641cd4f7d7f8ac2c52b4423e5085b30b05e4012558f6f733fbd4c7b871bc not found: ID does not exist" containerID="ca47641cd4f7d7f8ac2c52b4423e5085b30b05e4012558f6f733fbd4c7b871bc" Jul 06 23:20:45.492856 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.492792 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca47641cd4f7d7f8ac2c52b4423e5085b30b05e4012558f6f733fbd4c7b871bc"} err="failed to get container status \"ca47641cd4f7d7f8ac2c52b4423e5085b30b05e4012558f6f733fbd4c7b871bc\": rpc error: code = NotFound desc = could not find container \"ca47641cd4f7d7f8ac2c52b4423e5085b30b05e4012558f6f733fbd4c7b871bc\": container with ID starting with ca47641cd4f7d7f8ac2c52b4423e5085b30b05e4012558f6f733fbd4c7b871bc not found: ID does not exist" Jul 06 23:20:45.498527 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.498501 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c"] Jul 06 23:20:45.502908 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:45.502884 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-639686-openshift-default-754f979f7f-6qz8c"] Jul 06 23:20:47.105118 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:47.105085 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="689dd657-33c2-435b-aeab-dbdd5c441a7a" path="/var/lib/kubelet/pods/689dd657-33c2-435b-aeab-dbdd5c441a7a/volumes" Jul 06 23:20:48.248089 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:48.248054 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:48.693318 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:48.693288 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:48.976712 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:48.976632 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf"] Jul 06 23:20:48.977155 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:48.977141 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="689dd657-33c2-435b-aeab-dbdd5c441a7a" containerName="istio-proxy" Jul 06 23:20:48.977219 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:48.977159 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="689dd657-33c2-435b-aeab-dbdd5c441a7a" containerName="istio-proxy" Jul 06 23:20:48.977219 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:48.977187 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ca85a23-66ab-4f94-8b07-283d2f009cd2" containerName="main" Jul 06 23:20:48.977219 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:48.977195 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ca85a23-66ab-4f94-8b07-283d2f009cd2" containerName="main" Jul 06 23:20:48.977326 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:48.977284 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="689dd657-33c2-435b-aeab-dbdd5c441a7a" containerName="istio-proxy" Jul 06 23:20:48.977326 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:48.977300 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ca85a23-66ab-4f94-8b07-283d2f009cd2" containerName="main" Jul 06 23:20:48.982026 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:48.982006 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:48.985320 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:48.985299 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-d792b0-openshift-default-dockercfg-88gk6\"" Jul 06 23:20:49.000645 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.000617 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf"] Jul 06 23:20:49.016046 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.016018 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:49.099664 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.099633 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istio-data\") pod \"e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:49.099861 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.099689 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istio-podinfo\") pod \"e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:49.099861 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.099720 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnrhh\" (UniqueName: \"kubernetes.io/projected/5b0eeb84-479b-4fb3-ad6b-6a64645be526-kube-api-access-xnrhh\") pod \"e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:49.099861 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.099751 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istiod-ca-cert\") pod \"e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:49.099861 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.099787 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istio-token\") pod \"e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:49.100016 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.099931 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istio-envoy\") pod \"e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:49.100016 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.099969 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-workload-socket\") pod \"e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:49.100091 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.100019 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-credential-socket\") pod \"e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:49.100091 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.100048 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-workload-certs\") pod \"e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:49.137350 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.137315 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:49.201315 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.201279 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-workload-socket\") pod \"e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:49.201315 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.201317 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-credential-socket\") pod \"e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:49.201556 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.201342 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-workload-certs\") pod \"e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:49.201556 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.201409 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istio-data\") pod \"e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:49.201556 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.201449 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istio-podinfo\") pod \"e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:49.201556 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.201471 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnrhh\" (UniqueName: \"kubernetes.io/projected/5b0eeb84-479b-4fb3-ad6b-6a64645be526-kube-api-access-xnrhh\") pod \"e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:49.201556 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.201498 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istiod-ca-cert\") pod \"e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:49.201793 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.201577 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istio-token\") pod \"e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:49.201793 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.201651 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istio-envoy\") pod \"e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:49.201793 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.201715 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-workload-socket\") pod \"e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:49.201793 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.201765 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-workload-certs\") pod \"e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:49.202033 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.201847 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-credential-socket\") pod \"e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:49.202097 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.202079 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istio-data\") pod \"e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:49.202222 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.202204 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istiod-ca-cert\") pod \"e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:49.203967 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.203945 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istio-envoy\") pod \"e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:49.204203 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.204180 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istio-podinfo\") pod \"e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:49.210906 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.210877 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istio-token\") pod \"e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:49.211133 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.211114 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnrhh\" (UniqueName: \"kubernetes.io/projected/5b0eeb84-479b-4fb3-ad6b-6a64645be526-kube-api-access-xnrhh\") pod \"e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:49.293629 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.293531 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:49.433292 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.433260 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf"] Jul 06 23:20:49.435355 ip-10-0-131-21 kubenswrapper[2566]: W0706 23:20:49.435331 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b0eeb84_479b_4fb3_ad6b_6a64645be526.slice/crio-6b541f158bfefa9cefa38c199fc9a46cecc0e1a77b1510c5f8cb3a4c604d6375 WatchSource:0}: Error finding container 6b541f158bfefa9cefa38c199fc9a46cecc0e1a77b1510c5f8cb3a4c604d6375: Status 404 returned error can't find the container with id 6b541f158bfefa9cefa38c199fc9a46cecc0e1a77b1510c5f8cb3a4c604d6375 Jul 06 23:20:49.437943 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.437910 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:20:49.438040 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.437977 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:20:49.438040 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.438007 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:20:49.494975 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:49.494948 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" event={"ID":"5b0eeb84-479b-4fb3-ad6b-6a64645be526","Type":"ContainerStarted","Data":"6b541f158bfefa9cefa38c199fc9a46cecc0e1a77b1510c5f8cb3a4c604d6375"} Jul 06 23:20:50.501405 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:50.501363 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" event={"ID":"5b0eeb84-479b-4fb3-ad6b-6a64645be526","Type":"ContainerStarted","Data":"533b2f75a4c6f0eeb6db00758e91f57702e17029951cca8f5e72963e616c216e"} Jul 06 23:20:50.525856 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:50.525788 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" podStartSLOduration=2.52577268 podStartE2EDuration="2.52577268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:20:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:20:50.523924323 +0000 UTC m=+2079.989226606" watchObservedRunningTime="2026-07-06 23:20:50.52577268 +0000 UTC m=+2079.991074962" Jul 06 23:20:51.294150 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:51.294105 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:51.299157 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:51.299128 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:51.505753 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:51.505720 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:51.506820 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:51.506785 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:20:52.453323 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:52.453285 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:52.553530 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:52.553499 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:52.759702 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:52.759614 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:53.017189 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:53.017101 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:53.133273 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:53.133235 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:53.233339 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:53.233304 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:20:56.937849 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:20:56.937795 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:04.978582 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:04.978544 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:05.313606 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:05.313569 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:05.413640 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:05.413601 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:05.615412 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:05.615379 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:07.315756 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:07.315046 2566 patch_prober.go:28] interesting pod/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": read tcp 10.132.0.2:39182->10.132.0.40:15021: read: connection reset by peer" start-of-body= Jul 06 23:21:07.315756 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:07.315111 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" podUID="5b0eeb84-479b-4fb3-ad6b-6a64645be526" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": read tcp 10.132.0.2:39182->10.132.0.40:15021: read: connection reset by peer" Jul 06 23:21:07.585601 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:07.585498 2566 generic.go:356] "Generic (PLEG): container finished" podID="5b0eeb84-479b-4fb3-ad6b-6a64645be526" containerID="533b2f75a4c6f0eeb6db00758e91f57702e17029951cca8f5e72963e616c216e" exitCode=0 Jul 06 23:21:07.585601 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:07.585566 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" event={"ID":"5b0eeb84-479b-4fb3-ad6b-6a64645be526","Type":"ContainerDied","Data":"533b2f75a4c6f0eeb6db00758e91f57702e17029951cca8f5e72963e616c216e"} Jul 06 23:21:07.585994 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:07.585980 2566 scope.go:117] "RemoveContainer" containerID="533b2f75a4c6f0eeb6db00758e91f57702e17029951cca8f5e72963e616c216e" Jul 06 23:21:07.587006 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:07.586978 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:21:07.587072 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:07.587058 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:21:07.587112 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:07.587098 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:21:08.591545 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:08.591501 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" event={"ID":"5b0eeb84-479b-4fb3-ad6b-6a64645be526","Type":"ContainerStarted","Data":"2f0b59e620f54621d3b76a5184298142de687d1685442b9ab13285983dcb97f4"} Jul 06 23:21:09.294227 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:09.294191 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:21:09.294427 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:09.294407 2566 patch_prober.go:28] interesting pod/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 06 23:21:09.294490 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:09.294469 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" podUID="5b0eeb84-479b-4fb3-ad6b-6a64645be526" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 06 23:21:10.294782 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:10.294744 2566 patch_prober.go:28] interesting pod/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 06 23:21:10.295209 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:10.294841 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" podUID="5b0eeb84-479b-4fb3-ad6b-6a64645be526" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 06 23:21:11.103545 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:11.103520 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rtzxs_1dc50270-5e71-4a7b-8160-9041cbc18cd9/console-operator/2.log" Jul 06 23:21:11.106312 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:11.106284 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rtzxs_1dc50270-5e71-4a7b-8160-9041cbc18cd9/console-operator/2.log" Jul 06 23:21:11.242446 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:11.242413 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:11.294238 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:11.294202 2566 patch_prober.go:28] interesting pod/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 06 23:21:11.294418 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:11.294258 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" podUID="5b0eeb84-479b-4fb3-ad6b-6a64645be526" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 06 23:21:11.341294 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:11.341250 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:11.504337 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:11.504239 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:11.718580 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:11.718530 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:11.895278 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:11.895248 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:12.294362 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:12.294268 2566 patch_prober.go:28] interesting pod/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 06 23:21:12.294362 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:12.294338 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" podUID="5b0eeb84-479b-4fb3-ad6b-6a64645be526" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 06 23:21:12.383719 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:12.383685 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:12.486006 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:12.485974 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:12.587968 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:12.587883 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:12.743527 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:12.743499 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:13.298143 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:13.298112 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:21:13.298440 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:13.298418 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:21:13.299038 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:13.299018 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:21:18.557169 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:18.557134 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:18.648972 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:18.648936 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:18.752126 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:18.752088 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf"] Jul 06 23:21:18.752442 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:18.752415 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" podUID="5b0eeb84-479b-4fb3-ad6b-6a64645be526" containerName="istio-proxy" containerID="cri-o://2f0b59e620f54621d3b76a5184298142de687d1685442b9ab13285983dcb97f4" gracePeriod=30 Jul 06 23:21:18.779909 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:18.779853 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:19.031003 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:19.030971 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:19.373559 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:19.373532 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:19.706273 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:19.706186 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:19.813048 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:19.813015 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:22.956984 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:22.956956 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:23.069751 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:23.069723 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:23.194666 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:23.194631 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:23.429895 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:23.429862 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:23.555124 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:23.555094 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:23.656635 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:23.656605 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:24.005019 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.004992 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:21:24.141564 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.141529 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-workload-certs\") pod \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " Jul 06 23:21:24.141564 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.141566 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istiod-ca-cert\") pod \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " Jul 06 23:21:24.141793 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.141595 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istio-token\") pod \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " Jul 06 23:21:24.141793 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.141616 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istio-envoy\") pod \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " Jul 06 23:21:24.141793 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.141704 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-workload-socket\") pod \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " Jul 06 23:21:24.141793 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.141729 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-credential-socket\") pod \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " Jul 06 23:21:24.141793 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.141755 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istio-podinfo\") pod \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " Jul 06 23:21:24.141793 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.141782 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istio-data\") pod \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " Jul 06 23:21:24.142176 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.141850 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnrhh\" (UniqueName: \"kubernetes.io/projected/5b0eeb84-479b-4fb3-ad6b-6a64645be526-kube-api-access-xnrhh\") pod \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\" (UID: \"5b0eeb84-479b-4fb3-ad6b-6a64645be526\") " Jul 06 23:21:24.142176 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.141908 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5b0eeb84-479b-4fb3-ad6b-6a64645be526" (UID: "5b0eeb84-479b-4fb3-ad6b-6a64645be526"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:21:24.142176 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.142013 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5b0eeb84-479b-4fb3-ad6b-6a64645be526" (UID: "5b0eeb84-479b-4fb3-ad6b-6a64645be526"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:21:24.142176 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.142031 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5b0eeb84-479b-4fb3-ad6b-6a64645be526" (UID: "5b0eeb84-479b-4fb3-ad6b-6a64645be526"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:21:24.142176 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.142113 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5b0eeb84-479b-4fb3-ad6b-6a64645be526" (UID: "5b0eeb84-479b-4fb3-ad6b-6a64645be526"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:21:24.142406 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.142237 2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-workload-certs\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:21:24.142406 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.142256 2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istiod-ca-cert\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:21:24.142406 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.142270 2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-workload-socket\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:21:24.142406 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.142284 2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-credential-socket\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:21:24.142803 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.142779 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istio-data" (OuterVolumeSpecName: "istio-data") pod "5b0eeb84-479b-4fb3-ad6b-6a64645be526" (UID: "5b0eeb84-479b-4fb3-ad6b-6a64645be526"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:21:24.143909 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.143885 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5b0eeb84-479b-4fb3-ad6b-6a64645be526" (UID: "5b0eeb84-479b-4fb3-ad6b-6a64645be526"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:21:24.144016 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.143951 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5b0eeb84-479b-4fb3-ad6b-6a64645be526" (UID: "5b0eeb84-479b-4fb3-ad6b-6a64645be526"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 23:21:24.144380 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.144363 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b0eeb84-479b-4fb3-ad6b-6a64645be526-kube-api-access-xnrhh" (OuterVolumeSpecName: "kube-api-access-xnrhh") pod "5b0eeb84-479b-4fb3-ad6b-6a64645be526" (UID: "5b0eeb84-479b-4fb3-ad6b-6a64645be526"). InnerVolumeSpecName "kube-api-access-xnrhh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:21:24.144434 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.144386 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istio-token" (OuterVolumeSpecName: "istio-token") pod "5b0eeb84-479b-4fb3-ad6b-6a64645be526" (UID: "5b0eeb84-479b-4fb3-ad6b-6a64645be526"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:21:24.243777 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.243740 2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istio-token\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:21:24.243777 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.243768 2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istio-envoy\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:21:24.243777 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.243777 2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istio-podinfo\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:21:24.243777 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.243785 2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b0eeb84-479b-4fb3-ad6b-6a64645be526-istio-data\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:21:24.244069 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.243795 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnrhh\" (UniqueName: \"kubernetes.io/projected/5b0eeb84-479b-4fb3-ad6b-6a64645be526-kube-api-access-xnrhh\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:21:24.666500 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.666469 2566 generic.go:356] "Generic (PLEG): container finished" podID="5b0eeb84-479b-4fb3-ad6b-6a64645be526" containerID="2f0b59e620f54621d3b76a5184298142de687d1685442b9ab13285983dcb97f4" exitCode=0 Jul 06 23:21:24.666682 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.666518 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" Jul 06 23:21:24.666682 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.666563 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" event={"ID":"5b0eeb84-479b-4fb3-ad6b-6a64645be526","Type":"ContainerDied","Data":"2f0b59e620f54621d3b76a5184298142de687d1685442b9ab13285983dcb97f4"} Jul 06 23:21:24.666682 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.666622 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf" event={"ID":"5b0eeb84-479b-4fb3-ad6b-6a64645be526","Type":"ContainerDied","Data":"6b541f158bfefa9cefa38c199fc9a46cecc0e1a77b1510c5f8cb3a4c604d6375"} Jul 06 23:21:24.666682 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.666649 2566 scope.go:117] "RemoveContainer" containerID="2f0b59e620f54621d3b76a5184298142de687d1685442b9ab13285983dcb97f4" Jul 06 23:21:24.678385 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.678369 2566 scope.go:117] "RemoveContainer" containerID="533b2f75a4c6f0eeb6db00758e91f57702e17029951cca8f5e72963e616c216e" Jul 06 23:21:24.686345 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.686326 2566 scope.go:117] "RemoveContainer" containerID="2f0b59e620f54621d3b76a5184298142de687d1685442b9ab13285983dcb97f4" Jul 06 23:21:24.686613 ip-10-0-131-21 kubenswrapper[2566]: E0706 23:21:24.686590 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f0b59e620f54621d3b76a5184298142de687d1685442b9ab13285983dcb97f4\": container with ID starting with 2f0b59e620f54621d3b76a5184298142de687d1685442b9ab13285983dcb97f4 not found: ID does not exist" containerID="2f0b59e620f54621d3b76a5184298142de687d1685442b9ab13285983dcb97f4" Jul 06 23:21:24.686707 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.686622 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f0b59e620f54621d3b76a5184298142de687d1685442b9ab13285983dcb97f4"} err="failed to get container status \"2f0b59e620f54621d3b76a5184298142de687d1685442b9ab13285983dcb97f4\": rpc error: code = NotFound desc = could not find container \"2f0b59e620f54621d3b76a5184298142de687d1685442b9ab13285983dcb97f4\": container with ID starting with 2f0b59e620f54621d3b76a5184298142de687d1685442b9ab13285983dcb97f4 not found: ID does not exist" Jul 06 23:21:24.686707 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.686639 2566 scope.go:117] "RemoveContainer" containerID="533b2f75a4c6f0eeb6db00758e91f57702e17029951cca8f5e72963e616c216e" Jul 06 23:21:24.686901 ip-10-0-131-21 kubenswrapper[2566]: E0706 23:21:24.686884 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"533b2f75a4c6f0eeb6db00758e91f57702e17029951cca8f5e72963e616c216e\": container with ID starting with 533b2f75a4c6f0eeb6db00758e91f57702e17029951cca8f5e72963e616c216e not found: ID does not exist" containerID="533b2f75a4c6f0eeb6db00758e91f57702e17029951cca8f5e72963e616c216e" Jul 06 23:21:24.686947 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.686909 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"533b2f75a4c6f0eeb6db00758e91f57702e17029951cca8f5e72963e616c216e"} err="failed to get container status \"533b2f75a4c6f0eeb6db00758e91f57702e17029951cca8f5e72963e616c216e\": rpc error: code = NotFound desc = could not find container \"533b2f75a4c6f0eeb6db00758e91f57702e17029951cca8f5e72963e616c216e\": container with ID starting with 533b2f75a4c6f0eeb6db00758e91f57702e17029951cca8f5e72963e616c216e not found: ID does not exist" Jul 06 23:21:24.692041 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.692021 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf"] Jul 06 23:21:24.697084 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:24.697065 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-d792b0-openshift-default-c79f7c9c-m6whf"] Jul 06 23:21:25.109952 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:25.109918 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b0eeb84-479b-4fb3-ad6b-6a64645be526" path="/var/lib/kubelet/pods/5b0eeb84-479b-4fb3-ad6b-6a64645be526/volumes" Jul 06 23:21:27.480100 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:27.480068 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:27.851674 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:27.851646 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:28.146897 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.146798 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq"] Jul 06 23:21:28.147183 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.147171 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b0eeb84-479b-4fb3-ad6b-6a64645be526" containerName="istio-proxy" Jul 06 23:21:28.147229 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.147185 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b0eeb84-479b-4fb3-ad6b-6a64645be526" containerName="istio-proxy" Jul 06 23:21:28.147229 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.147199 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b0eeb84-479b-4fb3-ad6b-6a64645be526" containerName="istio-proxy" Jul 06 23:21:28.147229 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.147204 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b0eeb84-479b-4fb3-ad6b-6a64645be526" containerName="istio-proxy" Jul 06 23:21:28.147229 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.147213 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="689dd657-33c2-435b-aeab-dbdd5c441a7a" containerName="istio-proxy" Jul 06 23:21:28.147229 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.147218 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="689dd657-33c2-435b-aeab-dbdd5c441a7a" containerName="istio-proxy" Jul 06 23:21:28.147381 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.147273 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b0eeb84-479b-4fb3-ad6b-6a64645be526" containerName="istio-proxy" Jul 06 23:21:28.147381 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.147283 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="689dd657-33c2-435b-aeab-dbdd5c441a7a" containerName="istio-proxy" Jul 06 23:21:28.150456 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.150439 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.153962 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.153934 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-d3a5b8-openshift-default-dockercfg-dlklg\"" Jul 06 23:21:28.176283 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.176259 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq"] Jul 06 23:21:28.186209 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.186184 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:28.282713 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.282673 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istio-envoy\") pod \"e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.282713 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.282719 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istio-token\") pod \"e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.282956 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.282739 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-credential-socket\") pod \"e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.282956 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.282758 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgncv\" (UniqueName: \"kubernetes.io/projected/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-kube-api-access-zgncv\") pod \"e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.282956 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.282873 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istio-data\") pod \"e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.282956 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.282921 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istio-podinfo\") pod \"e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.283135 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.282998 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-workload-socket\") pod \"e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.283135 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.283073 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istiod-ca-cert\") pod \"e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.283135 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.283109 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-workload-certs\") pod \"e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.383995 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.383957 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istio-envoy\") pod \"e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.384215 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.384006 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istio-token\") pod \"e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.384215 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.384024 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-credential-socket\") pod \"e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.384215 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.384045 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgncv\" (UniqueName: \"kubernetes.io/projected/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-kube-api-access-zgncv\") pod \"e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.384215 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.384087 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istio-data\") pod \"e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.384215 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.384121 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istio-podinfo\") pod \"e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.384507 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.384243 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-workload-socket\") pod \"e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.384507 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.384327 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istiod-ca-cert\") pod \"e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.384507 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.384357 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-workload-certs\") pod \"e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.384670 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.384601 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istio-data\") pod \"e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.384670 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.384653 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-workload-socket\") pod \"e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.384782 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.384697 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-workload-certs\") pod \"e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.384871 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.384839 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-credential-socket\") pod \"e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.385102 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.385081 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istiod-ca-cert\") pod \"e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.386306 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.386286 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istio-envoy\") pod \"e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.386516 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.386498 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istio-podinfo\") pod \"e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.393536 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.393509 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgncv\" (UniqueName: \"kubernetes.io/projected/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-kube-api-access-zgncv\") pod \"e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.393646 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.393624 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istio-token\") pod \"e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.461876 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.461755 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:28.518274 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.518233 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:28.603151 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.603059 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq"] Jul 06 23:21:28.605610 ip-10-0-131-21 kubenswrapper[2566]: W0706 23:21:28.605578 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf307d616_0d97_4a2c_b005_b84d6b7cc7b8.slice/crio-04b407e715162a363652588145f3671f23f208b5856dc38afdefd91cca3981c4 WatchSource:0}: Error finding container 04b407e715162a363652588145f3671f23f208b5856dc38afdefd91cca3981c4: Status 404 returned error can't find the container with id 04b407e715162a363652588145f3671f23f208b5856dc38afdefd91cca3981c4 Jul 06 23:21:28.607748 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.607716 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:21:28.607861 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.607782 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:21:28.607861 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.607825 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:21:28.686076 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.686039 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" event={"ID":"f307d616-0d97-4a2c-b005-b84d6b7cc7b8","Type":"ContainerStarted","Data":"522cf947d4f3a3cdadc54bdb6c1b8f42974c74c93d64248b0d747f347c6e99b0"} Jul 06 23:21:28.686209 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.686099 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" event={"ID":"f307d616-0d97-4a2c-b005-b84d6b7cc7b8","Type":"ContainerStarted","Data":"04b407e715162a363652588145f3671f23f208b5856dc38afdefd91cca3981c4"} Jul 06 23:21:28.713398 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:28.713283 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" podStartSLOduration=0.713264899 podStartE2EDuration="713.264899ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:21:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:21:28.710844761 +0000 UTC m=+2118.176147056" watchObservedRunningTime="2026-07-06 23:21:28.713264899 +0000 UTC m=+2118.178567181" Jul 06 23:21:29.461976 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:29.461938 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:29.467104 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:29.467077 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:29.690456 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:29.690422 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:29.691420 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:29.691400 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:30.662723 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:30.662689 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:30.753048 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:30.753016 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:30.829507 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:30.829446 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:31.082667 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:31.082570 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:31.301022 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:31.300988 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:31.391338 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:31.391292 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:34.460068 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:34.460034 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:34.565187 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:34.565158 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:35.159063 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:35.159033 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:40.749738 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:40.749633 2566 generic.go:356] "Generic (PLEG): container finished" podID="f307d616-0d97-4a2c-b005-b84d6b7cc7b8" containerID="522cf947d4f3a3cdadc54bdb6c1b8f42974c74c93d64248b0d747f347c6e99b0" exitCode=0 Jul 06 23:21:40.749738 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:40.749681 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" event={"ID":"f307d616-0d97-4a2c-b005-b84d6b7cc7b8","Type":"ContainerDied","Data":"522cf947d4f3a3cdadc54bdb6c1b8f42974c74c93d64248b0d747f347c6e99b0"} Jul 06 23:21:40.750291 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:40.750100 2566 scope.go:117] "RemoveContainer" containerID="522cf947d4f3a3cdadc54bdb6c1b8f42974c74c93d64248b0d747f347c6e99b0" Jul 06 23:21:40.751238 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:40.751209 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:21:40.751314 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:40.751277 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:21:40.751354 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:40.751310 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:21:41.756547 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:41.756512 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" event={"ID":"f307d616-0d97-4a2c-b005-b84d6b7cc7b8","Type":"ContainerStarted","Data":"760cc7f190b9dd0470d8123bc24eb08e16ec50d1395000f0851b6f7a692323ef"} Jul 06 23:21:42.462430 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:42.462384 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:42.463468 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:42.463441 2566 patch_prober.go:28] interesting pod/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 06 23:21:42.463612 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:42.463497 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" podUID="f307d616-0d97-4a2c-b005-b84d6b7cc7b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 06 23:21:43.462827 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:43.462776 2566 patch_prober.go:28] interesting pod/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 06 23:21:43.463239 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:43.462858 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" podUID="f307d616-0d97-4a2c-b005-b84d6b7cc7b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 06 23:21:44.258226 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:44.258192 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:44.362448 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:44.362415 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:44.462645 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:44.462612 2566 patch_prober.go:28] interesting pod/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 06 23:21:44.462828 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:44.462669 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" podUID="f307d616-0d97-4a2c-b005-b84d6b7cc7b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 06 23:21:44.690572 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:44.690538 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:45.462700 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:45.462665 2566 patch_prober.go:28] interesting pod/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 06 23:21:45.462902 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:45.462720 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" podUID="f307d616-0d97-4a2c-b005-b84d6b7cc7b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 06 23:21:46.436346 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:46.436297 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:46.466585 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:46.466554 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:46.467648 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:46.467630 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:21:52.130709 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:52.130676 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:21:52.279599 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:21:52.279565 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:22:25.620624 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:22:25.620594 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:22:52.332946 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:22:52.332908 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:22:58.698135 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:22:58.698099 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:23:09.000670 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:23:09.000639 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:23:09.055145 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:23:09.055114 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:23:16.845933 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:23:16.845883 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:24:33.732125 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:24:33.732096 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:24:59.113800 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:24:59.113755 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:25:00.038848 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:25:00.038816 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:25:36.461140 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:25:36.461069 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:26:08.961383 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:26:08.961346 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:26:11.133229 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:26:11.133202 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rtzxs_1dc50270-5e71-4a7b-8160-9041cbc18cd9/console-operator/2.log" Jul 06 23:26:11.159728 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:26:11.159700 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rtzxs_1dc50270-5e71-4a7b-8160-9041cbc18cd9/console-operator/2.log" Jul 06 23:26:35.127332 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:26:35.127133 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:26:35.227162 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:26:35.227127 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:26:45.081890 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:26:45.081848 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:26:45.184220 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:26:45.184186 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:26:52.893491 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:26:52.893457 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:26:52.994562 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:26:52.994523 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:26:53.673107 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:26:53.673071 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:26:54.458579 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:26:54.458554 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:27:02.635732 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:02.635696 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr"] Jul 06 23:27:02.636203 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:02.636188 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b0eeb84-479b-4fb3-ad6b-6a64645be526" containerName="istio-proxy" Jul 06 23:27:02.638243 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:02.638223 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" Jul 06 23:27:02.640730 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:02.640708 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-669fee\"/\"openshift-service-ca.crt\"" Jul 06 23:27:02.641838 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:02.641803 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-669fee\"/\"kube-root-ca.crt\"" Jul 06 23:27:02.641971 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:02.641901 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-669fee\"/\"default-dockercfg-6ncrl\"" Jul 06 23:27:02.641971 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:02.641910 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-669fee\"/\"rate-test-model-669fee-kserve-self-signed-certs\"" Jul 06 23:27:02.648547 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:02.648517 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr"] Jul 06 23:27:02.688698 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:02.688659 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/824b1429-335f-4af6-956d-2b00a8a1aa18-tmp-dir\") pod \"rate-test-model-669fee-kserve-5bddc6767-zjvmr\" (UID: \"824b1429-335f-4af6-956d-2b00a8a1aa18\") " pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" Jul 06 23:27:02.688898 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:02.688706 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h82pd\" (UniqueName: \"kubernetes.io/projected/824b1429-335f-4af6-956d-2b00a8a1aa18-kube-api-access-h82pd\") pod \"rate-test-model-669fee-kserve-5bddc6767-zjvmr\" (UID: \"824b1429-335f-4af6-956d-2b00a8a1aa18\") " pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" Jul 06 23:27:02.688898 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:02.688790 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/824b1429-335f-4af6-956d-2b00a8a1aa18-tls-certs\") pod \"rate-test-model-669fee-kserve-5bddc6767-zjvmr\" (UID: \"824b1429-335f-4af6-956d-2b00a8a1aa18\") " pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" Jul 06 23:27:02.688898 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:02.688857 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/824b1429-335f-4af6-956d-2b00a8a1aa18-home\") pod \"rate-test-model-669fee-kserve-5bddc6767-zjvmr\" (UID: \"824b1429-335f-4af6-956d-2b00a8a1aa18\") " pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" Jul 06 23:27:02.688898 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:02.688878 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/824b1429-335f-4af6-956d-2b00a8a1aa18-model-cache\") pod \"rate-test-model-669fee-kserve-5bddc6767-zjvmr\" (UID: \"824b1429-335f-4af6-956d-2b00a8a1aa18\") " pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" Jul 06 23:27:02.689043 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:02.688908 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/824b1429-335f-4af6-956d-2b00a8a1aa18-dshm\") pod \"rate-test-model-669fee-kserve-5bddc6767-zjvmr\" (UID: \"824b1429-335f-4af6-956d-2b00a8a1aa18\") " pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" Jul 06 23:27:02.734309 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:02.734270 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:27:02.789783 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:02.789746 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/824b1429-335f-4af6-956d-2b00a8a1aa18-home\") pod \"rate-test-model-669fee-kserve-5bddc6767-zjvmr\" (UID: \"824b1429-335f-4af6-956d-2b00a8a1aa18\") " pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" Jul 06 23:27:02.790011 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:02.789791 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/824b1429-335f-4af6-956d-2b00a8a1aa18-model-cache\") pod \"rate-test-model-669fee-kserve-5bddc6767-zjvmr\" (UID: \"824b1429-335f-4af6-956d-2b00a8a1aa18\") " pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" Jul 06 23:27:02.790011 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:02.789863 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/824b1429-335f-4af6-956d-2b00a8a1aa18-dshm\") pod \"rate-test-model-669fee-kserve-5bddc6767-zjvmr\" (UID: \"824b1429-335f-4af6-956d-2b00a8a1aa18\") " pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" Jul 06 23:27:02.790011 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:02.789885 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/824b1429-335f-4af6-956d-2b00a8a1aa18-tmp-dir\") pod \"rate-test-model-669fee-kserve-5bddc6767-zjvmr\" (UID: \"824b1429-335f-4af6-956d-2b00a8a1aa18\") " pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" Jul 06 23:27:02.790011 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:02.789915 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h82pd\" (UniqueName: \"kubernetes.io/projected/824b1429-335f-4af6-956d-2b00a8a1aa18-kube-api-access-h82pd\") pod \"rate-test-model-669fee-kserve-5bddc6767-zjvmr\" (UID: \"824b1429-335f-4af6-956d-2b00a8a1aa18\") " pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" Jul 06 23:27:02.790011 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:02.790010 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/824b1429-335f-4af6-956d-2b00a8a1aa18-tls-certs\") pod \"rate-test-model-669fee-kserve-5bddc6767-zjvmr\" (UID: \"824b1429-335f-4af6-956d-2b00a8a1aa18\") " pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" Jul 06 23:27:02.790278 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:02.790214 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/824b1429-335f-4af6-956d-2b00a8a1aa18-home\") pod \"rate-test-model-669fee-kserve-5bddc6767-zjvmr\" (UID: \"824b1429-335f-4af6-956d-2b00a8a1aa18\") " pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" Jul 06 23:27:02.790278 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:02.790228 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/824b1429-335f-4af6-956d-2b00a8a1aa18-model-cache\") pod \"rate-test-model-669fee-kserve-5bddc6767-zjvmr\" (UID: \"824b1429-335f-4af6-956d-2b00a8a1aa18\") " pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" Jul 06 23:27:02.790388 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:02.790297 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/824b1429-335f-4af6-956d-2b00a8a1aa18-tmp-dir\") pod \"rate-test-model-669fee-kserve-5bddc6767-zjvmr\" (UID: \"824b1429-335f-4af6-956d-2b00a8a1aa18\") " pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" Jul 06 23:27:02.792307 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:02.792283 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/824b1429-335f-4af6-956d-2b00a8a1aa18-dshm\") pod \"rate-test-model-669fee-kserve-5bddc6767-zjvmr\" (UID: \"824b1429-335f-4af6-956d-2b00a8a1aa18\") " pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" Jul 06 23:27:02.792602 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:02.792584 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/824b1429-335f-4af6-956d-2b00a8a1aa18-tls-certs\") pod \"rate-test-model-669fee-kserve-5bddc6767-zjvmr\" (UID: \"824b1429-335f-4af6-956d-2b00a8a1aa18\") " pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" Jul 06 23:27:02.797078 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:02.797057 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h82pd\" (UniqueName: \"kubernetes.io/projected/824b1429-335f-4af6-956d-2b00a8a1aa18-kube-api-access-h82pd\") pod \"rate-test-model-669fee-kserve-5bddc6767-zjvmr\" (UID: \"824b1429-335f-4af6-956d-2b00a8a1aa18\") " pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" Jul 06 23:27:02.948983 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:02.948893 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" Jul 06 23:27:03.088651 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:03.086957 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr"] Jul 06 23:27:03.262793 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:03.262706 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" event={"ID":"824b1429-335f-4af6-956d-2b00a8a1aa18","Type":"ContainerStarted","Data":"615fbc37a349d6f43401d8b344e22306c614f3c108bd05e44fbdaab06f3333b6"} Jul 06 23:27:03.262793 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:03.262749 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" event={"ID":"824b1429-335f-4af6-956d-2b00a8a1aa18","Type":"ContainerStarted","Data":"fbd73f7671e8bf5f9ac22ea6f0197f38c9168fc336cdb54c101eca86c2a1fe87"} Jul 06 23:27:03.280062 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:03.280012 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" podStartSLOduration=1.279994276 podStartE2EDuration="1.279994276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:27:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:27:03.278393181 +0000 UTC m=+2452.743695462" watchObservedRunningTime="2026-07-06 23:27:03.279994276 +0000 UTC m=+2452.745296557" Jul 06 23:27:12.949434 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:12.949386 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" Jul 06 23:27:12.949921 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:12.949449 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" Jul 06 23:27:12.962448 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:12.962419 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" Jul 06 23:27:13.322722 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:13.322635 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" Jul 06 23:27:32.373707 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:27:32.373667 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:28:15.542491 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:15.542458 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:28:16.936596 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:16.936550 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr"] Jul 06 23:28:16.956193 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:16.956142 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:28:17.917076 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:17.917040 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:28:18.935710 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:18.935667 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:28:19.343893 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:19.343856 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:28:19.441216 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:19.441167 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:28:19.571223 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:19.571192 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:28:24.424191 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:24.424159 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:28:31.957606 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:31.957555 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" podUID="824b1429-335f-4af6-956d-2b00a8a1aa18" containerName="main" containerID="cri-o://615fbc37a349d6f43401d8b344e22306c614f3c108bd05e44fbdaab06f3333b6" gracePeriod=45 Jul 06 23:28:32.223128 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:32.223060 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" Jul 06 23:28:32.245717 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:32.245674 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h82pd\" (UniqueName: \"kubernetes.io/projected/824b1429-335f-4af6-956d-2b00a8a1aa18-kube-api-access-h82pd\") pod \"824b1429-335f-4af6-956d-2b00a8a1aa18\" (UID: \"824b1429-335f-4af6-956d-2b00a8a1aa18\") " Jul 06 23:28:32.245717 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:32.245721 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/824b1429-335f-4af6-956d-2b00a8a1aa18-dshm\") pod \"824b1429-335f-4af6-956d-2b00a8a1aa18\" (UID: \"824b1429-335f-4af6-956d-2b00a8a1aa18\") " Jul 06 23:28:32.245996 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:32.245774 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/824b1429-335f-4af6-956d-2b00a8a1aa18-tls-certs\") pod \"824b1429-335f-4af6-956d-2b00a8a1aa18\" (UID: \"824b1429-335f-4af6-956d-2b00a8a1aa18\") " Jul 06 23:28:32.245996 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:32.245830 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/824b1429-335f-4af6-956d-2b00a8a1aa18-home\") pod \"824b1429-335f-4af6-956d-2b00a8a1aa18\" (UID: \"824b1429-335f-4af6-956d-2b00a8a1aa18\") " Jul 06 23:28:32.245996 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:32.245884 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/824b1429-335f-4af6-956d-2b00a8a1aa18-tmp-dir\") pod \"824b1429-335f-4af6-956d-2b00a8a1aa18\" (UID: \"824b1429-335f-4af6-956d-2b00a8a1aa18\") " Jul 06 23:28:32.245996 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:32.245906 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/824b1429-335f-4af6-956d-2b00a8a1aa18-model-cache\") pod \"824b1429-335f-4af6-956d-2b00a8a1aa18\" (UID: \"824b1429-335f-4af6-956d-2b00a8a1aa18\") " Jul 06 23:28:32.246573 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:32.246508 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/824b1429-335f-4af6-956d-2b00a8a1aa18-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "824b1429-335f-4af6-956d-2b00a8a1aa18" (UID: "824b1429-335f-4af6-956d-2b00a8a1aa18"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:28:32.246697 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:32.246579 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/824b1429-335f-4af6-956d-2b00a8a1aa18-model-cache" (OuterVolumeSpecName: "model-cache") pod "824b1429-335f-4af6-956d-2b00a8a1aa18" (UID: "824b1429-335f-4af6-956d-2b00a8a1aa18"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:28:32.250098 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:32.246992 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/824b1429-335f-4af6-956d-2b00a8a1aa18-home" (OuterVolumeSpecName: "home") pod "824b1429-335f-4af6-956d-2b00a8a1aa18" (UID: "824b1429-335f-4af6-956d-2b00a8a1aa18"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:28:32.254932 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:32.254881 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/824b1429-335f-4af6-956d-2b00a8a1aa18-dshm" (OuterVolumeSpecName: "dshm") pod "824b1429-335f-4af6-956d-2b00a8a1aa18" (UID: "824b1429-335f-4af6-956d-2b00a8a1aa18"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:28:32.255534 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:32.255506 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/824b1429-335f-4af6-956d-2b00a8a1aa18-kube-api-access-h82pd" (OuterVolumeSpecName: "kube-api-access-h82pd") pod "824b1429-335f-4af6-956d-2b00a8a1aa18" (UID: "824b1429-335f-4af6-956d-2b00a8a1aa18"). InnerVolumeSpecName "kube-api-access-h82pd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:28:32.258201 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:32.258156 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/824b1429-335f-4af6-956d-2b00a8a1aa18-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "824b1429-335f-4af6-956d-2b00a8a1aa18" (UID: "824b1429-335f-4af6-956d-2b00a8a1aa18"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:28:32.347466 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:32.347429 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h82pd\" (UniqueName: \"kubernetes.io/projected/824b1429-335f-4af6-956d-2b00a8a1aa18-kube-api-access-h82pd\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:28:32.347466 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:32.347461 2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/824b1429-335f-4af6-956d-2b00a8a1aa18-dshm\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:28:32.347466 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:32.347473 2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/824b1429-335f-4af6-956d-2b00a8a1aa18-tls-certs\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:28:32.347703 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:32.347482 2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/824b1429-335f-4af6-956d-2b00a8a1aa18-home\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:28:32.347703 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:32.347490 2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/824b1429-335f-4af6-956d-2b00a8a1aa18-tmp-dir\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:28:32.347703 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:32.347498 2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/824b1429-335f-4af6-956d-2b00a8a1aa18-model-cache\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:28:32.675720 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:32.675683 2566 generic.go:356] "Generic (PLEG): container finished" podID="824b1429-335f-4af6-956d-2b00a8a1aa18" containerID="615fbc37a349d6f43401d8b344e22306c614f3c108bd05e44fbdaab06f3333b6" exitCode=0 Jul 06 23:28:32.675918 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:32.675733 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" Jul 06 23:28:32.675918 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:32.675736 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" event={"ID":"824b1429-335f-4af6-956d-2b00a8a1aa18","Type":"ContainerDied","Data":"615fbc37a349d6f43401d8b344e22306c614f3c108bd05e44fbdaab06f3333b6"} Jul 06 23:28:32.675918 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:32.675866 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr" event={"ID":"824b1429-335f-4af6-956d-2b00a8a1aa18","Type":"ContainerDied","Data":"fbd73f7671e8bf5f9ac22ea6f0197f38c9168fc336cdb54c101eca86c2a1fe87"} Jul 06 23:28:32.675918 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:32.675891 2566 scope.go:117] "RemoveContainer" containerID="615fbc37a349d6f43401d8b344e22306c614f3c108bd05e44fbdaab06f3333b6" Jul 06 23:28:32.686030 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:32.686007 2566 scope.go:117] "RemoveContainer" containerID="615fbc37a349d6f43401d8b344e22306c614f3c108bd05e44fbdaab06f3333b6" Jul 06 23:28:32.686605 ip-10-0-131-21 kubenswrapper[2566]: E0706 23:28:32.686535 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"615fbc37a349d6f43401d8b344e22306c614f3c108bd05e44fbdaab06f3333b6\": container with ID starting with 615fbc37a349d6f43401d8b344e22306c614f3c108bd05e44fbdaab06f3333b6 not found: ID does not exist" containerID="615fbc37a349d6f43401d8b344e22306c614f3c108bd05e44fbdaab06f3333b6" Jul 06 23:28:32.686605 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:32.686572 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"615fbc37a349d6f43401d8b344e22306c614f3c108bd05e44fbdaab06f3333b6"} err="failed to get container status \"615fbc37a349d6f43401d8b344e22306c614f3c108bd05e44fbdaab06f3333b6\": rpc error: code = NotFound desc = could not find container \"615fbc37a349d6f43401d8b344e22306c614f3c108bd05e44fbdaab06f3333b6\": container with ID starting with 615fbc37a349d6f43401d8b344e22306c614f3c108bd05e44fbdaab06f3333b6 not found: ID does not exist" Jul 06 23:28:32.697254 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:32.697228 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr"] Jul 06 23:28:32.701531 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:32.701509 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-669fee/rate-test-model-669fee-kserve-5bddc6767-zjvmr"] Jul 06 23:28:33.105397 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:33.105369 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="824b1429-335f-4af6-956d-2b00a8a1aa18" path="/var/lib/kubelet/pods/824b1429-335f-4af6-956d-2b00a8a1aa18/volumes" Jul 06 23:28:51.247220 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:51.247188 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:28:51.352985 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:28:51.352957 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:29:01.308867 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:01.308831 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:29:01.596969 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:01.596913 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:29:01.850822 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:01.850714 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:29:02.034611 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:02.034578 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:29:02.510642 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:02.510604 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:29:02.642175 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:02.642147 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:29:02.743874 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:02.743838 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:29:02.866127 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:02.866096 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:29:08.230121 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:08.230067 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:29:08.329061 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:08.329027 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:29:08.550693 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:08.550586 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq"] Jul 06 23:29:08.550904 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:08.550873 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" podUID="f307d616-0d97-4a2c-b005-b84d6b7cc7b8" containerName="istio-proxy" containerID="cri-o://760cc7f190b9dd0470d8123bc24eb08e16ec50d1395000f0851b6f7a692323ef" gracePeriod=30 Jul 06 23:29:08.574816 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:08.574762 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:29:08.794915 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:08.794882 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:29:13.807125 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.807098 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:29:13.866072 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.866039 2566 generic.go:356] "Generic (PLEG): container finished" podID="f307d616-0d97-4a2c-b005-b84d6b7cc7b8" containerID="760cc7f190b9dd0470d8123bc24eb08e16ec50d1395000f0851b6f7a692323ef" exitCode=0 Jul 06 23:29:13.866245 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.866083 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" event={"ID":"f307d616-0d97-4a2c-b005-b84d6b7cc7b8","Type":"ContainerDied","Data":"760cc7f190b9dd0470d8123bc24eb08e16ec50d1395000f0851b6f7a692323ef"} Jul 06 23:29:13.866245 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.866088 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" Jul 06 23:29:13.866245 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.866135 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq" event={"ID":"f307d616-0d97-4a2c-b005-b84d6b7cc7b8","Type":"ContainerDied","Data":"04b407e715162a363652588145f3671f23f208b5856dc38afdefd91cca3981c4"} Jul 06 23:29:13.866245 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.866167 2566 scope.go:117] "RemoveContainer" containerID="760cc7f190b9dd0470d8123bc24eb08e16ec50d1395000f0851b6f7a692323ef" Jul 06 23:29:13.874616 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.874598 2566 scope.go:117] "RemoveContainer" containerID="522cf947d4f3a3cdadc54bdb6c1b8f42974c74c93d64248b0d747f347c6e99b0" Jul 06 23:29:13.882677 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.882656 2566 scope.go:117] "RemoveContainer" containerID="760cc7f190b9dd0470d8123bc24eb08e16ec50d1395000f0851b6f7a692323ef" Jul 06 23:29:13.882976 ip-10-0-131-21 kubenswrapper[2566]: E0706 23:29:13.882952 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"760cc7f190b9dd0470d8123bc24eb08e16ec50d1395000f0851b6f7a692323ef\": container with ID starting with 760cc7f190b9dd0470d8123bc24eb08e16ec50d1395000f0851b6f7a692323ef not found: ID does not exist" containerID="760cc7f190b9dd0470d8123bc24eb08e16ec50d1395000f0851b6f7a692323ef" Jul 06 23:29:13.883056 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.882984 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"760cc7f190b9dd0470d8123bc24eb08e16ec50d1395000f0851b6f7a692323ef"} err="failed to get container status \"760cc7f190b9dd0470d8123bc24eb08e16ec50d1395000f0851b6f7a692323ef\": rpc error: code = NotFound desc = could not find container \"760cc7f190b9dd0470d8123bc24eb08e16ec50d1395000f0851b6f7a692323ef\": container with ID starting with 760cc7f190b9dd0470d8123bc24eb08e16ec50d1395000f0851b6f7a692323ef not found: ID does not exist" Jul 06 23:29:13.883056 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.883003 2566 scope.go:117] "RemoveContainer" containerID="522cf947d4f3a3cdadc54bdb6c1b8f42974c74c93d64248b0d747f347c6e99b0" Jul 06 23:29:13.883273 ip-10-0-131-21 kubenswrapper[2566]: E0706 23:29:13.883255 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"522cf947d4f3a3cdadc54bdb6c1b8f42974c74c93d64248b0d747f347c6e99b0\": container with ID starting with 522cf947d4f3a3cdadc54bdb6c1b8f42974c74c93d64248b0d747f347c6e99b0 not found: ID does not exist" containerID="522cf947d4f3a3cdadc54bdb6c1b8f42974c74c93d64248b0d747f347c6e99b0" Jul 06 23:29:13.883322 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.883281 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"522cf947d4f3a3cdadc54bdb6c1b8f42974c74c93d64248b0d747f347c6e99b0"} err="failed to get container status \"522cf947d4f3a3cdadc54bdb6c1b8f42974c74c93d64248b0d747f347c6e99b0\": rpc error: code = NotFound desc = could not find container \"522cf947d4f3a3cdadc54bdb6c1b8f42974c74c93d64248b0d747f347c6e99b0\": container with ID starting with 522cf947d4f3a3cdadc54bdb6c1b8f42974c74c93d64248b0d747f347c6e99b0 not found: ID does not exist" Jul 06 23:29:13.934982 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.934950 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istio-envoy\") pod \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " Jul 06 23:29:13.935142 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.935020 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istio-podinfo\") pod \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " Jul 06 23:29:13.935142 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.935054 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istio-token\") pod \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " Jul 06 23:29:13.935367 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.935151 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-credential-socket\") pod \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " Jul 06 23:29:13.935367 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.935177 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istio-data\") pod \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " Jul 06 23:29:13.936551 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.935322 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istiod-ca-cert\") pod \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " Jul 06 23:29:13.936551 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.935692 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgncv\" (UniqueName: \"kubernetes.io/projected/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-kube-api-access-zgncv\") pod \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " Jul 06 23:29:13.936551 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.935719 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-workload-socket\") pod \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " Jul 06 23:29:13.936551 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.935742 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-workload-certs\") pod \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\" (UID: \"f307d616-0d97-4a2c-b005-b84d6b7cc7b8\") " Jul 06 23:29:13.936551 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.936005 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istio-data" (OuterVolumeSpecName: "istio-data") pod "f307d616-0d97-4a2c-b005-b84d6b7cc7b8" (UID: "f307d616-0d97-4a2c-b005-b84d6b7cc7b8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:29:13.936551 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.936070 2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istio-data\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:29:13.936551 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.936111 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f307d616-0d97-4a2c-b005-b84d6b7cc7b8" (UID: "f307d616-0d97-4a2c-b005-b84d6b7cc7b8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:29:13.936551 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.936315 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f307d616-0d97-4a2c-b005-b84d6b7cc7b8" (UID: "f307d616-0d97-4a2c-b005-b84d6b7cc7b8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:29:13.936551 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.936338 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f307d616-0d97-4a2c-b005-b84d6b7cc7b8" (UID: "f307d616-0d97-4a2c-b005-b84d6b7cc7b8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:29:13.936551 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.936374 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f307d616-0d97-4a2c-b005-b84d6b7cc7b8" (UID: "f307d616-0d97-4a2c-b005-b84d6b7cc7b8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:29:13.937838 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.937794 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istio-token" (OuterVolumeSpecName: "istio-token") pod "f307d616-0d97-4a2c-b005-b84d6b7cc7b8" (UID: "f307d616-0d97-4a2c-b005-b84d6b7cc7b8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:29:13.937838 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.937830 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f307d616-0d97-4a2c-b005-b84d6b7cc7b8" (UID: "f307d616-0d97-4a2c-b005-b84d6b7cc7b8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:29:13.937966 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.937834 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f307d616-0d97-4a2c-b005-b84d6b7cc7b8" (UID: "f307d616-0d97-4a2c-b005-b84d6b7cc7b8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 23:29:13.938183 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:13.938163 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-kube-api-access-zgncv" (OuterVolumeSpecName: "kube-api-access-zgncv") pod "f307d616-0d97-4a2c-b005-b84d6b7cc7b8" (UID: "f307d616-0d97-4a2c-b005-b84d6b7cc7b8"). InnerVolumeSpecName "kube-api-access-zgncv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:29:14.037035 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:14.037004 2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istio-podinfo\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:29:14.037035 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:14.037032 2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istio-token\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:29:14.037035 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:14.037042 2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-credential-socket\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:29:14.037276 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:14.037050 2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istiod-ca-cert\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:29:14.037276 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:14.037061 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgncv\" (UniqueName: \"kubernetes.io/projected/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-kube-api-access-zgncv\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:29:14.037276 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:14.037069 2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-workload-socket\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:29:14.037276 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:14.037081 2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-workload-certs\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:29:14.037276 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:14.037093 2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f307d616-0d97-4a2c-b005-b84d6b7cc7b8-istio-envoy\") on node \"ip-10-0-131-21.ec2.internal\" DevicePath \"\"" Jul 06 23:29:14.192560 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:14.192523 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq"] Jul 06 23:29:14.198145 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:14.198114 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-d3a5b8-openshift-default-96f6f68c-r2gjq"] Jul 06 23:29:15.104692 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:15.104658 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f307d616-0d97-4a2c-b005-b84d6b7cc7b8" path="/var/lib/kubelet/pods/f307d616-0d97-4a2c-b005-b84d6b7cc7b8/volumes" Jul 06 23:29:15.482493 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:15.482410 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b8c6df956-wd6nm_c157bcaa-c3b0-4113-ac41-630aeb384b62/copy-manifests/0.log" Jul 06 23:29:15.489287 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:15.489259 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b8c6df956-wd6nm_c157bcaa-c3b0-4113-ac41-630aeb384b62/manager/0.log" Jul 06 23:29:17.625971 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:17.625939 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6k9wq_227eac5e-d012-4acb-ab98-97357f30ddaa/manager/0.log" Jul 06 23:29:18.274968 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:18.274937 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6782vsrq_027735e3-200c-4e72-927c-89d4e8962d31/istio-proxy/0.log" Jul 06 23:29:18.514775 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:18.514747 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-698448cf7f-7954g_93d3f7da-04ee-4255-8496-d55852f55c45/kube-auth-proxy/0.log" Jul 06 23:29:19.737920 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:19.737890 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-bv7g9_7fb39043-0151-4e6e-a6d9-f492f122a3f5/main/0.log" Jul 06 23:29:19.858109 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:19.858080 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbc4h6_4f18c2d5-ac49-455d-ab36-aa2b4945ead2/main/0.log" Jul 06 23:29:19.976493 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:19.976462 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-btpgl_cb22e6dc-298b-4cfc-8e94-3604b10d1a0c/main/0.log" Jul 06 23:29:20.093664 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:20.093641 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-j5v27_0b13c0c2-9b49-4cba-b50b-4264fdbd47d2/main/0.log" Jul 06 23:29:24.134681 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:24.134650 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:29:24.196866 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:24.196836 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:29:26.749178 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:26.749146 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fc82v_6802a34f-0779-44b2-8c48-d3dadcc548ee/global-pull-secret-syncer/0.log" Jul 06 23:29:26.870010 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:26.869980 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" Jul 06 23:29:26.956002 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:26.955971 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-21.ec2.internal_71bfcc916832c3d1846ee4d7572ec4f6/haproxy/0.log" Jul 06 23:29:32.241887 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:32.241854 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6k9wq_227eac5e-d012-4acb-ab98-97357f30ddaa/manager/0.log" Jul 06 23:29:34.142628 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:34.142596 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5c84b57f8-vgsqk_f06af77f-2b43-4344-8aa0-e57e11b9ce16/metrics-server/0.log" Jul 06 23:29:34.182048 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:34.182025 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-whqd2_e7d5983e-4a15-48a3-9718-81dcaac2586e/monitoring-plugin/0.log" Jul 06 23:29:34.215486 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:34.215445 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7mn2v_084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd/node-exporter/0.log" Jul 06 23:29:34.238102 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:34.238080 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7mn2v_084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd/kube-rbac-proxy/0.log" Jul 06 23:29:34.259377 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:34.259353 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7mn2v_084c68fd-0deb-4c34-a9b2-07e2ef0f5ccd/init-textfile/0.log" Jul 06 23:29:34.546084 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:34.546000 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c05ee026-7ee7-42e7-ab6b-2ffd79af9908/prometheus/0.log" Jul 06 23:29:34.570450 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:34.570423 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c05ee026-7ee7-42e7-ab6b-2ffd79af9908/config-reloader/0.log" Jul 06 23:29:34.592229 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:34.592197 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c05ee026-7ee7-42e7-ab6b-2ffd79af9908/thanos-sidecar/0.log" Jul 06 23:29:34.615932 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:34.615906 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c05ee026-7ee7-42e7-ab6b-2ffd79af9908/kube-rbac-proxy-web/0.log" Jul 06 23:29:34.642720 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:34.642693 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c05ee026-7ee7-42e7-ab6b-2ffd79af9908/kube-rbac-proxy/0.log" Jul 06 23:29:34.667065 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:34.667038 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c05ee026-7ee7-42e7-ab6b-2ffd79af9908/kube-rbac-proxy-thanos/0.log" Jul 06 23:29:34.688850 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:34.688803 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c05ee026-7ee7-42e7-ab6b-2ffd79af9908/init-config-reloader/0.log" Jul 06 23:29:34.721900 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:34.721875 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-gzcc9_6f9c5a23-b7a6-4050-939f-9d517d287b23/prometheus-operator/0.log" Jul 06 23:29:34.741592 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:34.741566 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-gzcc9_6f9c5a23-b7a6-4050-939f-9d517d287b23/kube-rbac-proxy/0.log" Jul 06 23:29:34.763848 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:34.763826 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-tpbxs_27c5038b-6397-4793-89fc-8f8b74588249/prometheus-operator-admission-webhook/0.log" Jul 06 23:29:36.755303 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:36.755266 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rtzxs_1dc50270-5e71-4a7b-8160-9041cbc18cd9/console-operator/2.log" Jul 06 23:29:36.759516 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:36.759491 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rtzxs_1dc50270-5e71-4a7b-8160-9041cbc18cd9/console-operator/3.log" Jul 06 23:29:36.799174 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:36.799140 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-r9kzh/perf-node-gather-daemonset-wcz47"] Jul 06 23:29:36.799507 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:36.799495 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f307d616-0d97-4a2c-b005-b84d6b7cc7b8" containerName="istio-proxy" Jul 06 23:29:36.799557 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:36.799509 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f307d616-0d97-4a2c-b005-b84d6b7cc7b8" containerName="istio-proxy" Jul 06 23:29:36.799557 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:36.799516 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="824b1429-335f-4af6-956d-2b00a8a1aa18" containerName="main" Jul 06 23:29:36.799557 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:36.799522 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="824b1429-335f-4af6-956d-2b00a8a1aa18" containerName="main" Jul 06 23:29:36.799557 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:36.799537 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f307d616-0d97-4a2c-b005-b84d6b7cc7b8" containerName="istio-proxy" Jul 06 23:29:36.799557 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:36.799541 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f307d616-0d97-4a2c-b005-b84d6b7cc7b8" containerName="istio-proxy" Jul 06 23:29:36.799729 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:36.799601 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f307d616-0d97-4a2c-b005-b84d6b7cc7b8" containerName="istio-proxy" Jul 06 23:29:36.799729 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:36.799609 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f307d616-0d97-4a2c-b005-b84d6b7cc7b8" containerName="istio-proxy" Jul 06 23:29:36.799729 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:36.799616 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="824b1429-335f-4af6-956d-2b00a8a1aa18" containerName="main" Jul 06 23:29:36.803006 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:36.802985 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-wcz47" Jul 06 23:29:36.805414 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:36.805389 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r9kzh\"/\"kube-root-ca.crt\"" Jul 06 23:29:36.806259 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:36.806239 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-r9kzh\"/\"default-dockercfg-v45ts\"" Jul 06 23:29:36.806377 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:36.806242 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r9kzh\"/\"openshift-service-ca.crt\"" Jul 06 23:29:36.812236 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:36.812209 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r9kzh/perf-node-gather-daemonset-wcz47"] Jul 06 23:29:36.948372 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:36.948317 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5088c9b-7459-4869-b0f3-d29fdf245fa4-lib-modules\") pod \"perf-node-gather-daemonset-wcz47\" (UID: \"a5088c9b-7459-4869-b0f3-d29fdf245fa4\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-wcz47" Jul 06 23:29:36.948372 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:36.948391 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a5088c9b-7459-4869-b0f3-d29fdf245fa4-proc\") pod \"perf-node-gather-daemonset-wcz47\" (UID: \"a5088c9b-7459-4869-b0f3-d29fdf245fa4\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-wcz47" Jul 06 23:29:36.948648 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:36.948432 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a5088c9b-7459-4869-b0f3-d29fdf245fa4-podres\") pod \"perf-node-gather-daemonset-wcz47\" (UID: \"a5088c9b-7459-4869-b0f3-d29fdf245fa4\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-wcz47" Jul 06 23:29:36.948648 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:36.948474 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx44j\" (UniqueName: \"kubernetes.io/projected/a5088c9b-7459-4869-b0f3-d29fdf245fa4-kube-api-access-mx44j\") pod \"perf-node-gather-daemonset-wcz47\" (UID: \"a5088c9b-7459-4869-b0f3-d29fdf245fa4\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-wcz47" Jul 06 23:29:36.948648 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:36.948533 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5088c9b-7459-4869-b0f3-d29fdf245fa4-sys\") pod \"perf-node-gather-daemonset-wcz47\" (UID: \"a5088c9b-7459-4869-b0f3-d29fdf245fa4\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-wcz47" Jul 06 23:29:37.049626 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:37.049528 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5088c9b-7459-4869-b0f3-d29fdf245fa4-lib-modules\") pod \"perf-node-gather-daemonset-wcz47\" (UID: \"a5088c9b-7459-4869-b0f3-d29fdf245fa4\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-wcz47" Jul 06 23:29:37.049626 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:37.049574 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a5088c9b-7459-4869-b0f3-d29fdf245fa4-proc\") pod \"perf-node-gather-daemonset-wcz47\" (UID: \"a5088c9b-7459-4869-b0f3-d29fdf245fa4\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-wcz47" Jul 06 23:29:37.049626 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:37.049600 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a5088c9b-7459-4869-b0f3-d29fdf245fa4-podres\") pod \"perf-node-gather-daemonset-wcz47\" (UID: \"a5088c9b-7459-4869-b0f3-d29fdf245fa4\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-wcz47" Jul 06 23:29:37.049895 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:37.049636 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx44j\" (UniqueName: \"kubernetes.io/projected/a5088c9b-7459-4869-b0f3-d29fdf245fa4-kube-api-access-mx44j\") pod \"perf-node-gather-daemonset-wcz47\" (UID: \"a5088c9b-7459-4869-b0f3-d29fdf245fa4\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-wcz47" Jul 06 23:29:37.049895 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:37.049680 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5088c9b-7459-4869-b0f3-d29fdf245fa4-sys\") pod \"perf-node-gather-daemonset-wcz47\" (UID: \"a5088c9b-7459-4869-b0f3-d29fdf245fa4\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-wcz47" Jul 06 23:29:37.049895 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:37.049682 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a5088c9b-7459-4869-b0f3-d29fdf245fa4-proc\") pod \"perf-node-gather-daemonset-wcz47\" (UID: \"a5088c9b-7459-4869-b0f3-d29fdf245fa4\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-wcz47" Jul 06 23:29:37.049895 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:37.049710 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5088c9b-7459-4869-b0f3-d29fdf245fa4-lib-modules\") pod \"perf-node-gather-daemonset-wcz47\" (UID: \"a5088c9b-7459-4869-b0f3-d29fdf245fa4\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-wcz47" Jul 06 23:29:37.049895 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:37.049763 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5088c9b-7459-4869-b0f3-d29fdf245fa4-sys\") pod \"perf-node-gather-daemonset-wcz47\" (UID: \"a5088c9b-7459-4869-b0f3-d29fdf245fa4\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-wcz47" Jul 06 23:29:37.049895 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:37.049784 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a5088c9b-7459-4869-b0f3-d29fdf245fa4-podres\") pod \"perf-node-gather-daemonset-wcz47\" (UID: \"a5088c9b-7459-4869-b0f3-d29fdf245fa4\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-wcz47" Jul 06 23:29:37.057430 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:37.057405 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx44j\" (UniqueName: \"kubernetes.io/projected/a5088c9b-7459-4869-b0f3-d29fdf245fa4-kube-api-access-mx44j\") pod \"perf-node-gather-daemonset-wcz47\" (UID: \"a5088c9b-7459-4869-b0f3-d29fdf245fa4\") " pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-wcz47" Jul 06 23:29:37.114162 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:37.114133 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-wcz47" Jul 06 23:29:37.250339 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:37.250308 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r9kzh/perf-node-gather-daemonset-wcz47"] Jul 06 23:29:37.253178 ip-10-0-131-21 kubenswrapper[2566]: W0706 23:29:37.253146 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda5088c9b_7459_4869_b0f3_d29fdf245fa4.slice/crio-cc23ed1cd80927e8f9302922711ebf888c5fa9f49903c9e0fb36cad600eb1f8d WatchSource:0}: Error finding container cc23ed1cd80927e8f9302922711ebf888c5fa9f49903c9e0fb36cad600eb1f8d: Status 404 returned error can't find the container with id cc23ed1cd80927e8f9302922711ebf888c5fa9f49903c9e0fb36cad600eb1f8d Jul 06 23:29:37.925026 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:37.924989 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-fc5c9_f8c866fa-1188-4367-807e-f44e8e284050/volume-data-source-validator/0.log" Jul 06 23:29:37.975297 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:37.975255 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-wcz47" event={"ID":"a5088c9b-7459-4869-b0f3-d29fdf245fa4","Type":"ContainerStarted","Data":"5d5e4b3c78da6f7dddffbf958eeb5c60f0bc5615f052e2ac53f7dbeb6e3ea1e3"} Jul 06 23:29:37.975473 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:37.975350 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-wcz47" event={"ID":"a5088c9b-7459-4869-b0f3-d29fdf245fa4","Type":"ContainerStarted","Data":"cc23ed1cd80927e8f9302922711ebf888c5fa9f49903c9e0fb36cad600eb1f8d"} Jul 06 23:29:37.975473 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:37.975379 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-wcz47" Jul 06 23:29:37.990377 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:37.990333 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-wcz47" podStartSLOduration=1.9903193460000002 podStartE2EDuration="1.990319346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:29:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:29:37.989388346 +0000 UTC m=+2607.454690622" watchObservedRunningTime="2026-07-06 23:29:37.990319346 +0000 UTC m=+2607.455621677" Jul 06 23:29:38.989817 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:38.989769 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rt8d9_7e00471d-a3c5-4971-971b-850ddb797e98/dns/0.log" Jul 06 23:29:39.011666 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:39.011631 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rt8d9_7e00471d-a3c5-4971-971b-850ddb797e98/kube-rbac-proxy/0.log" Jul 06 23:29:39.033986 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:39.033959 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dpsfc_8fc501b7-3112-4f7e-b832-e14515946afa/dns-node-resolver/0.log" Jul 06 23:29:39.664113 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:39.664081 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ls869_afb97aaa-10b7-4dc2-94cd-f4b98b8b8912/node-ca/0.log" Jul 06 23:29:40.600794 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:40.600761 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6782vsrq_027735e3-200c-4e72-927c-89d4e8962d31/istio-proxy/0.log" Jul 06 23:29:40.727117 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:40.727088 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-698448cf7f-7954g_93d3f7da-04ee-4255-8496-d55852f55c45/kube-auth-proxy/0.log" Jul 06 23:29:41.673064 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:41.673034 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gnh7j_20ad72c0-1ddb-4415-9fa8-62ca527e26af/serve-healthcheck-canary/0.log" Jul 06 23:29:42.222599 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:42.222571 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kb6h6_1724ae64-fb19-417f-9090-22d7a5f4effa/kube-rbac-proxy/0.log" Jul 06 23:29:42.254250 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:42.254211 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kb6h6_1724ae64-fb19-417f-9090-22d7a5f4effa/exporter/0.log" Jul 06 23:29:42.269799 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:42.269776 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kb6h6_1724ae64-fb19-417f-9090-22d7a5f4effa/extractor/0.log" Jul 06 23:29:43.990236 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:43.990209 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-r9kzh/perf-node-gather-daemonset-wcz47" Jul 06 23:29:45.245987 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:45.245958 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b8c6df956-wd6nm_c157bcaa-c3b0-4113-ac41-630aeb384b62/manager/0.log" Jul 06 23:29:45.266710 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:45.266682 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b8c6df956-wd6nm_c157bcaa-c3b0-4113-ac41-630aeb384b62/copy-manifests/0.log" Jul 06 23:29:46.834999 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:46.834974 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-55f7b57db4-ql7qf_8561d135-3eb5-4900-999f-501ad99c2532/manager/0.log" Jul 06 23:29:47.175207 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:47.175174 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6782vsrq_027735e3-200c-4e72-927c-89d4e8962d31/istio-proxy/0.log" Jul 06 23:29:47.294864 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:47.294838 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-698448cf7f-7954g_93d3f7da-04ee-4255-8496-d55852f55c45/kube-auth-proxy/0.log" Jul 06 23:29:48.674239 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:48.674146 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6782vsrq_027735e3-200c-4e72-927c-89d4e8962d31/istio-proxy/0.log" Jul 06 23:29:48.796211 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:48.796178 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-698448cf7f-7954g_93d3f7da-04ee-4255-8496-d55852f55c45/kube-auth-proxy/0.log" Jul 06 23:29:52.224960 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:52.224911 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-n8fdv_44a73ff1-a1c0-483d-9edf-500cf057759e/kube-storage-version-migrator-operator/1.log" Jul 06 23:29:52.226020 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:52.225999 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-n8fdv_44a73ff1-a1c0-483d-9edf-500cf057759e/kube-storage-version-migrator-operator/0.log" Jul 06 23:29:52.644749 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:52.644715 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5954w_e1068e0c-7d61-469a-a508-dd97e6be6532/konnectivity-agent/0.log" limit=1024 Jul 06 23:29:53.260547 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:53.260522 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5frql_2297dd87-145b-4fbf-95c3-7e235bbb35ba/kube-multus/0.log" Jul 06 23:29:53.436926 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:53.436895 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kcwnt_55227435-70da-4e08-af29-62da383155fc/kube-multus-additional-cni-plugins/0.log" Jul 06 23:29:53.455954 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:53.455919 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kcwnt_55227435-70da-4e08-af29-62da383155fc/egress-router-binary-copy/0.log" Jul 06 23:29:53.473792 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:53.473765 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kcwnt_55227435-70da-4e08-af29-62da383155fc/cni-plugins/0.log" Jul 06 23:29:53.492738 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:53.492712 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kcwnt_55227435-70da-4e08-af29-62da383155fc/bond-cni-plugin/0.log" Jul 06 23:29:53.511457 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:53.511382 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kcwnt_55227435-70da-4e08-af29-62da383155fc/routeoverride-cni/0.log" Jul 06 23:29:53.530701 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:53.530674 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kcwnt_55227435-70da-4e08-af29-62da383155fc/whereabouts-cni-bincopy/0.log" Jul 06 23:29:53.549934 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:53.549907 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kcwnt_55227435-70da-4e08-af29-62da383155fc/whereabouts-cni/0.log" Jul 06 23:29:53.861505 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:53.861466 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-s6867_420491ca-5a34-4390-900c-61bd11f56d77/network-metrics-daemon/0.log" Jul 06 23:29:53.879296 ip-10-0-131-21 kubenswrapper[2566]: I0706 23:29:53.879271 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-s6867_420491ca-5a34-4390-900c-61bd11f56d77/kube-rbac-proxy/0.log"