Jul 23 20:59:22.319008 ip-10-0-139-105 systemd[1]: Starting Kubernetes Kubelet... Jul 23 20:59:22.723331 ip-10-0-139-105 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 20:59:22.723331 ip-10-0-139-105 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 23 20:59:22.723331 ip-10-0-139-105 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 20:59:22.723331 ip-10-0-139-105 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 23 20:59:22.723331 ip-10-0-139-105 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 20:59:22.725138 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.725047 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 23 20:59:22.729793 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729776 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 20:59:22.729793 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729792 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 20:59:22.729876 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729796 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 20:59:22.729876 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729799 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 20:59:22.729876 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729803 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 20:59:22.729876 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729806 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 20:59:22.729876 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729808 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 20:59:22.729876 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729811 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 20:59:22.729876 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729814 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 20:59:22.729876 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729816 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 20:59:22.729876 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729819 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 20:59:22.729876 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729824 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 20:59:22.729876 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729832 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 20:59:22.729876 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729836 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 20:59:22.729876 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729838 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 20:59:22.729876 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729841 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 20:59:22.729876 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729844 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 20:59:22.729876 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729848 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 20:59:22.729876 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729852 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 20:59:22.729876 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729855 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 20:59:22.729876 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729870 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 20:59:22.730345 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729873 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 20:59:22.730345 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729876 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 20:59:22.730345 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729879 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 20:59:22.730345 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729882 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 20:59:22.730345 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729886 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 20:59:22.730345 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729889 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 20:59:22.730345 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729892 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 20:59:22.730345 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729894 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 20:59:22.730345 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729897 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 20:59:22.730345 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729900 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 20:59:22.730345 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729902 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 20:59:22.730345 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729905 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 20:59:22.730345 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729908 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 20:59:22.730345 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729911 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 20:59:22.730345 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729915 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 20:59:22.730345 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729918 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 20:59:22.730345 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729922 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 20:59:22.730345 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729924 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 20:59:22.730345 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729927 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 20:59:22.730345 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729930 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 20:59:22.730820 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729932 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 20:59:22.730820 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729935 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 20:59:22.730820 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729937 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 20:59:22.730820 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729940 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 20:59:22.730820 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729942 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 20:59:22.730820 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729945 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 20:59:22.730820 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729949 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 20:59:22.730820 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729951 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 20:59:22.730820 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729954 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 20:59:22.730820 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729957 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 20:59:22.730820 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729959 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 20:59:22.730820 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729962 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 20:59:22.730820 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729965 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 20:59:22.730820 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729968 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 20:59:22.730820 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729971 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 20:59:22.730820 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729974 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 20:59:22.730820 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729976 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 20:59:22.730820 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729979 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 20:59:22.730820 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729982 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 20:59:22.730820 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729984 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 20:59:22.731310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729987 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 20:59:22.731310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729989 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 20:59:22.731310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729992 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 20:59:22.731310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729994 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 20:59:22.731310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.729997 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 20:59:22.731310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730000 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 20:59:22.731310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730003 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 20:59:22.731310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730006 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 20:59:22.731310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730008 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 20:59:22.731310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730011 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 20:59:22.731310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730014 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 20:59:22.731310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730016 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 20:59:22.731310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730019 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 20:59:22.731310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730023 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 20:59:22.731310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730025 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 20:59:22.731310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730028 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 20:59:22.731310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730030 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 20:59:22.731310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730033 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 20:59:22.731310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730036 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 20:59:22.731310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730039 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 20:59:22.731818 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730042 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 20:59:22.731818 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730044 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 20:59:22.731818 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730047 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 20:59:22.731818 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730050 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 20:59:22.731818 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730052 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 20:59:22.731818 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730056 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 20:59:22.731818 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730059 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 23 20:59:22.731818 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730061 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 20:59:22.731818 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730064 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 20:59:22.731818 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730066 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 20:59:22.731818 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730070 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 20:59:22.731818 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730074 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 20:59:22.731818 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730077 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 20:59:22.731818 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730086 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 20:59:22.731818 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730090 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 20:59:22.731818 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730092 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 20:59:22.731818 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730096 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 20:59:22.731818 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.730099 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 20:59:22.731818 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731611 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 20:59:22.731818 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731619 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 20:59:22.732310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731622 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 20:59:22.732310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731625 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 20:59:22.732310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731628 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 20:59:22.732310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731631 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 20:59:22.732310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731634 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 20:59:22.732310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731636 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 20:59:22.732310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731640 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 20:59:22.732310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731642 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 20:59:22.732310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731645 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 20:59:22.732310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731647 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 20:59:22.732310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731650 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 20:59:22.732310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731652 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 20:59:22.732310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731655 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 20:59:22.732310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731658 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 20:59:22.732310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731660 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 20:59:22.732310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731663 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 20:59:22.732310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731666 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 20:59:22.732310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731669 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 20:59:22.732310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731672 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 20:59:22.732310 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731674 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 20:59:22.732799 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731677 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 20:59:22.732799 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731679 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 20:59:22.732799 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731682 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 20:59:22.732799 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731685 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 20:59:22.732799 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731687 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 20:59:22.732799 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731690 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 20:59:22.732799 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731693 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 20:59:22.732799 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731695 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 20:59:22.732799 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731697 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 20:59:22.732799 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731701 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 20:59:22.732799 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731705 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 20:59:22.732799 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731708 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 20:59:22.732799 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731711 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 20:59:22.732799 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731714 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 20:59:22.732799 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731716 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 20:59:22.732799 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731719 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 20:59:22.732799 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731721 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 20:59:22.732799 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731724 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 20:59:22.732799 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731726 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 20:59:22.733340 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731729 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 20:59:22.733340 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731732 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 20:59:22.733340 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731734 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 20:59:22.733340 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731737 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 20:59:22.733340 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731739 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 20:59:22.733340 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731742 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 20:59:22.733340 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731744 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 20:59:22.733340 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731747 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 20:59:22.733340 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731750 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 20:59:22.733340 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731753 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 20:59:22.733340 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731756 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 20:59:22.733340 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731758 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 20:59:22.733340 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731761 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 20:59:22.733340 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731763 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 20:59:22.733340 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731766 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 20:59:22.733340 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731768 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 20:59:22.733340 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731771 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 20:59:22.733340 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731775 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 20:59:22.733340 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731778 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 20:59:22.733340 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731781 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 20:59:22.733826 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731783 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 20:59:22.733826 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731786 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 20:59:22.733826 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731788 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 20:59:22.733826 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731792 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 20:59:22.733826 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731794 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 20:59:22.733826 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731797 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 20:59:22.733826 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731800 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 20:59:22.733826 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731802 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 20:59:22.733826 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731805 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 20:59:22.733826 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731807 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 20:59:22.733826 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731810 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 20:59:22.733826 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731812 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 20:59:22.733826 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731815 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 20:59:22.733826 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731818 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 20:59:22.733826 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731821 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 20:59:22.733826 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731824 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 20:59:22.733826 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731827 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 20:59:22.733826 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731830 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 20:59:22.733826 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731832 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 20:59:22.734307 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731835 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 20:59:22.734307 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731839 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 20:59:22.734307 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731843 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 20:59:22.734307 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731846 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 20:59:22.734307 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731848 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 20:59:22.734307 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731851 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 20:59:22.734307 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731855 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 20:59:22.734307 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731871 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 20:59:22.734307 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731876 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 20:59:22.734307 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731879 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 20:59:22.734307 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731883 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 20:59:22.734307 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731886 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 20:59:22.734307 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731889 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 20:59:22.734307 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731892 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 20:59:22.734307 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731895 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 20:59:22.734307 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731897 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 20:59:22.734307 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731900 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 20:59:22.734307 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731903 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 23 20:59:22.734307 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.731906 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 20:59:22.734750 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732293 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 20:59:22.734750 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732298 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 20:59:22.734750 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732301 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 20:59:22.734750 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732304 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 20:59:22.734750 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732306 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 20:59:22.734750 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732309 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 20:59:22.734750 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732312 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 20:59:22.734750 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732317 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 20:59:22.734750 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732321 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 20:59:22.734750 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732325 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 20:59:22.734750 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732328 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 20:59:22.734750 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732331 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 20:59:22.734750 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732335 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 20:59:22.734750 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732337 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 20:59:22.734750 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732340 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 20:59:22.734750 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732343 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 20:59:22.734750 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732345 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 20:59:22.734750 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732348 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 20:59:22.734750 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732350 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 20:59:22.734750 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732353 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 20:59:22.735249 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732355 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 20:59:22.735249 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732358 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 20:59:22.735249 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732361 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 20:59:22.735249 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732363 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 20:59:22.735249 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732366 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 20:59:22.735249 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732368 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 20:59:22.735249 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732372 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 20:59:22.735249 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732376 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 20:59:22.735249 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732379 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 20:59:22.735249 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732381 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 20:59:22.735249 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732384 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 20:59:22.735249 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732387 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 20:59:22.735249 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732390 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 20:59:22.735249 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732392 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 20:59:22.735249 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732397 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 20:59:22.735249 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732400 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 20:59:22.735249 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732403 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 20:59:22.735249 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732405 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 20:59:22.735249 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732408 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 20:59:22.735715 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732410 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 20:59:22.735715 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732413 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 20:59:22.735715 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732416 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 20:59:22.735715 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732419 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 20:59:22.735715 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732421 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 20:59:22.735715 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732425 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 20:59:22.735715 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732428 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 20:59:22.735715 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732431 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 20:59:22.735715 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732433 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 20:59:22.735715 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732436 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 20:59:22.735715 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732438 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 20:59:22.735715 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732442 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 20:59:22.735715 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732444 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 20:59:22.735715 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732447 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 20:59:22.735715 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732450 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 20:59:22.735715 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732452 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 20:59:22.735715 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732455 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 20:59:22.735715 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732457 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 20:59:22.735715 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732460 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 20:59:22.736182 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732462 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 20:59:22.736182 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732465 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 20:59:22.736182 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732467 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 20:59:22.736182 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732470 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 20:59:22.736182 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732473 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 20:59:22.736182 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732476 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 20:59:22.736182 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732478 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 20:59:22.736182 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732481 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 20:59:22.736182 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732485 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 20:59:22.736182 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732488 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 20:59:22.736182 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732491 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 20:59:22.736182 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732493 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 20:59:22.736182 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732496 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 20:59:22.736182 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732498 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 20:59:22.736182 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732501 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 20:59:22.736182 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732504 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 20:59:22.736182 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732507 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 20:59:22.736182 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732509 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 20:59:22.736182 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732512 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 20:59:22.736182 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732514 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 20:59:22.736690 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732517 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 20:59:22.736690 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732520 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 20:59:22.736690 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732522 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 20:59:22.736690 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732525 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 20:59:22.736690 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732527 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 20:59:22.736690 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732530 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 23 20:59:22.736690 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732533 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 20:59:22.736690 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732536 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 20:59:22.736690 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732539 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 20:59:22.736690 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732541 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 20:59:22.736690 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732544 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 20:59:22.736690 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732546 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 20:59:22.736690 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732548 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 20:59:22.736690 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732551 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 20:59:22.736690 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732553 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 20:59:22.736690 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732556 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 20:59:22.736690 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732559 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 20:59:22.736690 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732561 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 20:59:22.736690 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732564 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 20:59:22.736690 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732566 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 20:59:22.737180 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.732571 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 20:59:22.737180 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732650 2575 flags.go:64] FLAG: --address="0.0.0.0" Jul 23 20:59:22.737180 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732660 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 23 20:59:22.737180 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732671 2575 flags.go:64] FLAG: --anonymous-auth="true" Jul 23 20:59:22.737180 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732679 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 23 20:59:22.737180 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732684 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 23 20:59:22.737180 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732688 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 23 20:59:22.737180 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732692 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 23 20:59:22.737180 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732696 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 23 20:59:22.737180 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732700 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 23 20:59:22.737180 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732703 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 23 20:59:22.737180 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732706 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 23 20:59:22.737180 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732709 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 23 20:59:22.737180 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732712 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 23 20:59:22.737180 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732715 2575 flags.go:64] FLAG: --cgroup-root="" Jul 23 20:59:22.737180 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732718 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 23 20:59:22.737180 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732721 2575 flags.go:64] FLAG: --client-ca-file="" Jul 23 20:59:22.737180 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732725 2575 flags.go:64] FLAG: --cloud-provider="external" Jul 23 20:59:22.737180 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732728 2575 flags.go:64] FLAG: --cluster-dns="[]" Jul 23 20:59:22.737180 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732732 2575 flags.go:64] FLAG: --cluster-domain="" Jul 23 20:59:22.737180 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732734 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 23 20:59:22.737180 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732738 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 23 20:59:22.737180 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732741 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 23 20:59:22.737180 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732744 2575 flags.go:64] FLAG: --container-log-max-files="5" Jul 23 20:59:22.737749 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732748 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 23 20:59:22.737749 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732751 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 23 20:59:22.737749 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732754 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 23 20:59:22.737749 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732758 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 23 20:59:22.737749 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732761 2575 flags.go:64] FLAG: --contention-profiling="false" Jul 23 20:59:22.737749 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732764 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 23 20:59:22.737749 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732767 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 23 20:59:22.737749 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732770 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 23 20:59:22.737749 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732775 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 23 20:59:22.737749 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732780 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 23 20:59:22.737749 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732783 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 23 20:59:22.737749 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732786 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 23 20:59:22.737749 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732788 2575 flags.go:64] FLAG: --enable-load-reader="false" Jul 23 20:59:22.737749 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732791 2575 flags.go:64] FLAG: --enable-server="true" Jul 23 20:59:22.737749 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732795 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 23 20:59:22.737749 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732799 2575 flags.go:64] FLAG: --event-burst="100" Jul 23 20:59:22.737749 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732802 2575 flags.go:64] FLAG: --event-qps="50" Jul 23 20:59:22.737749 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732805 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 23 20:59:22.737749 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732809 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 23 20:59:22.737749 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732813 2575 flags.go:64] FLAG: --eviction-hard="" Jul 23 20:59:22.737749 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732817 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 23 20:59:22.737749 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732820 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 23 20:59:22.737749 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732823 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 23 20:59:22.737749 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732826 2575 flags.go:64] FLAG: --eviction-soft="" Jul 23 20:59:22.737749 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732829 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 23 20:59:22.738364 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732832 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 23 20:59:22.738364 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732835 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 23 20:59:22.738364 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732838 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jul 23 20:59:22.738364 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732841 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 23 20:59:22.738364 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732844 2575 flags.go:64] FLAG: --fail-swap-on="true" Jul 23 20:59:22.738364 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732847 2575 flags.go:64] FLAG: --feature-gates="" Jul 23 20:59:22.738364 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732851 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jul 23 20:59:22.738364 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732853 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 23 20:59:22.738364 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732871 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 23 20:59:22.738364 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732875 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 23 20:59:22.738364 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732878 2575 flags.go:64] FLAG: --healthz-port="10248" Jul 23 20:59:22.738364 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732881 2575 flags.go:64] FLAG: --help="false" Jul 23 20:59:22.738364 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732884 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-139-105.ec2.internal" Jul 23 20:59:22.738364 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732887 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 23 20:59:22.738364 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732890 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jul 23 20:59:22.738364 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732896 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 23 20:59:22.738364 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732899 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 23 20:59:22.738364 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732903 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 23 20:59:22.738364 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732906 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 23 20:59:22.738364 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732909 2575 flags.go:64] FLAG: --image-service-endpoint="" Jul 23 20:59:22.738364 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732911 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 23 20:59:22.738364 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732914 2575 flags.go:64] FLAG: --kube-api-burst="100" Jul 23 20:59:22.738364 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732917 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 23 20:59:22.738983 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732920 2575 flags.go:64] FLAG: --kube-api-qps="50" Jul 23 20:59:22.738983 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732923 2575 flags.go:64] FLAG: --kube-reserved="" Jul 23 20:59:22.738983 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732926 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 23 20:59:22.738983 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732929 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 23 20:59:22.738983 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732932 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jul 23 20:59:22.738983 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732935 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 23 20:59:22.738983 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732938 2575 flags.go:64] FLAG: --lock-file="" Jul 23 20:59:22.738983 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732941 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 23 20:59:22.738983 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732944 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 23 20:59:22.738983 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732947 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 23 20:59:22.738983 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732952 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jul 23 20:59:22.738983 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732955 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 23 20:59:22.738983 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732958 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jul 23 20:59:22.738983 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732961 2575 flags.go:64] FLAG: --logging-format="text" Jul 23 20:59:22.738983 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732964 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 23 20:59:22.738983 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732967 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 23 20:59:22.738983 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732970 2575 flags.go:64] FLAG: --manifest-url="" Jul 23 20:59:22.738983 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732973 2575 flags.go:64] FLAG: --manifest-url-header="" Jul 23 20:59:22.738983 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732977 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 23 20:59:22.738983 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732980 2575 flags.go:64] FLAG: --max-open-files="1000000" Jul 23 20:59:22.738983 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732984 2575 flags.go:64] FLAG: --max-pods="110" Jul 23 20:59:22.738983 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732987 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 23 20:59:22.738983 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732990 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 23 20:59:22.738983 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732993 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jul 23 20:59:22.738983 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.732997 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 23 20:59:22.739582 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733001 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 23 20:59:22.739582 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733004 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 23 20:59:22.739582 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733007 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 23 20:59:22.739582 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733015 2575 flags.go:64] FLAG: --node-status-max-images="50" Jul 23 20:59:22.739582 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733019 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 23 20:59:22.739582 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733022 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jul 23 20:59:22.739582 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733025 2575 flags.go:64] FLAG: --pod-cidr="" Jul 23 20:59:22.739582 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733028 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 23 20:59:22.739582 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733033 2575 flags.go:64] FLAG: --pod-manifest-path="" Jul 23 20:59:22.739582 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733036 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jul 23 20:59:22.739582 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733039 2575 flags.go:64] FLAG: --pods-per-core="0" Jul 23 20:59:22.739582 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733042 2575 flags.go:64] FLAG: --port="10250" Jul 23 20:59:22.739582 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733046 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 23 20:59:22.739582 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733048 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cbd8acaaa7fdfb92" Jul 23 20:59:22.739582 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733052 2575 flags.go:64] FLAG: --qos-reserved="" Jul 23 20:59:22.739582 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733054 2575 flags.go:64] FLAG: --read-only-port="10255" Jul 23 20:59:22.739582 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733057 2575 flags.go:64] FLAG: --register-node="true" Jul 23 20:59:22.739582 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733060 2575 flags.go:64] FLAG: --register-with-taints="" Jul 23 20:59:22.739582 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733064 2575 flags.go:64] FLAG: --registry-burst="10" Jul 23 20:59:22.739582 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733067 2575 flags.go:64] FLAG: --registry-qps="5" Jul 23 20:59:22.739582 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733070 2575 flags.go:64] FLAG: --reserved-cpus="" Jul 23 20:59:22.739582 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733073 2575 flags.go:64] FLAG: --reserved-memory="" Jul 23 20:59:22.739582 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733076 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 23 20:59:22.739582 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733079 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 23 20:59:22.739582 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733082 2575 flags.go:64] FLAG: --rotate-certificates="false" Jul 23 20:59:22.740233 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733085 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 23 20:59:22.740233 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733088 2575 flags.go:64] FLAG: --runonce="false" Jul 23 20:59:22.740233 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733091 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 23 20:59:22.740233 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733094 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 23 20:59:22.740233 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733097 2575 flags.go:64] FLAG: --seccomp-default="false" Jul 23 20:59:22.740233 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733100 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 23 20:59:22.740233 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733103 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 23 20:59:22.740233 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733107 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 23 20:59:22.740233 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733111 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 23 20:59:22.740233 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733114 2575 flags.go:64] FLAG: --storage-driver-password="root" Jul 23 20:59:22.740233 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733119 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jul 23 20:59:22.740233 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733121 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jul 23 20:59:22.740233 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733124 2575 flags.go:64] FLAG: --storage-driver-user="root" Jul 23 20:59:22.740233 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733127 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 23 20:59:22.740233 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733130 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 23 20:59:22.740233 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733133 2575 flags.go:64] FLAG: --system-cgroups="" Jul 23 20:59:22.740233 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733136 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 23 20:59:22.740233 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733142 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 23 20:59:22.740233 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733144 2575 flags.go:64] FLAG: --tls-cert-file="" Jul 23 20:59:22.740233 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733147 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 23 20:59:22.740233 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733151 2575 flags.go:64] FLAG: --tls-min-version="" Jul 23 20:59:22.740233 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733154 2575 flags.go:64] FLAG: --tls-private-key-file="" Jul 23 20:59:22.740233 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733157 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jul 23 20:59:22.740233 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733160 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 23 20:59:22.740233 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733163 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jul 23 20:59:22.740833 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733166 2575 flags.go:64] FLAG: --v="2" Jul 23 20:59:22.740833 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733170 2575 flags.go:64] FLAG: --version="false" Jul 23 20:59:22.740833 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733174 2575 flags.go:64] FLAG: --vmodule="" Jul 23 20:59:22.740833 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733177 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 23 20:59:22.740833 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.733181 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 23 20:59:22.740833 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733314 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 20:59:22.740833 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733319 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 20:59:22.740833 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733322 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 20:59:22.740833 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733325 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 20:59:22.740833 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733328 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 20:59:22.740833 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733331 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 20:59:22.740833 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733333 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 20:59:22.740833 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733336 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 20:59:22.740833 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733339 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 20:59:22.740833 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733343 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 20:59:22.740833 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733345 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 20:59:22.740833 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733349 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 20:59:22.740833 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733353 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 20:59:22.740833 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733356 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 20:59:22.740833 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733359 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 20:59:22.740833 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733361 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 20:59:22.741471 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733364 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 20:59:22.741471 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733367 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 20:59:22.741471 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733369 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 20:59:22.741471 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733372 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 20:59:22.741471 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733374 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 20:59:22.741471 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733377 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 20:59:22.741471 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733379 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 20:59:22.741471 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733382 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 20:59:22.741471 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733384 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 20:59:22.741471 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733387 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 20:59:22.741471 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733390 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 20:59:22.741471 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733393 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 20:59:22.741471 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733395 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 20:59:22.741471 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733398 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 20:59:22.741471 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733400 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 23 20:59:22.741471 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733403 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 20:59:22.741471 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733406 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 20:59:22.741471 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733408 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 20:59:22.741471 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733411 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 20:59:22.741471 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733413 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 20:59:22.742371 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733416 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 20:59:22.742371 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733418 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 20:59:22.742371 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733421 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 20:59:22.742371 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733424 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 20:59:22.742371 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733429 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 20:59:22.742371 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733432 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 20:59:22.742371 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733435 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 20:59:22.742371 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733438 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 20:59:22.742371 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733448 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 20:59:22.742371 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733451 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 20:59:22.742371 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733454 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 20:59:22.742371 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733456 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 20:59:22.742371 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733459 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 20:59:22.742371 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733461 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 20:59:22.742371 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733464 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 20:59:22.742371 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733466 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 20:59:22.742371 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733468 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 20:59:22.742371 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733471 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 20:59:22.742371 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733473 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 20:59:22.742963 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733476 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 20:59:22.742963 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733479 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 20:59:22.742963 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733481 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 20:59:22.742963 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733484 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 20:59:22.742963 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733486 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 20:59:22.742963 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733489 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 20:59:22.742963 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733491 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 20:59:22.742963 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733494 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 20:59:22.742963 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733496 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 20:59:22.742963 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733499 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 20:59:22.742963 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733502 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 20:59:22.742963 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733504 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 20:59:22.742963 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733507 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 20:59:22.742963 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733511 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 20:59:22.742963 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733515 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 20:59:22.742963 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733518 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 20:59:22.742963 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733521 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 20:59:22.742963 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733523 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 20:59:22.742963 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733526 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 20:59:22.743422 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733529 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 20:59:22.743422 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733533 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 20:59:22.743422 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733537 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 20:59:22.743422 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733546 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 20:59:22.743422 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733549 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 20:59:22.743422 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733552 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 20:59:22.743422 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733555 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 20:59:22.743422 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733557 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 20:59:22.743422 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733560 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 20:59:22.743422 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733563 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 20:59:22.743422 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733566 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 20:59:22.743422 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733569 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 20:59:22.743422 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733572 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 20:59:22.743422 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733574 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 20:59:22.743422 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733577 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 20:59:22.743422 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733581 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 20:59:22.743422 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733583 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 20:59:22.743422 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733586 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 20:59:22.743422 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733588 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 20:59:22.743422 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733591 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 20:59:22.743924 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733593 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 20:59:22.743924 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733595 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 20:59:22.743924 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733598 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 20:59:22.743924 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733601 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 20:59:22.743924 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.733603 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 20:59:22.743924 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.734262 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 20:59:22.743924 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.742771 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 23 20:59:22.743924 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.742788 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 23 20:59:22.743924 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.743631 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 23 20:59:22.743924 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.743639 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 23 20:59:22.743924 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743701 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 20:59:22.743924 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743706 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 20:59:22.743924 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743710 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 20:59:22.743924 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743714 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 20:59:22.743924 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743716 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 20:59:22.744301 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743719 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 20:59:22.744301 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743722 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 20:59:22.744301 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743724 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 20:59:22.744301 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743727 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 20:59:22.744301 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743730 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 20:59:22.744301 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743732 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 20:59:22.744301 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743735 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 20:59:22.744301 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743738 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 20:59:22.744301 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743741 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 20:59:22.744301 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743743 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 20:59:22.744301 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743746 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 20:59:22.744301 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743748 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 20:59:22.744301 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743751 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 20:59:22.744301 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743753 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 20:59:22.744301 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743756 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 20:59:22.744301 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743758 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 20:59:22.744301 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743761 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 20:59:22.744301 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743763 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 20:59:22.744301 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743766 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 20:59:22.744301 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743769 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 20:59:22.744784 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743771 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 20:59:22.744784 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743775 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 20:59:22.744784 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743780 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 20:59:22.744784 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743783 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 20:59:22.744784 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743787 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 20:59:22.744784 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743790 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 20:59:22.744784 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743793 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 20:59:22.744784 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743796 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 20:59:22.744784 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743799 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 20:59:22.744784 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743802 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 20:59:22.744784 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743805 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 20:59:22.744784 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743808 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 20:59:22.744784 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743811 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 20:59:22.744784 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743813 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 20:59:22.744784 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743816 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 20:59:22.744784 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743819 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 20:59:22.744784 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743822 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 20:59:22.744784 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743824 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 20:59:22.744784 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743827 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 20:59:22.745288 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743830 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 20:59:22.745288 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743832 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 20:59:22.745288 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743835 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 20:59:22.745288 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743837 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 20:59:22.745288 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743840 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 20:59:22.745288 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743843 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 20:59:22.745288 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743845 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 20:59:22.745288 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743848 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 20:59:22.745288 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743851 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 20:59:22.745288 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743853 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 20:59:22.745288 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743869 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 20:59:22.745288 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743874 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 20:59:22.745288 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743878 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 20:59:22.745288 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743880 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 20:59:22.745288 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743883 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 20:59:22.745288 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743886 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 20:59:22.745288 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743889 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 20:59:22.745288 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743892 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 20:59:22.745288 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743895 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 20:59:22.745734 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743897 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 20:59:22.745734 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743900 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 20:59:22.745734 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743904 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 20:59:22.745734 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743906 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 20:59:22.745734 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743909 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 20:59:22.745734 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743912 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 20:59:22.745734 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743914 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 20:59:22.745734 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743917 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 20:59:22.745734 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743920 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 20:59:22.745734 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743922 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 20:59:22.745734 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743925 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 20:59:22.745734 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743928 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 20:59:22.745734 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743931 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 20:59:22.745734 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743935 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 20:59:22.745734 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743938 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 20:59:22.745734 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743941 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 20:59:22.745734 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743943 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 20:59:22.745734 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743946 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 20:59:22.745734 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743949 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 20:59:22.746267 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743952 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 20:59:22.746267 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743954 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 20:59:22.746267 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743957 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 20:59:22.746267 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743960 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 20:59:22.746267 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743963 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 20:59:22.746267 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743966 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 20:59:22.746267 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743968 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 23 20:59:22.746267 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743971 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 20:59:22.746267 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743974 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 20:59:22.746267 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743976 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 20:59:22.746267 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743979 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 20:59:22.746267 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743982 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 20:59:22.746267 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743984 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 20:59:22.746267 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743987 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 20:59:22.746267 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743990 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 20:59:22.746267 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743992 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 20:59:22.746267 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.743995 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 20:59:22.746678 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.744000 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 20:59:22.746678 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744124 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 20:59:22.746678 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744130 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 20:59:22.746678 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744133 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 20:59:22.746678 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744136 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 20:59:22.746678 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744139 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 20:59:22.746678 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744142 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 20:59:22.746678 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744144 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 20:59:22.746678 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744147 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 20:59:22.746678 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744150 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 20:59:22.746678 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744152 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 20:59:22.746678 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744155 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 20:59:22.746678 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744158 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 20:59:22.746678 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744162 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 20:59:22.746678 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744165 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 20:59:22.747063 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744167 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 20:59:22.747063 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744170 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 20:59:22.747063 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744173 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 20:59:22.747063 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744175 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 20:59:22.747063 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744178 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 20:59:22.747063 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744181 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 20:59:22.747063 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744183 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 20:59:22.747063 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744186 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 20:59:22.747063 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744188 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 20:59:22.747063 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744191 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 20:59:22.747063 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744194 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 20:59:22.747063 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744196 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 20:59:22.747063 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744200 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 20:59:22.747063 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744204 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 20:59:22.747063 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744206 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 20:59:22.747063 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744209 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 20:59:22.747063 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744212 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 20:59:22.747063 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744214 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 20:59:22.747063 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744218 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 20:59:22.747520 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744220 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 20:59:22.747520 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744223 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 20:59:22.747520 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744225 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 20:59:22.747520 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744228 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 20:59:22.747520 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744230 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 20:59:22.747520 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744233 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 20:59:22.747520 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744235 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 20:59:22.747520 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744238 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 20:59:22.747520 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744240 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 20:59:22.747520 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744243 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 20:59:22.747520 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744245 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 20:59:22.747520 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744248 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 20:59:22.747520 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744251 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 20:59:22.747520 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744254 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 20:59:22.747520 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744256 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 20:59:22.747520 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744259 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 20:59:22.747520 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744261 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 20:59:22.747520 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744264 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 20:59:22.747520 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744267 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 20:59:22.747520 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744269 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 20:59:22.748127 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744272 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 20:59:22.748127 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744274 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 20:59:22.748127 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744277 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 20:59:22.748127 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744279 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 20:59:22.748127 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744282 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 20:59:22.748127 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744285 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 20:59:22.748127 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744287 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 20:59:22.748127 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744290 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 20:59:22.748127 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744292 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 20:59:22.748127 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744295 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 20:59:22.748127 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744298 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 20:59:22.748127 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744300 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 20:59:22.748127 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744303 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 20:59:22.748127 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744306 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 20:59:22.748127 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744308 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 20:59:22.748127 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744311 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 20:59:22.748127 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744315 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 20:59:22.748127 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744319 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 20:59:22.748127 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744323 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 20:59:22.748590 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744325 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 20:59:22.748590 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744328 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 20:59:22.748590 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744331 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 20:59:22.748590 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744334 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 20:59:22.748590 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744337 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 20:59:22.748590 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744339 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 23 20:59:22.748590 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744343 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 20:59:22.748590 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744345 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 20:59:22.748590 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744347 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 20:59:22.748590 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744350 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 20:59:22.748590 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744352 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 20:59:22.748590 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744355 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 20:59:22.748590 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744357 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 20:59:22.748590 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744360 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 20:59:22.748590 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744362 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 20:59:22.748590 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744365 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 20:59:22.748590 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744367 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 20:59:22.748590 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744370 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 20:59:22.748590 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744373 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 20:59:22.748590 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744375 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 20:59:22.749092 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744378 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 20:59:22.749092 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744381 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 20:59:22.749092 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744384 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 20:59:22.749092 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744387 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 20:59:22.749092 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744389 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 20:59:22.749092 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744392 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 20:59:22.749092 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:22.744394 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 20:59:22.749092 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.744399 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 20:59:22.749092 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.744541 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jul 23 20:59:22.749092 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.746509 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 23 20:59:22.749092 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.748054 2575 server.go:1019] "Starting client certificate rotation" Jul 23 20:59:22.749092 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.748159 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 20:59:22.749092 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.748195 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 20:59:22.750578 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.750561 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 20:59:22.753853 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.753833 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 20:59:22.764974 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.764956 2575 log.go:25] "Validated CRI v1 runtime API" Jul 23 20:59:22.767305 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.767291 2575 log.go:25] "Validated CRI v1 image API" Jul 23 20:59:22.768157 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.768142 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 23 20:59:22.772623 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.772604 2575 fs.go:135] Filesystem UUIDs: map[041e8d46-46c2-462f-9a7a-a18f942f909e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e044235c-85de-4fe2-98be-075b4e50720c:/dev/nvme0n1p4] Jul 23 20:59:22.772700 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.772622 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 23 20:59:22.773930 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.773914 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 20:59:22.777764 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.777657 2575 manager.go:216] Machine: {Timestamp:2026-07-23 20:59:22.776188101 +0000 UTC m=+0.338622076 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098956 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2197abb0b9d02dfa41fd64568000eb SystemUUID:ec2197ab-b0b9-d02d-fa41-fd64568000eb BootID:468efb08-a080-41fc-b7f7-ca1b8cc718e5 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5b:10:40:87:6d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5b:10:40:87:6d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:27:0a:82:53:4f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 23 20:59:22.777764 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.777762 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 23 20:59:22.777902 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.777891 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 23 20:59:22.780211 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.780188 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 23 20:59:22.780345 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.780215 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-105.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 23 20:59:22.781002 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.780954 2575 topology_manager.go:138] "Creating topology manager with none policy" Jul 23 20:59:22.781002 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.780966 2575 container_manager_linux.go:309] "Creating device plugin manager" Jul 23 20:59:22.781002 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.780974 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 20:59:22.782283 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.782262 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 20:59:22.783538 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.783528 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 23 20:59:22.786167 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.786156 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 23 20:59:22.786283 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.786274 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 23 20:59:22.786319 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.786304 2575 kubelet.go:486] "Attempting to sync node with API server" Jul 23 20:59:22.786347 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.786318 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 23 20:59:22.786377 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.786345 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 23 20:59:22.786377 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.786361 2575 kubelet.go:398] "Adding apiserver pod source" Jul 23 20:59:22.786377 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.786374 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 23 20:59:22.786856 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.786840 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 20:59:22.786856 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.786880 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 20:59:22.791597 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.791574 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 23 20:59:22.793691 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.793678 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 23 20:59:22.793762 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.793708 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 23 20:59:22.794805 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.794790 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 23 20:59:22.794848 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.794812 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 23 20:59:22.794848 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.794822 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 23 20:59:22.794848 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.794829 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 23 20:59:22.794848 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.794838 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 23 20:59:22.794848 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.794844 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 23 20:59:22.794991 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.794852 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 23 20:59:22.794991 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.794875 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 23 20:59:22.794991 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.794885 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 23 20:59:22.794991 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.794890 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 23 20:59:22.794991 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.794898 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 23 20:59:22.794991 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.794904 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 23 20:59:22.795644 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.795636 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 23 20:59:22.795644 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.795644 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 23 20:59:22.798568 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.798550 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6nhgx" Jul 23 20:59:22.798957 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.798941 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-105.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 23 20:59:22.799021 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:22.799002 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 23 20:59:22.799057 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.799051 2575 server.go:1268] "Started kubelet" Jul 23 20:59:22.799085 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:22.799053 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-105.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 23 20:59:22.799181 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.799149 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 23 20:59:22.799235 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.799170 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 23 20:59:22.799283 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.799249 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 23 20:59:22.799887 ip-10-0-139-105 systemd[1]: Started Kubernetes Kubelet. Jul 23 20:59:22.800911 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.800882 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 23 20:59:22.801136 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.801119 2575 server.go:310] "Adding debug handlers to kubelet server" Jul 23 20:59:22.803645 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:22.803615 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 23 20:59:22.805898 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.805883 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6nhgx" Jul 23 20:59:22.806967 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.806953 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 23 20:59:22.807033 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.806978 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 23 20:59:22.807337 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:22.807133 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-105.ec2.internal\" not found" Jul 23 20:59:22.807438 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:22.806386 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-105.ec2.internal.18c506da7d6a5810 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-105.ec2.internal,UID:ip-10-0-139-105.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-105.ec2.internal,},FirstTimestamp:2026-07-23 20:59:22.79902824 +0000 UTC m=+0.361462222,LastTimestamp:2026-07-23 20:59:22.79902824 +0000 UTC m=+0.361462222,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-105.ec2.internal,}" Jul 23 20:59:22.807511 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.807502 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 23 20:59:22.807555 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.807507 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 23 20:59:22.807555 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.807529 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 23 20:59:22.807702 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.807684 2575 reconstruct.go:97] "Volume reconstruction finished" Jul 23 20:59:22.807702 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.807697 2575 reconciler.go:29] "Reconciler: start to sync state" Jul 23 20:59:22.807850 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.807809 2575 factory.go:55] Registering systemd factory Jul 23 20:59:22.807850 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.807823 2575 factory.go:223] Registration of the systemd container factory successfully Jul 23 20:59:22.808111 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.808090 2575 factory.go:153] Registering CRI-O factory Jul 23 20:59:22.808111 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.808108 2575 factory.go:223] Registration of the crio container factory successfully Jul 23 20:59:22.808223 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.808166 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 23 20:59:22.808223 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.808189 2575 factory.go:103] Registering Raw factory Jul 23 20:59:22.808223 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.808205 2575 manager.go:1196] Started watching for new ooms in manager Jul 23 20:59:22.808587 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.808577 2575 manager.go:349] Starting recovery of all containers Jul 23 20:59:22.812452 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.812426 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 20:59:22.815753 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:22.815720 2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-105.ec2.internal\" not found" node="ip-10-0-139-105.ec2.internal" Jul 23 20:59:22.818587 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.818564 2575 manager.go:354] Recovery completed Jul 23 20:59:22.823591 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.823578 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 20:59:22.825471 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.825451 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-105.ec2.internal" event="NodeHasSufficientMemory" Jul 23 20:59:22.825549 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.825482 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-105.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 20:59:22.825549 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.825492 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-105.ec2.internal" event="NodeHasSufficientPID" Jul 23 20:59:22.826069 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.826053 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 23 20:59:22.826132 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.826070 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 20:59:22.826132 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.826072 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 23 20:59:22.826132 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.826106 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 23 20:59:22.826985 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.826943 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-105.ec2.internal" event="NodeHasSufficientMemory" Jul 23 20:59:22.826985 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.826974 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-105.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 20:59:22.826985 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.826986 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-105.ec2.internal" event="NodeHasSufficientPID" Jul 23 20:59:22.827342 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.827331 2575 policy_none.go:49] "None policy: Start" Jul 23 20:59:22.827378 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.827346 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 23 20:59:22.827378 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.827371 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 23 20:59:22.828391 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.828378 2575 policy_none.go:47] "Start" Jul 23 20:59:22.882672 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.882459 2575 manager.go:337] "Starting Device Plugin manager" Jul 23 20:59:22.882788 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:22.882695 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 23 20:59:22.882788 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.882706 2575 server.go:87] "Starting device plugin registration server" Jul 23 20:59:22.882994 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.882978 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 23 20:59:22.883083 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.882994 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 23 20:59:22.883133 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.883081 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 23 20:59:22.883178 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.883171 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 23 20:59:22.883241 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.883182 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 23 20:59:22.883764 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:22.883744 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 23 20:59:22.883856 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:22.883801 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-105.ec2.internal\" not found" Jul 23 20:59:22.955696 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.955659 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 23 20:59:22.957224 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.956892 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 23 20:59:22.957224 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.956937 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 23 20:59:22.957224 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.956966 2575 kubelet.go:2448] "Starting kubelet main sync loop" Jul 23 20:59:22.957224 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:22.957006 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 23 20:59:22.959584 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.959566 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 20:59:22.983780 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.983764 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 20:59:22.984697 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.984678 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-105.ec2.internal" event="NodeHasSufficientMemory" Jul 23 20:59:22.984781 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.984711 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-105.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 20:59:22.984781 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.984722 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-105.ec2.internal" event="NodeHasSufficientPID" Jul 23 20:59:22.984781 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.984747 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-105.ec2.internal" Jul 23 20:59:22.993900 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:22.993885 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-105.ec2.internal" Jul 23 20:59:22.993966 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:22.993908 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-105.ec2.internal\": node \"ip-10-0-139-105.ec2.internal\" not found" Jul 23 20:59:23.009930 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:23.009913 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-105.ec2.internal\" not found" Jul 23 20:59:23.059749 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.059713 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-105.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-105.ec2.internal"] Jul 23 20:59:23.059859 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.059800 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 20:59:23.061518 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.061494 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-105.ec2.internal" event="NodeHasSufficientMemory" Jul 23 20:59:23.061633 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.061529 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-105.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 20:59:23.061633 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.061545 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-105.ec2.internal" event="NodeHasSufficientPID" Jul 23 20:59:23.063389 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.063373 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 20:59:23.063490 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.063483 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-105.ec2.internal" Jul 23 20:59:23.063558 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.063509 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 20:59:23.064163 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.064147 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-105.ec2.internal" event="NodeHasSufficientMemory" Jul 23 20:59:23.064244 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.064177 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-105.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 20:59:23.064244 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.064189 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-105.ec2.internal" event="NodeHasSufficientPID" Jul 23 20:59:23.064244 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.064149 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-105.ec2.internal" event="NodeHasSufficientMemory" Jul 23 20:59:23.064244 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.064229 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-105.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 20:59:23.064244 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.064240 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-105.ec2.internal" event="NodeHasSufficientPID" Jul 23 20:59:23.067118 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.067102 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-105.ec2.internal" Jul 23 20:59:23.067208 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.067127 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 20:59:23.067941 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.067924 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-105.ec2.internal" event="NodeHasSufficientMemory" Jul 23 20:59:23.068033 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.067950 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-105.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 20:59:23.068033 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.067965 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-105.ec2.internal" event="NodeHasSufficientPID" Jul 23 20:59:23.095920 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:23.095896 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-105.ec2.internal\" not found" node="ip-10-0-139-105.ec2.internal" Jul 23 20:59:23.099600 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:23.099580 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-105.ec2.internal\" not found" node="ip-10-0-139-105.ec2.internal" Jul 23 20:59:23.109040 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.109022 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6a91334f2b2daa9817292f0040684ba7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-105.ec2.internal\" (UID: \"6a91334f2b2daa9817292f0040684ba7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-105.ec2.internal" Jul 23 20:59:23.109093 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.109051 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a91334f2b2daa9817292f0040684ba7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-105.ec2.internal\" (UID: \"6a91334f2b2daa9817292f0040684ba7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-105.ec2.internal" Jul 23 20:59:23.109093 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.109082 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a88942796a5b6b2c5f36a7e709e10120-config\") pod \"kube-apiserver-proxy-ip-10-0-139-105.ec2.internal\" (UID: \"a88942796a5b6b2c5f36a7e709e10120\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-105.ec2.internal" Jul 23 20:59:23.110058 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:23.110042 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-105.ec2.internal\" not found" Jul 23 20:59:23.209989 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.209958 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6a91334f2b2daa9817292f0040684ba7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-105.ec2.internal\" (UID: \"6a91334f2b2daa9817292f0040684ba7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-105.ec2.internal" Jul 23 20:59:23.210119 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.210000 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a91334f2b2daa9817292f0040684ba7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-105.ec2.internal\" (UID: \"6a91334f2b2daa9817292f0040684ba7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-105.ec2.internal" Jul 23 20:59:23.210119 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.210021 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a88942796a5b6b2c5f36a7e709e10120-config\") pod \"kube-apiserver-proxy-ip-10-0-139-105.ec2.internal\" (UID: \"a88942796a5b6b2c5f36a7e709e10120\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-105.ec2.internal" Jul 23 20:59:23.210119 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.210054 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a88942796a5b6b2c5f36a7e709e10120-config\") pod \"kube-apiserver-proxy-ip-10-0-139-105.ec2.internal\" (UID: \"a88942796a5b6b2c5f36a7e709e10120\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-105.ec2.internal" Jul 23 20:59:23.210119 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.210069 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6a91334f2b2daa9817292f0040684ba7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-105.ec2.internal\" (UID: \"6a91334f2b2daa9817292f0040684ba7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-105.ec2.internal" Jul 23 20:59:23.210119 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.210069 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a91334f2b2daa9817292f0040684ba7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-105.ec2.internal\" (UID: \"6a91334f2b2daa9817292f0040684ba7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-105.ec2.internal" Jul 23 20:59:23.210119 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:23.210100 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-105.ec2.internal\" not found" Jul 23 20:59:23.311204 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:23.311170 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-105.ec2.internal\" not found" Jul 23 20:59:23.404213 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.404168 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-105.ec2.internal" Jul 23 20:59:23.404390 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.404178 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-105.ec2.internal" Jul 23 20:59:23.411774 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:23.411751 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-105.ec2.internal\" not found" Jul 23 20:59:23.512504 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:23.512457 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-105.ec2.internal\" not found" Jul 23 20:59:23.613634 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:23.613552 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-105.ec2.internal\" not found" Jul 23 20:59:23.713625 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.713587 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 20:59:23.747544 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.747494 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 23 20:59:23.748103 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.747682 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 20:59:23.748103 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.747707 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 20:59:23.748103 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.747704 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 20:59:23.787105 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.787074 2575 apiserver.go:52] "Watching apiserver" Jul 23 20:59:23.807197 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.807165 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 23 20:59:23.807197 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.807181 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-105.ec2.internal" Jul 23 20:59:23.807737 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.807720 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 23 20:59:23.808111 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.808084 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-wqmks","kube-system/konnectivity-agent-k4mpd","openshift-image-registry/node-ca-ndd69","openshift-multus/multus-lf85l","openshift-multus/network-metrics-daemon-rbjvm","openshift-network-operator/iptables-alerter-xrgfx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4","openshift-cluster-node-tuning-operator/tuned-xk77s","openshift-dns/node-resolver-5t58l","openshift-multus/multus-additional-cni-plugins-7lf94","openshift-network-diagnostics/network-check-target-v2gxq","openshift-ovn-kubernetes/ovnkube-node-6dqgm"] Jul 23 20:59:23.809569 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.809541 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 20:54:23 +0000 UTC" deadline="2028-04-10 07:03:42.454942686 +0000 UTC" Jul 23 20:59:23.809569 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.809563 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15034h4m18.645382909s" Jul 23 20:59:23.810329 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.810317 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:23.810388 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:23.810376 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqmks" podUID="1bc0eede-3f89-44b8-9acc-244ddd68e26b" Jul 23 20:59:23.812211 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.812190 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k4mpd" Jul 23 20:59:23.814009 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.813994 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ndd69" Jul 23 20:59:23.814471 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.814454 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qv97r\"" Jul 23 20:59:23.814471 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.814468 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 23 20:59:23.814574 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.814501 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 23 20:59:23.817240 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.817217 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 23 20:59:23.817509 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.817492 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 23 20:59:23.817800 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.817782 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7flth\"" Jul 23 20:59:23.818175 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.818143 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 23 20:59:23.818549 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.818531 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 20:59:23.818618 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.818570 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:23.818690 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:23.818666 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbjvm" podUID="66db3efe-80c5-48fe-88ef-48536557da73" Jul 23 20:59:23.818753 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.818698 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-105.ec2.internal" Jul 23 20:59:23.819191 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.819170 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lf85l" Jul 23 20:59:23.821107 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.821090 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xrgfx" Jul 23 20:59:23.821482 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.821463 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 23 20:59:23.821593 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.821517 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 20:59:23.821663 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.821606 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qzq7v\"" Jul 23 20:59:23.821781 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.821767 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 23 20:59:23.821781 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.821775 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 23 20:59:23.821865 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.821787 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 23 20:59:23.823215 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.823197 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4" Jul 23 20:59:23.823629 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.823609 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 23 20:59:23.823726 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.823684 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d7l5h\"" Jul 23 20:59:23.823778 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.823720 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 23 20:59:23.823979 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.823964 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 23 20:59:23.825365 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.825349 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:23.825723 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.825706 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mhnll\"" Jul 23 20:59:23.825898 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.825880 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 23 20:59:23.826104 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.826088 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 23 20:59:23.826186 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.826095 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 23 20:59:23.827472 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.827456 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dmdt9\"" Jul 23 20:59:23.827579 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.827558 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 23 20:59:23.827779 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.827763 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 23 20:59:23.828084 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.828067 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5t58l" Jul 23 20:59:23.830242 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.830225 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 23 20:59:23.830341 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.830321 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 23 20:59:23.830450 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.830438 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wqvdg\"" Jul 23 20:59:23.830964 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.830921 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7lf94" Jul 23 20:59:23.831754 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.831737 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 20:59:23.832997 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.832979 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 23 20:59:23.833093 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.833012 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 23 20:59:23.833325 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.833311 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 20:59:23.833399 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:23.833377 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v2gxq" podUID="01b37872-acdc-426d-9aef-d964ac7a91b4" Jul 23 20:59:23.833717 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.833702 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-99t8k\"" Jul 23 20:59:23.835782 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.835761 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-105.ec2.internal"] Jul 23 20:59:23.835869 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.835791 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-105.ec2.internal"] Jul 23 20:59:23.835869 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.835855 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:23.838000 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.837979 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 23 20:59:23.839024 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.839001 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 23 20:59:23.839024 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.839015 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 23 20:59:23.839191 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.839042 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 23 20:59:23.839191 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.839050 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 23 20:59:23.839389 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.839374 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hh77g\"" Jul 23 20:59:23.839857 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.839841 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 23 20:59:23.851218 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.851194 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jgtrv" Jul 23 20:59:23.860240 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.860222 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jgtrv" Jul 23 20:59:23.892859 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.892835 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 20:59:23.908651 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.908631 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 23 20:59:23.914096 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914070 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a5c7d21-3bf5-443a-bae4-31aef0469bdd-host-slash\") pod \"iptables-alerter-xrgfx\" (UID: \"9a5c7d21-3bf5-443a-bae4-31aef0469bdd\") " pod="openshift-network-operator/iptables-alerter-xrgfx" Jul 23 20:59:23.914198 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914106 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-host-kubelet\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:23.914198 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914124 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-run\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:23.914198 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914154 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bc0eede-3f89-44b8-9acc-244ddd68e26b-original-pull-secret\") pod \"global-pull-secret-syncer-wqmks\" (UID: \"1bc0eede-3f89-44b8-9acc-244ddd68e26b\") " pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:23.914198 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914177 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6c822b6-da7a-488f-9c36-cfb188240ae4-host\") pod \"node-ca-ndd69\" (UID: \"d6c822b6-da7a-488f-9c36-cfb188240ae4\") " pod="openshift-image-registry/node-ca-ndd69" Jul 23 20:59:23.914412 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914243 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-multus-conf-dir\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:23.914412 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914286 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67rs9\" (UniqueName: \"kubernetes.io/projected/132210c5-b5be-499e-98c1-113a40450446-kube-api-access-67rs9\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:23.914412 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914315 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db899d82-4b93-4bc9-9c96-7eff79204586-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7lf94\" (UID: \"db899d82-4b93-4bc9-9c96-7eff79204586\") " pod="openshift-multus/multus-additional-cni-plugins-7lf94" Jul 23 20:59:23.914412 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914341 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-host-run-k8s-cni-cncf-io\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:23.914412 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914365 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e727997-ea44-49f3-a78a-2e639ce8f1a7-ovn-node-metrics-cert\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:23.914412 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914390 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh8s6\" (UniqueName: \"kubernetes.io/projected/9a5c7d21-3bf5-443a-bae4-31aef0469bdd-kube-api-access-nh8s6\") pod \"iptables-alerter-xrgfx\" (UID: \"9a5c7d21-3bf5-443a-bae4-31aef0469bdd\") " pod="openshift-network-operator/iptables-alerter-xrgfx" Jul 23 20:59:23.914637 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914416 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-etc-modprobe-d\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:23.914637 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914442 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-etc-systemd\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:23.914637 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914481 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1bc0eede-3f89-44b8-9acc-244ddd68e26b-kubelet-config\") pod \"global-pull-secret-syncer-wqmks\" (UID: \"1bc0eede-3f89-44b8-9acc-244ddd68e26b\") " pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:23.914637 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914507 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cj92\" (UniqueName: \"kubernetes.io/projected/d6c822b6-da7a-488f-9c36-cfb188240ae4-kube-api-access-8cj92\") pod \"node-ca-ndd69\" (UID: \"d6c822b6-da7a-488f-9c36-cfb188240ae4\") " pod="openshift-image-registry/node-ca-ndd69" Jul 23 20:59:23.914637 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914523 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-multus-socket-dir-parent\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:23.914637 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914540 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-host-var-lib-cni-multus\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:23.914637 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914556 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:23.914637 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914571 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-host-var-lib-cni-bin\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:23.914637 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914591 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db899d82-4b93-4bc9-9c96-7eff79204586-os-release\") pod \"multus-additional-cni-plugins-7lf94\" (UID: \"db899d82-4b93-4bc9-9c96-7eff79204586\") " pod="openshift-multus/multus-additional-cni-plugins-7lf94" Jul 23 20:59:23.914637 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914606 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-run-systemd\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:23.914637 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914623 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-run-ovn\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:23.914637 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914639 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c6d723d3-d280-4491-b3a4-7734f233fab1-registration-dir\") pod \"aws-ebs-csi-driver-node-x2vk4\" (UID: \"c6d723d3-d280-4491-b3a4-7734f233fab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4" Jul 23 20:59:23.915242 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914655 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-etc-sysctl-d\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:23.915242 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914670 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a18eb347-e5e5-43ba-b5fa-f73884596341-tmp\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:23.915242 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914686 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d6c822b6-da7a-488f-9c36-cfb188240ae4-serviceca\") pod \"node-ca-ndd69\" (UID: \"d6c822b6-da7a-488f-9c36-cfb188240ae4\") " pod="openshift-image-registry/node-ca-ndd69" Jul 23 20:59:23.915242 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914718 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-host-cni-netd\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:23.915242 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914756 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c6d723d3-d280-4491-b3a4-7734f233fab1-device-dir\") pod \"aws-ebs-csi-driver-node-x2vk4\" (UID: \"c6d723d3-d280-4491-b3a4-7734f233fab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4" Jul 23 20:59:23.915242 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914790 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k8mb\" (UniqueName: \"kubernetes.io/projected/c6d723d3-d280-4491-b3a4-7734f233fab1-kube-api-access-8k8mb\") pod \"aws-ebs-csi-driver-node-x2vk4\" (UID: \"c6d723d3-d280-4491-b3a4-7734f233fab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4" Jul 23 20:59:23.915242 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914820 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-etc-sysconfig\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:23.915242 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914845 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-sys\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:23.915242 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914889 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnd5d\" (UniqueName: \"kubernetes.io/projected/f66dc9f4-cf62-41d2-a924-3c99f035c6fa-kube-api-access-vnd5d\") pod \"node-resolver-5t58l\" (UID: \"f66dc9f4-cf62-41d2-a924-3c99f035c6fa\") " pod="openshift-dns/node-resolver-5t58l" Jul 23 20:59:23.915242 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914916 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-system-cni-dir\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:23.915242 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914939 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-host-cni-bin\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:23.915242 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914967 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9a5c7d21-3bf5-443a-bae4-31aef0469bdd-iptables-alerter-script\") pod \"iptables-alerter-xrgfx\" (UID: \"9a5c7d21-3bf5-443a-bae4-31aef0469bdd\") " pod="openshift-network-operator/iptables-alerter-xrgfx" Jul 23 20:59:23.915242 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.914993 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-etc-sysctl-conf\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:23.915242 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915016 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-etc-kubernetes\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:23.915242 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915043 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/db899d82-4b93-4bc9-9c96-7eff79204586-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7lf94\" (UID: \"db899d82-4b93-4bc9-9c96-7eff79204586\") " pod="openshift-multus/multus-additional-cni-plugins-7lf94" Jul 23 20:59:23.915242 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915071 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5e727997-ea44-49f3-a78a-2e639ce8f1a7-ovnkube-config\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:23.916011 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915095 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-hostroot\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:23.916011 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915120 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-systemd-units\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:23.916011 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915146 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-run-openvswitch\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:23.916011 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915172 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-host\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:23.916011 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915200 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c360a063-018a-4e22-978b-69dc9b659c9b-konnectivity-ca\") pod \"konnectivity-agent-k4mpd\" (UID: \"c360a063-018a-4e22-978b-69dc9b659c9b\") " pod="kube-system/konnectivity-agent-k4mpd" Jul 23 20:59:23.916011 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915231 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w4b8\" (UniqueName: \"kubernetes.io/projected/66db3efe-80c5-48fe-88ef-48536557da73-kube-api-access-7w4b8\") pod \"network-metrics-daemon-rbjvm\" (UID: \"66db3efe-80c5-48fe-88ef-48536557da73\") " pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:23.916011 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915255 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c6d723d3-d280-4491-b3a4-7734f233fab1-sys-fs\") pod \"aws-ebs-csi-driver-node-x2vk4\" (UID: \"c6d723d3-d280-4491-b3a4-7734f233fab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4" Jul 23 20:59:23.916011 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915285 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-os-release\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:23.916011 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915325 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-host-var-lib-kubelet\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:23.916011 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915353 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-host-run-multus-certs\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:23.916011 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915392 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:23.916011 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915418 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c6d723d3-d280-4491-b3a4-7734f233fab1-etc-selinux\") pod \"aws-ebs-csi-driver-node-x2vk4\" (UID: \"c6d723d3-d280-4491-b3a4-7734f233fab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4" Jul 23 20:59:23.916011 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915451 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a18eb347-e5e5-43ba-b5fa-f73884596341-etc-tuned\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:23.916011 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915477 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/132210c5-b5be-499e-98c1-113a40450446-multus-daemon-config\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:23.916011 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915503 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-node-log\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:23.916011 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915526 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-log-socket\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:23.916612 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915551 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5e727997-ea44-49f3-a78a-2e639ce8f1a7-env-overrides\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:23.916612 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915572 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hqlm\" (UniqueName: \"kubernetes.io/projected/5e727997-ea44-49f3-a78a-2e639ce8f1a7-kube-api-access-4hqlm\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:23.916612 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915587 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c360a063-018a-4e22-978b-69dc9b659c9b-agent-certs\") pod \"konnectivity-agent-k4mpd\" (UID: \"c360a063-018a-4e22-978b-69dc9b659c9b\") " pod="kube-system/konnectivity-agent-k4mpd" Jul 23 20:59:23.916612 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915607 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/132210c5-b5be-499e-98c1-113a40450446-cni-binary-copy\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:23.916612 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915624 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-host-run-netns\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:23.916612 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915640 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-etc-openvswitch\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:23.916612 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915655 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgw4p\" (UniqueName: \"kubernetes.io/projected/a18eb347-e5e5-43ba-b5fa-f73884596341-kube-api-access-pgw4p\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:23.916612 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915670 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-host-run-netns\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:23.916612 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915695 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db899d82-4b93-4bc9-9c96-7eff79204586-system-cni-dir\") pod \"multus-additional-cni-plugins-7lf94\" (UID: \"db899d82-4b93-4bc9-9c96-7eff79204586\") " pod="openshift-multus/multus-additional-cni-plugins-7lf94" Jul 23 20:59:23.916612 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915715 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66db3efe-80c5-48fe-88ef-48536557da73-metrics-certs\") pod \"network-metrics-daemon-rbjvm\" (UID: \"66db3efe-80c5-48fe-88ef-48536557da73\") " pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:23.916612 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915734 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-var-lib-kubelet\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:23.916612 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915753 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f66dc9f4-cf62-41d2-a924-3c99f035c6fa-hosts-file\") pod \"node-resolver-5t58l\" (UID: \"f66dc9f4-cf62-41d2-a924-3c99f035c6fa\") " pod="openshift-dns/node-resolver-5t58l" Jul 23 20:59:23.916612 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915767 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-multus-cni-dir\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:23.916612 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915782 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db899d82-4b93-4bc9-9c96-7eff79204586-cnibin\") pod \"multus-additional-cni-plugins-7lf94\" (UID: \"db899d82-4b93-4bc9-9c96-7eff79204586\") " pod="openshift-multus/multus-additional-cni-plugins-7lf94" Jul 23 20:59:23.916612 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915798 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dggz2\" (UniqueName: \"kubernetes.io/projected/01b37872-acdc-426d-9aef-d964ac7a91b4-kube-api-access-dggz2\") pod \"network-check-target-v2gxq\" (UID: \"01b37872-acdc-426d-9aef-d964ac7a91b4\") " pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 20:59:23.916612 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915825 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-var-lib-openvswitch\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:23.917133 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915859 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c6d723d3-d280-4491-b3a4-7734f233fab1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x2vk4\" (UID: \"c6d723d3-d280-4491-b3a4-7734f233fab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4" Jul 23 20:59:23.917133 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915914 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c6d723d3-d280-4491-b3a4-7734f233fab1-socket-dir\") pod \"aws-ebs-csi-driver-node-x2vk4\" (UID: \"c6d723d3-d280-4491-b3a4-7734f233fab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4" Jul 23 20:59:23.917133 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915937 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-etc-kubernetes\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:23.917133 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915967 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f66dc9f4-cf62-41d2-a924-3c99f035c6fa-tmp-dir\") pod \"node-resolver-5t58l\" (UID: \"f66dc9f4-cf62-41d2-a924-3c99f035c6fa\") " pod="openshift-dns/node-resolver-5t58l" Jul 23 20:59:23.917133 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.915993 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db899d82-4b93-4bc9-9c96-7eff79204586-cni-binary-copy\") pod \"multus-additional-cni-plugins-7lf94\" (UID: \"db899d82-4b93-4bc9-9c96-7eff79204586\") " pod="openshift-multus/multus-additional-cni-plugins-7lf94" Jul 23 20:59:23.917133 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.916018 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/db899d82-4b93-4bc9-9c96-7eff79204586-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7lf94\" (UID: \"db899d82-4b93-4bc9-9c96-7eff79204586\") " pod="openshift-multus/multus-additional-cni-plugins-7lf94" Jul 23 20:59:23.917133 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.916040 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-lib-modules\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:23.917133 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.916064 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1bc0eede-3f89-44b8-9acc-244ddd68e26b-dbus\") pod \"global-pull-secret-syncer-wqmks\" (UID: \"1bc0eede-3f89-44b8-9acc-244ddd68e26b\") " pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:23.917133 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.916096 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-cnibin\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:23.917133 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.916134 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwkdf\" (UniqueName: \"kubernetes.io/projected/db899d82-4b93-4bc9-9c96-7eff79204586-kube-api-access-gwkdf\") pod \"multus-additional-cni-plugins-7lf94\" (UID: \"db899d82-4b93-4bc9-9c96-7eff79204586\") " pod="openshift-multus/multus-additional-cni-plugins-7lf94" Jul 23 20:59:23.917133 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.916168 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-host-slash\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:23.917133 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:23.916196 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5e727997-ea44-49f3-a78a-2e639ce8f1a7-ovnkube-script-lib\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.017375 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.017341 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9a5c7d21-3bf5-443a-bae4-31aef0469bdd-iptables-alerter-script\") pod \"iptables-alerter-xrgfx\" (UID: \"9a5c7d21-3bf5-443a-bae4-31aef0469bdd\") " pod="openshift-network-operator/iptables-alerter-xrgfx" Jul 23 20:59:24.017538 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.017387 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-etc-sysctl-conf\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.017538 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.017410 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-etc-kubernetes\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.017538 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.017436 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/db899d82-4b93-4bc9-9c96-7eff79204586-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7lf94\" (UID: \"db899d82-4b93-4bc9-9c96-7eff79204586\") " pod="openshift-multus/multus-additional-cni-plugins-7lf94" Jul 23 20:59:24.017538 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.017461 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5e727997-ea44-49f3-a78a-2e639ce8f1a7-ovnkube-config\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.017751 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.017531 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-etc-kubernetes\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.017751 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.017558 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-etc-sysctl-conf\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.017751 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.017594 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-hostroot\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.017751 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.017617 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-systemd-units\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.017751 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.017635 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-run-openvswitch\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.017751 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.017652 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-host\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.017751 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.017666 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c360a063-018a-4e22-978b-69dc9b659c9b-konnectivity-ca\") pod \"konnectivity-agent-k4mpd\" (UID: \"c360a063-018a-4e22-978b-69dc9b659c9b\") " pod="kube-system/konnectivity-agent-k4mpd" Jul 23 20:59:24.017751 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.017686 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w4b8\" (UniqueName: \"kubernetes.io/projected/66db3efe-80c5-48fe-88ef-48536557da73-kube-api-access-7w4b8\") pod \"network-metrics-daemon-rbjvm\" (UID: \"66db3efe-80c5-48fe-88ef-48536557da73\") " pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:24.017751 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.017703 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c6d723d3-d280-4491-b3a4-7734f233fab1-sys-fs\") pod \"aws-ebs-csi-driver-node-x2vk4\" (UID: \"c6d723d3-d280-4491-b3a4-7734f233fab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4" Jul 23 20:59:24.017751 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.017720 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-os-release\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.017751 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.017734 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-host-var-lib-kubelet\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.017751 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.017749 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-host-run-multus-certs\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.018499 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.017765 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.018499 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.017783 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c6d723d3-d280-4491-b3a4-7734f233fab1-etc-selinux\") pod \"aws-ebs-csi-driver-node-x2vk4\" (UID: \"c6d723d3-d280-4491-b3a4-7734f233fab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4" Jul 23 20:59:24.018499 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.017800 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a18eb347-e5e5-43ba-b5fa-f73884596341-etc-tuned\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.018499 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.017814 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/132210c5-b5be-499e-98c1-113a40450446-multus-daemon-config\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.018499 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.017832 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-node-log\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.018499 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.017846 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-log-socket\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.018499 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.017861 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5e727997-ea44-49f3-a78a-2e639ce8f1a7-env-overrides\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.018499 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.017877 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hqlm\" (UniqueName: \"kubernetes.io/projected/5e727997-ea44-49f3-a78a-2e639ce8f1a7-kube-api-access-4hqlm\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.018499 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.017893 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c360a063-018a-4e22-978b-69dc9b659c9b-agent-certs\") pod \"konnectivity-agent-k4mpd\" (UID: \"c360a063-018a-4e22-978b-69dc9b659c9b\") " pod="kube-system/konnectivity-agent-k4mpd" Jul 23 20:59:24.018499 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.017912 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/132210c5-b5be-499e-98c1-113a40450446-cni-binary-copy\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.018499 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.017955 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-host-run-netns\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.018499 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018015 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-etc-openvswitch\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.018499 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018041 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgw4p\" (UniqueName: \"kubernetes.io/projected/a18eb347-e5e5-43ba-b5fa-f73884596341-kube-api-access-pgw4p\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.018499 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018075 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-host-run-netns\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.018499 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018102 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db899d82-4b93-4bc9-9c96-7eff79204586-system-cni-dir\") pod \"multus-additional-cni-plugins-7lf94\" (UID: \"db899d82-4b93-4bc9-9c96-7eff79204586\") " pod="openshift-multus/multus-additional-cni-plugins-7lf94" Jul 23 20:59:24.018499 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018130 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66db3efe-80c5-48fe-88ef-48536557da73-metrics-certs\") pod \"network-metrics-daemon-rbjvm\" (UID: \"66db3efe-80c5-48fe-88ef-48536557da73\") " pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:24.018499 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018157 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-var-lib-kubelet\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.019390 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018186 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f66dc9f4-cf62-41d2-a924-3c99f035c6fa-hosts-file\") pod \"node-resolver-5t58l\" (UID: \"f66dc9f4-cf62-41d2-a924-3c99f035c6fa\") " pod="openshift-dns/node-resolver-5t58l" Jul 23 20:59:24.019390 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018213 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-multus-cni-dir\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.019390 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018238 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db899d82-4b93-4bc9-9c96-7eff79204586-cnibin\") pod \"multus-additional-cni-plugins-7lf94\" (UID: \"db899d82-4b93-4bc9-9c96-7eff79204586\") " pod="openshift-multus/multus-additional-cni-plugins-7lf94" Jul 23 20:59:24.019390 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018240 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9a5c7d21-3bf5-443a-bae4-31aef0469bdd-iptables-alerter-script\") pod \"iptables-alerter-xrgfx\" (UID: \"9a5c7d21-3bf5-443a-bae4-31aef0469bdd\") " pod="openshift-network-operator/iptables-alerter-xrgfx" Jul 23 20:59:24.019390 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018251 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/db899d82-4b93-4bc9-9c96-7eff79204586-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7lf94\" (UID: \"db899d82-4b93-4bc9-9c96-7eff79204586\") " pod="openshift-multus/multus-additional-cni-plugins-7lf94" Jul 23 20:59:24.019390 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018270 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dggz2\" (UniqueName: \"kubernetes.io/projected/01b37872-acdc-426d-9aef-d964ac7a91b4-kube-api-access-dggz2\") pod \"network-check-target-v2gxq\" (UID: \"01b37872-acdc-426d-9aef-d964ac7a91b4\") " pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 20:59:24.019390 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018301 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-var-lib-openvswitch\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.019390 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018302 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-node-log\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.019390 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018315 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-hostroot\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.019390 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018351 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c6d723d3-d280-4491-b3a4-7734f233fab1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x2vk4\" (UID: \"c6d723d3-d280-4491-b3a4-7734f233fab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4" Jul 23 20:59:24.019390 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018376 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-systemd-units\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.019390 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018386 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c6d723d3-d280-4491-b3a4-7734f233fab1-socket-dir\") pod \"aws-ebs-csi-driver-node-x2vk4\" (UID: \"c6d723d3-d280-4491-b3a4-7734f233fab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4" Jul 23 20:59:24.019390 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018390 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-os-release\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.019390 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018414 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-etc-kubernetes\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.019390 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018437 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-host-run-netns\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.019390 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018444 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f66dc9f4-cf62-41d2-a924-3c99f035c6fa-tmp-dir\") pod \"node-resolver-5t58l\" (UID: \"f66dc9f4-cf62-41d2-a924-3c99f035c6fa\") " pod="openshift-dns/node-resolver-5t58l" Jul 23 20:59:24.019390 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018452 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-var-lib-kubelet\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.020771 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018473 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db899d82-4b93-4bc9-9c96-7eff79204586-cni-binary-copy\") pod \"multus-additional-cni-plugins-7lf94\" (UID: \"db899d82-4b93-4bc9-9c96-7eff79204586\") " pod="openshift-multus/multus-additional-cni-plugins-7lf94" Jul 23 20:59:24.020771 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018503 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/db899d82-4b93-4bc9-9c96-7eff79204586-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7lf94\" (UID: \"db899d82-4b93-4bc9-9c96-7eff79204586\") " pod="openshift-multus/multus-additional-cni-plugins-7lf94" Jul 23 20:59:24.020771 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:24.018516 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 20:59:24.020771 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018526 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f66dc9f4-cf62-41d2-a924-3c99f035c6fa-hosts-file\") pod \"node-resolver-5t58l\" (UID: \"f66dc9f4-cf62-41d2-a924-3c99f035c6fa\") " pod="openshift-dns/node-resolver-5t58l" Jul 23 20:59:24.020771 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018531 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-lib-modules\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.020771 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018578 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db899d82-4b93-4bc9-9c96-7eff79204586-cnibin\") pod \"multus-additional-cni-plugins-7lf94\" (UID: \"db899d82-4b93-4bc9-9c96-7eff79204586\") " pod="openshift-multus/multus-additional-cni-plugins-7lf94" Jul 23 20:59:24.020771 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018711 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-multus-cni-dir\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.020771 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018769 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5e727997-ea44-49f3-a78a-2e639ce8f1a7-env-overrides\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.020771 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018787 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-var-lib-openvswitch\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.020771 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018801 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c6d723d3-d280-4491-b3a4-7734f233fab1-etc-selinux\") pod \"aws-ebs-csi-driver-node-x2vk4\" (UID: \"c6d723d3-d280-4491-b3a4-7734f233fab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4" Jul 23 20:59:24.020771 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018830 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-log-socket\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.020771 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018837 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-host-run-multus-certs\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.020771 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018852 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-host-var-lib-kubelet\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.020771 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018873 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c360a063-018a-4e22-978b-69dc9b659c9b-konnectivity-ca\") pod \"konnectivity-agent-k4mpd\" (UID: \"c360a063-018a-4e22-978b-69dc9b659c9b\") " pod="kube-system/konnectivity-agent-k4mpd" Jul 23 20:59:24.020771 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018954 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-etc-kubernetes\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.020771 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.018963 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-host\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.020771 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.019136 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 23 20:59:24.020771 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.019392 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c6d723d3-d280-4491-b3a4-7734f233fab1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x2vk4\" (UID: \"c6d723d3-d280-4491-b3a4-7734f233fab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4" Jul 23 20:59:24.021654 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.019446 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/132210c5-b5be-499e-98c1-113a40450446-multus-daemon-config\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.021654 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.019459 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/132210c5-b5be-499e-98c1-113a40450446-cni-binary-copy\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.021654 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.019499 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c6d723d3-d280-4491-b3a4-7734f233fab1-socket-dir\") pod \"aws-ebs-csi-driver-node-x2vk4\" (UID: \"c6d723d3-d280-4491-b3a4-7734f233fab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4" Jul 23 20:59:24.021654 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.019507 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db899d82-4b93-4bc9-9c96-7eff79204586-cni-binary-copy\") pod \"multus-additional-cni-plugins-7lf94\" (UID: \"db899d82-4b93-4bc9-9c96-7eff79204586\") " pod="openshift-multus/multus-additional-cni-plugins-7lf94" Jul 23 20:59:24.021654 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.019513 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db899d82-4b93-4bc9-9c96-7eff79204586-system-cni-dir\") pod \"multus-additional-cni-plugins-7lf94\" (UID: \"db899d82-4b93-4bc9-9c96-7eff79204586\") " pod="openshift-multus/multus-additional-cni-plugins-7lf94" Jul 23 20:59:24.021654 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.019586 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.021654 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.019591 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1bc0eede-3f89-44b8-9acc-244ddd68e26b-dbus\") pod \"global-pull-secret-syncer-wqmks\" (UID: \"1bc0eede-3f89-44b8-9acc-244ddd68e26b\") " pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:24.021654 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.019607 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-lib-modules\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.021654 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:24.019632 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66db3efe-80c5-48fe-88ef-48536557da73-metrics-certs podName:66db3efe-80c5-48fe-88ef-48536557da73 nodeName:}" failed. No retries permitted until 2026-07-23 20:59:24.519606082 +0000 UTC m=+2.082040053 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66db3efe-80c5-48fe-88ef-48536557da73-metrics-certs") pod "network-metrics-daemon-rbjvm" (UID: "66db3efe-80c5-48fe-88ef-48536557da73") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 20:59:24.021654 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.019704 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f66dc9f4-cf62-41d2-a924-3c99f035c6fa-tmp-dir\") pod \"node-resolver-5t58l\" (UID: \"f66dc9f4-cf62-41d2-a924-3c99f035c6fa\") " pod="openshift-dns/node-resolver-5t58l" Jul 23 20:59:24.021654 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.019781 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-cnibin\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.021654 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.019811 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwkdf\" (UniqueName: \"kubernetes.io/projected/db899d82-4b93-4bc9-9c96-7eff79204586-kube-api-access-gwkdf\") pod \"multus-additional-cni-plugins-7lf94\" (UID: \"db899d82-4b93-4bc9-9c96-7eff79204586\") " pod="openshift-multus/multus-additional-cni-plugins-7lf94" Jul 23 20:59:24.021654 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.019838 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-host-slash\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.021654 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.019838 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-host-run-netns\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.021654 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.019896 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5e727997-ea44-49f3-a78a-2e639ce8f1a7-ovnkube-script-lib\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.021654 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.019915 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-cnibin\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.021654 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.019926 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1bc0eede-3f89-44b8-9acc-244ddd68e26b-dbus\") pod \"global-pull-secret-syncer-wqmks\" (UID: \"1bc0eede-3f89-44b8-9acc-244ddd68e26b\") " pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:24.022692 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.019934 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a5c7d21-3bf5-443a-bae4-31aef0469bdd-host-slash\") pod \"iptables-alerter-xrgfx\" (UID: \"9a5c7d21-3bf5-443a-bae4-31aef0469bdd\") " pod="openshift-network-operator/iptables-alerter-xrgfx" Jul 23 20:59:24.022692 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.019970 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-etc-openvswitch\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.022692 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.019974 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c6d723d3-d280-4491-b3a4-7734f233fab1-sys-fs\") pod \"aws-ebs-csi-driver-node-x2vk4\" (UID: \"c6d723d3-d280-4491-b3a4-7734f233fab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4" Jul 23 20:59:24.022692 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.020027 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a5c7d21-3bf5-443a-bae4-31aef0469bdd-host-slash\") pod \"iptables-alerter-xrgfx\" (UID: \"9a5c7d21-3bf5-443a-bae4-31aef0469bdd\") " pod="openshift-network-operator/iptables-alerter-xrgfx" Jul 23 20:59:24.022692 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.020069 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-host-slash\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.022692 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.020168 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/db899d82-4b93-4bc9-9c96-7eff79204586-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7lf94\" (UID: \"db899d82-4b93-4bc9-9c96-7eff79204586\") " pod="openshift-multus/multus-additional-cni-plugins-7lf94" Jul 23 20:59:24.022692 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.020194 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-run-openvswitch\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.022692 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.020209 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-host-kubelet\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.022692 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.020236 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-run\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.022692 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.020278 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bc0eede-3f89-44b8-9acc-244ddd68e26b-original-pull-secret\") pod \"global-pull-secret-syncer-wqmks\" (UID: \"1bc0eede-3f89-44b8-9acc-244ddd68e26b\") " pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:24.022692 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.020280 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-run\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.022692 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.020319 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-host-kubelet\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.022692 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:24.020356 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 20:59:24.022692 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.020389 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6c822b6-da7a-488f-9c36-cfb188240ae4-host\") pod \"node-ca-ndd69\" (UID: \"d6c822b6-da7a-488f-9c36-cfb188240ae4\") " pod="openshift-image-registry/node-ca-ndd69" Jul 23 20:59:24.022692 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.020414 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-multus-conf-dir\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.022692 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.020450 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67rs9\" (UniqueName: \"kubernetes.io/projected/132210c5-b5be-499e-98c1-113a40450446-kube-api-access-67rs9\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.022692 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.020492 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db899d82-4b93-4bc9-9c96-7eff79204586-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7lf94\" (UID: \"db899d82-4b93-4bc9-9c96-7eff79204586\") " pod="openshift-multus/multus-additional-cni-plugins-7lf94" Jul 23 20:59:24.022692 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.020536 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-host-run-k8s-cni-cncf-io\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.023660 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.020564 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e727997-ea44-49f3-a78a-2e639ce8f1a7-ovn-node-metrics-cert\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.023660 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.020591 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh8s6\" (UniqueName: \"kubernetes.io/projected/9a5c7d21-3bf5-443a-bae4-31aef0469bdd-kube-api-access-nh8s6\") pod \"iptables-alerter-xrgfx\" (UID: \"9a5c7d21-3bf5-443a-bae4-31aef0469bdd\") " pod="openshift-network-operator/iptables-alerter-xrgfx" Jul 23 20:59:24.023660 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.020607 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5e727997-ea44-49f3-a78a-2e639ce8f1a7-ovnkube-script-lib\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.023660 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.020650 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5e727997-ea44-49f3-a78a-2e639ce8f1a7-ovnkube-config\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.023660 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.020618 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-etc-modprobe-d\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.023660 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.020707 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-etc-systemd\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.023660 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.020735 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1bc0eede-3f89-44b8-9acc-244ddd68e26b-kubelet-config\") pod \"global-pull-secret-syncer-wqmks\" (UID: \"1bc0eede-3f89-44b8-9acc-244ddd68e26b\") " pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:24.023660 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.020752 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-etc-modprobe-d\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.023660 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.020758 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cj92\" (UniqueName: \"kubernetes.io/projected/d6c822b6-da7a-488f-9c36-cfb188240ae4-kube-api-access-8cj92\") pod \"node-ca-ndd69\" (UID: \"d6c822b6-da7a-488f-9c36-cfb188240ae4\") " pod="openshift-image-registry/node-ca-ndd69" Jul 23 20:59:24.023660 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.020781 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-multus-socket-dir-parent\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.023660 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.020789 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-multus-conf-dir\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.023660 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.020804 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-host-var-lib-cni-multus\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.023660 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.020863 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6c822b6-da7a-488f-9c36-cfb188240ae4-host\") pod \"node-ca-ndd69\" (UID: \"d6c822b6-da7a-488f-9c36-cfb188240ae4\") " pod="openshift-image-registry/node-ca-ndd69" Jul 23 20:59:24.023660 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.021069 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-host-run-k8s-cni-cncf-io\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.023660 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.021115 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db899d82-4b93-4bc9-9c96-7eff79204586-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7lf94\" (UID: \"db899d82-4b93-4bc9-9c96-7eff79204586\") " pod="openshift-multus/multus-additional-cni-plugins-7lf94" Jul 23 20:59:24.023660 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:24.021185 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bc0eede-3f89-44b8-9acc-244ddd68e26b-original-pull-secret podName:1bc0eede-3f89-44b8-9acc-244ddd68e26b nodeName:}" failed. No retries permitted until 2026-07-23 20:59:24.521166384 +0000 UTC m=+2.083600364 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1bc0eede-3f89-44b8-9acc-244ddd68e26b-original-pull-secret") pod "global-pull-secret-syncer-wqmks" (UID: "1bc0eede-3f89-44b8-9acc-244ddd68e26b") : object "kube-system"/"original-pull-secret" not registered Jul 23 20:59:24.024442 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.021229 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.024442 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.021262 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-host-var-lib-cni-bin\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.024442 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.021308 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db899d82-4b93-4bc9-9c96-7eff79204586-os-release\") pod \"multus-additional-cni-plugins-7lf94\" (UID: \"db899d82-4b93-4bc9-9c96-7eff79204586\") " pod="openshift-multus/multus-additional-cni-plugins-7lf94" Jul 23 20:59:24.024442 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.021340 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-run-systemd\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.024442 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.021387 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-run-ovn\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.024442 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.021484 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c6d723d3-d280-4491-b3a4-7734f233fab1-registration-dir\") pod \"aws-ebs-csi-driver-node-x2vk4\" (UID: \"c6d723d3-d280-4491-b3a4-7734f233fab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4" Jul 23 20:59:24.024442 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.021508 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.024442 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.021521 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-etc-sysctl-d\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.024442 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.021554 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a18eb347-e5e5-43ba-b5fa-f73884596341-tmp\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.024442 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.021584 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d6c822b6-da7a-488f-9c36-cfb188240ae4-serviceca\") pod \"node-ca-ndd69\" (UID: \"d6c822b6-da7a-488f-9c36-cfb188240ae4\") " pod="openshift-image-registry/node-ca-ndd69" Jul 23 20:59:24.024442 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.021610 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-host-cni-netd\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.024442 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.021677 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c6d723d3-d280-4491-b3a4-7734f233fab1-registration-dir\") pod \"aws-ebs-csi-driver-node-x2vk4\" (UID: \"c6d723d3-d280-4491-b3a4-7734f233fab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4" Jul 23 20:59:24.024442 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.021719 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-run-systemd\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.024442 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.021765 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c6d723d3-d280-4491-b3a4-7734f233fab1-device-dir\") pod \"aws-ebs-csi-driver-node-x2vk4\" (UID: \"c6d723d3-d280-4491-b3a4-7734f233fab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4" Jul 23 20:59:24.024442 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.021774 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-etc-sysctl-d\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.024442 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.021918 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-run-ovn\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.024442 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.021985 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-host-cni-netd\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.025325 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.022049 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-multus-socket-dir-parent\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.025325 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.022079 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db899d82-4b93-4bc9-9c96-7eff79204586-os-release\") pod \"multus-additional-cni-plugins-7lf94\" (UID: \"db899d82-4b93-4bc9-9c96-7eff79204586\") " pod="openshift-multus/multus-additional-cni-plugins-7lf94" Jul 23 20:59:24.025325 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.022095 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-host-var-lib-cni-bin\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.025325 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.022142 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k8mb\" (UniqueName: \"kubernetes.io/projected/c6d723d3-d280-4491-b3a4-7734f233fab1-kube-api-access-8k8mb\") pod \"aws-ebs-csi-driver-node-x2vk4\" (UID: \"c6d723d3-d280-4491-b3a4-7734f233fab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4" Jul 23 20:59:24.025325 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.022144 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1bc0eede-3f89-44b8-9acc-244ddd68e26b-kubelet-config\") pod \"global-pull-secret-syncer-wqmks\" (UID: \"1bc0eede-3f89-44b8-9acc-244ddd68e26b\") " pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:24.025325 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.022178 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-etc-sysconfig\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.025325 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.022210 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-sys\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.025325 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.022238 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-host-var-lib-cni-multus\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.025325 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.022242 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnd5d\" (UniqueName: \"kubernetes.io/projected/f66dc9f4-cf62-41d2-a924-3c99f035c6fa-kube-api-access-vnd5d\") pod \"node-resolver-5t58l\" (UID: \"f66dc9f4-cf62-41d2-a924-3c99f035c6fa\") " pod="openshift-dns/node-resolver-5t58l" Jul 23 20:59:24.025325 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.022289 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-system-cni-dir\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.025325 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.022289 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-etc-sysconfig\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.025325 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.022300 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-etc-systemd\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.025325 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.022334 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c6d723d3-d280-4491-b3a4-7734f233fab1-device-dir\") pod \"aws-ebs-csi-driver-node-x2vk4\" (UID: \"c6d723d3-d280-4491-b3a4-7734f233fab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4" Jul 23 20:59:24.025325 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.022371 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/132210c5-b5be-499e-98c1-113a40450446-system-cni-dir\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.025325 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.022434 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a18eb347-e5e5-43ba-b5fa-f73884596341-sys\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.025325 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.022502 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-host-cni-bin\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.025325 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.022523 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d6c822b6-da7a-488f-9c36-cfb188240ae4-serviceca\") pod \"node-ca-ndd69\" (UID: \"d6c822b6-da7a-488f-9c36-cfb188240ae4\") " pod="openshift-image-registry/node-ca-ndd69" Jul 23 20:59:24.025325 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.022544 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e727997-ea44-49f3-a78a-2e639ce8f1a7-host-cni-bin\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.026126 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.024879 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e727997-ea44-49f3-a78a-2e639ce8f1a7-ovn-node-metrics-cert\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.026126 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.025148 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a18eb347-e5e5-43ba-b5fa-f73884596341-etc-tuned\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.026126 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.025245 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c360a063-018a-4e22-978b-69dc9b659c9b-agent-certs\") pod \"konnectivity-agent-k4mpd\" (UID: \"c360a063-018a-4e22-978b-69dc9b659c9b\") " pod="kube-system/konnectivity-agent-k4mpd" Jul 23 20:59:24.026126 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.025384 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a18eb347-e5e5-43ba-b5fa-f73884596341-tmp\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.030029 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.030012 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 20:59:24.031380 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:24.031360 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 20:59:24.031527 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:24.031388 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 20:59:24.031527 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:24.031403 2575 projected.go:196] Error preparing data for projected volume kube-api-access-dggz2 for pod openshift-network-diagnostics/network-check-target-v2gxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 20:59:24.031527 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:24.031476 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01b37872-acdc-426d-9aef-d964ac7a91b4-kube-api-access-dggz2 podName:01b37872-acdc-426d-9aef-d964ac7a91b4 nodeName:}" failed. No retries permitted until 2026-07-23 20:59:24.531456944 +0000 UTC m=+2.093890934 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dggz2" (UniqueName: "kubernetes.io/projected/01b37872-acdc-426d-9aef-d964ac7a91b4-kube-api-access-dggz2") pod "network-check-target-v2gxq" (UID: "01b37872-acdc-426d-9aef-d964ac7a91b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 20:59:24.034220 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.034194 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgw4p\" (UniqueName: \"kubernetes.io/projected/a18eb347-e5e5-43ba-b5fa-f73884596341-kube-api-access-pgw4p\") pod \"tuned-xk77s\" (UID: \"a18eb347-e5e5-43ba-b5fa-f73884596341\") " pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.034633 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.034595 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w4b8\" (UniqueName: \"kubernetes.io/projected/66db3efe-80c5-48fe-88ef-48536557da73-kube-api-access-7w4b8\") pod \"network-metrics-daemon-rbjvm\" (UID: \"66db3efe-80c5-48fe-88ef-48536557da73\") " pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:24.036163 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.036141 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k8mb\" (UniqueName: \"kubernetes.io/projected/c6d723d3-d280-4491-b3a4-7734f233fab1-kube-api-access-8k8mb\") pod \"aws-ebs-csi-driver-node-x2vk4\" (UID: \"c6d723d3-d280-4491-b3a4-7734f233fab1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4" Jul 23 20:59:24.036285 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.036260 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh8s6\" (UniqueName: \"kubernetes.io/projected/9a5c7d21-3bf5-443a-bae4-31aef0469bdd-kube-api-access-nh8s6\") pod \"iptables-alerter-xrgfx\" (UID: \"9a5c7d21-3bf5-443a-bae4-31aef0469bdd\") " pod="openshift-network-operator/iptables-alerter-xrgfx" Jul 23 20:59:24.036440 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.036353 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnd5d\" (UniqueName: \"kubernetes.io/projected/f66dc9f4-cf62-41d2-a924-3c99f035c6fa-kube-api-access-vnd5d\") pod \"node-resolver-5t58l\" (UID: \"f66dc9f4-cf62-41d2-a924-3c99f035c6fa\") " pod="openshift-dns/node-resolver-5t58l" Jul 23 20:59:24.036516 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.036472 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cj92\" (UniqueName: \"kubernetes.io/projected/d6c822b6-da7a-488f-9c36-cfb188240ae4-kube-api-access-8cj92\") pod \"node-ca-ndd69\" (UID: \"d6c822b6-da7a-488f-9c36-cfb188240ae4\") " pod="openshift-image-registry/node-ca-ndd69" Jul 23 20:59:24.036754 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.036733 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwkdf\" (UniqueName: \"kubernetes.io/projected/db899d82-4b93-4bc9-9c96-7eff79204586-kube-api-access-gwkdf\") pod \"multus-additional-cni-plugins-7lf94\" (UID: \"db899d82-4b93-4bc9-9c96-7eff79204586\") " pod="openshift-multus/multus-additional-cni-plugins-7lf94" Jul 23 20:59:24.036931 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:24.036904 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a91334f2b2daa9817292f0040684ba7.slice/crio-b445126434c6c19d6d20b1dee159752de74d8a8c8b1601d2510f9a21d62dd007 WatchSource:0}: Error finding container b445126434c6c19d6d20b1dee159752de74d8a8c8b1601d2510f9a21d62dd007: Status 404 returned error can't find the container with id b445126434c6c19d6d20b1dee159752de74d8a8c8b1601d2510f9a21d62dd007 Jul 23 20:59:24.037983 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.037958 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67rs9\" (UniqueName: \"kubernetes.io/projected/132210c5-b5be-499e-98c1-113a40450446-kube-api-access-67rs9\") pod \"multus-lf85l\" (UID: \"132210c5-b5be-499e-98c1-113a40450446\") " pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.038968 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.038948 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hqlm\" (UniqueName: \"kubernetes.io/projected/5e727997-ea44-49f3-a78a-2e639ce8f1a7-kube-api-access-4hqlm\") pod \"ovnkube-node-6dqgm\" (UID: \"5e727997-ea44-49f3-a78a-2e639ce8f1a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.141303 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.141213 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k4mpd" Jul 23 20:59:24.151380 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:24.151349 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc360a063_018a_4e22_978b_69dc9b659c9b.slice/crio-145e5c6080c6cdf21787627c68d29e985c3fe8799fbd651e7635cb63f8e00765 WatchSource:0}: Error finding container 145e5c6080c6cdf21787627c68d29e985c3fe8799fbd651e7635cb63f8e00765: Status 404 returned error can't find the container with id 145e5c6080c6cdf21787627c68d29e985c3fe8799fbd651e7635cb63f8e00765 Jul 23 20:59:24.159718 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.159697 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ndd69" Jul 23 20:59:24.167816 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.167793 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lf85l" Jul 23 20:59:24.168847 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:24.168823 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6c822b6_da7a_488f_9c36_cfb188240ae4.slice/crio-71bb6a4a0bfa3921f58d819001c7648ed678ab62e2398cd33903505ad0825781 WatchSource:0}: Error finding container 71bb6a4a0bfa3921f58d819001c7648ed678ab62e2398cd33903505ad0825781: Status 404 returned error can't find the container with id 71bb6a4a0bfa3921f58d819001c7648ed678ab62e2398cd33903505ad0825781 Jul 23 20:59:24.176761 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:24.176729 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod132210c5_b5be_499e_98c1_113a40450446.slice/crio-eae25ca5ec50673239ada3bd19dab0230406514ed3b1b31c7fa95956d15e49d1 WatchSource:0}: Error finding container eae25ca5ec50673239ada3bd19dab0230406514ed3b1b31c7fa95956d15e49d1: Status 404 returned error can't find the container with id eae25ca5ec50673239ada3bd19dab0230406514ed3b1b31c7fa95956d15e49d1 Jul 23 20:59:24.185663 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.185644 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xrgfx" Jul 23 20:59:24.195651 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:24.195628 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a5c7d21_3bf5_443a_bae4_31aef0469bdd.slice/crio-dee03f5671da3f6fa49f553e8a6a55335069fcf4255e991fb44263748d5d3c49 WatchSource:0}: Error finding container dee03f5671da3f6fa49f553e8a6a55335069fcf4255e991fb44263748d5d3c49: Status 404 returned error can't find the container with id dee03f5671da3f6fa49f553e8a6a55335069fcf4255e991fb44263748d5d3c49 Jul 23 20:59:24.200841 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.200819 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4" Jul 23 20:59:24.209214 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:24.209194 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6d723d3_d280_4491_b3a4_7734f233fab1.slice/crio-7d6e6a7a1aabdd863a434a79c3fbf43d328c10e61fb6d8e9e186028f6901dc38 WatchSource:0}: Error finding container 7d6e6a7a1aabdd863a434a79c3fbf43d328c10e61fb6d8e9e186028f6901dc38: Status 404 returned error can't find the container with id 7d6e6a7a1aabdd863a434a79c3fbf43d328c10e61fb6d8e9e186028f6901dc38 Jul 23 20:59:24.218825 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.218806 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xk77s" Jul 23 20:59:24.226732 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:24.226706 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda18eb347_e5e5_43ba_b5fa_f73884596341.slice/crio-15e4d400106f8d33926e08e4c856249118978088c583eee32351f040f339d9d6 WatchSource:0}: Error finding container 15e4d400106f8d33926e08e4c856249118978088c583eee32351f040f339d9d6: Status 404 returned error can't find the container with id 15e4d400106f8d33926e08e4c856249118978088c583eee32351f040f339d9d6 Jul 23 20:59:24.239957 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.239924 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5t58l" Jul 23 20:59:24.248669 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:24.248643 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf66dc9f4_cf62_41d2_a924_3c99f035c6fa.slice/crio-ae5e77b06379d27799493a4995c699000984c68edbe51f48ae5bc8b3b67c79c0 WatchSource:0}: Error finding container ae5e77b06379d27799493a4995c699000984c68edbe51f48ae5bc8b3b67c79c0: Status 404 returned error can't find the container with id ae5e77b06379d27799493a4995c699000984c68edbe51f48ae5bc8b3b67c79c0 Jul 23 20:59:24.253627 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.253611 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7lf94" Jul 23 20:59:24.258807 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.258791 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:24.263160 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:24.263137 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb899d82_4b93_4bc9_9c96_7eff79204586.slice/crio-b54e8b1cc90aeae4d5d9adce77455e45015adfc23697a172f3aa50e767b0192b WatchSource:0}: Error finding container b54e8b1cc90aeae4d5d9adce77455e45015adfc23697a172f3aa50e767b0192b: Status 404 returned error can't find the container with id b54e8b1cc90aeae4d5d9adce77455e45015adfc23697a172f3aa50e767b0192b Jul 23 20:59:24.267790 ip-10-0-139-105 kubenswrapper[2575]: W0723 20:59:24.267767 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e727997_ea44_49f3_a78a_2e639ce8f1a7.slice/crio-20c4a04fe3ea2d9936cfab08eae64e2d49447d18c5cc3f9c37770807f56ac676 WatchSource:0}: Error finding container 20c4a04fe3ea2d9936cfab08eae64e2d49447d18c5cc3f9c37770807f56ac676: Status 404 returned error can't find the container with id 20c4a04fe3ea2d9936cfab08eae64e2d49447d18c5cc3f9c37770807f56ac676 Jul 23 20:59:24.526182 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.526143 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66db3efe-80c5-48fe-88ef-48536557da73-metrics-certs\") pod \"network-metrics-daemon-rbjvm\" (UID: \"66db3efe-80c5-48fe-88ef-48536557da73\") " pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:24.526368 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.526238 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bc0eede-3f89-44b8-9acc-244ddd68e26b-original-pull-secret\") pod \"global-pull-secret-syncer-wqmks\" (UID: \"1bc0eede-3f89-44b8-9acc-244ddd68e26b\") " pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:24.526439 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:24.526386 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 20:59:24.526506 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:24.526471 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bc0eede-3f89-44b8-9acc-244ddd68e26b-original-pull-secret podName:1bc0eede-3f89-44b8-9acc-244ddd68e26b nodeName:}" failed. No retries permitted until 2026-07-23 20:59:25.52643626 +0000 UTC m=+3.088870247 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1bc0eede-3f89-44b8-9acc-244ddd68e26b-original-pull-secret") pod "global-pull-secret-syncer-wqmks" (UID: "1bc0eede-3f89-44b8-9acc-244ddd68e26b") : object "kube-system"/"original-pull-secret" not registered Jul 23 20:59:24.526887 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:24.526868 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 20:59:24.526982 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:24.526910 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66db3efe-80c5-48fe-88ef-48536557da73-metrics-certs podName:66db3efe-80c5-48fe-88ef-48536557da73 nodeName:}" failed. No retries permitted until 2026-07-23 20:59:25.526899194 +0000 UTC m=+3.089333158 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66db3efe-80c5-48fe-88ef-48536557da73-metrics-certs") pod "network-metrics-daemon-rbjvm" (UID: "66db3efe-80c5-48fe-88ef-48536557da73") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 20:59:24.627316 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.627273 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dggz2\" (UniqueName: \"kubernetes.io/projected/01b37872-acdc-426d-9aef-d964ac7a91b4-kube-api-access-dggz2\") pod \"network-check-target-v2gxq\" (UID: \"01b37872-acdc-426d-9aef-d964ac7a91b4\") " pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 20:59:24.627518 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:24.627443 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 20:59:24.627518 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:24.627467 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 20:59:24.627518 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:24.627479 2575 projected.go:196] Error preparing data for projected volume kube-api-access-dggz2 for pod openshift-network-diagnostics/network-check-target-v2gxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 20:59:24.627688 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:24.627543 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01b37872-acdc-426d-9aef-d964ac7a91b4-kube-api-access-dggz2 podName:01b37872-acdc-426d-9aef-d964ac7a91b4 nodeName:}" failed. No retries permitted until 2026-07-23 20:59:25.627522746 +0000 UTC m=+3.189956714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dggz2" (UniqueName: "kubernetes.io/projected/01b37872-acdc-426d-9aef-d964ac7a91b4-kube-api-access-dggz2") pod "network-check-target-v2gxq" (UID: "01b37872-acdc-426d-9aef-d964ac7a91b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 20:59:24.863872 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.863701 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 20:54:24 +0000 UTC" deadline="2028-04-22 14:41:56.081724558 +0000 UTC" Jul 23 20:59:24.863872 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:24.863766 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15329h42m31.217963188s" Jul 23 20:59:25.002200 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:25.002139 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5t58l" event={"ID":"f66dc9f4-cf62-41d2-a924-3c99f035c6fa","Type":"ContainerStarted","Data":"ae5e77b06379d27799493a4995c699000984c68edbe51f48ae5bc8b3b67c79c0"} Jul 23 20:59:25.020433 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:25.020391 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xk77s" event={"ID":"a18eb347-e5e5-43ba-b5fa-f73884596341","Type":"ContainerStarted","Data":"15e4d400106f8d33926e08e4c856249118978088c583eee32351f040f339d9d6"} Jul 23 20:59:25.055454 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:25.055414 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xrgfx" event={"ID":"9a5c7d21-3bf5-443a-bae4-31aef0469bdd","Type":"ContainerStarted","Data":"dee03f5671da3f6fa49f553e8a6a55335069fcf4255e991fb44263748d5d3c49"} Jul 23 20:59:25.067720 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:25.067680 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ndd69" event={"ID":"d6c822b6-da7a-488f-9c36-cfb188240ae4","Type":"ContainerStarted","Data":"71bb6a4a0bfa3921f58d819001c7648ed678ab62e2398cd33903505ad0825781"} Jul 23 20:59:25.092890 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:25.092786 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k4mpd" event={"ID":"c360a063-018a-4e22-978b-69dc9b659c9b","Type":"ContainerStarted","Data":"145e5c6080c6cdf21787627c68d29e985c3fe8799fbd651e7635cb63f8e00765"} Jul 23 20:59:25.101221 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:25.101108 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-105.ec2.internal" event={"ID":"6a91334f2b2daa9817292f0040684ba7","Type":"ContainerStarted","Data":"b445126434c6c19d6d20b1dee159752de74d8a8c8b1601d2510f9a21d62dd007"} Jul 23 20:59:25.107505 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:25.107388 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" event={"ID":"5e727997-ea44-49f3-a78a-2e639ce8f1a7","Type":"ContainerStarted","Data":"20c4a04fe3ea2d9936cfab08eae64e2d49447d18c5cc3f9c37770807f56ac676"} Jul 23 20:59:25.125236 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:25.125136 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7lf94" event={"ID":"db899d82-4b93-4bc9-9c96-7eff79204586","Type":"ContainerStarted","Data":"b54e8b1cc90aeae4d5d9adce77455e45015adfc23697a172f3aa50e767b0192b"} Jul 23 20:59:25.138437 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:25.138120 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4" event={"ID":"c6d723d3-d280-4491-b3a4-7734f233fab1","Type":"ContainerStarted","Data":"7d6e6a7a1aabdd863a434a79c3fbf43d328c10e61fb6d8e9e186028f6901dc38"} Jul 23 20:59:25.151956 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:25.150239 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lf85l" event={"ID":"132210c5-b5be-499e-98c1-113a40450446","Type":"ContainerStarted","Data":"eae25ca5ec50673239ada3bd19dab0230406514ed3b1b31c7fa95956d15e49d1"} Jul 23 20:59:25.169491 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:25.169281 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-105.ec2.internal" event={"ID":"a88942796a5b6b2c5f36a7e709e10120","Type":"ContainerStarted","Data":"dbe4bbfb45bc1aafd12eeb8b8219860e526b293c83bafc64e92e70530e626cbc"} Jul 23 20:59:25.193565 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:25.193338 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 20:59:25.264116 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:25.263867 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 20:59:25.535594 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:25.534716 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66db3efe-80c5-48fe-88ef-48536557da73-metrics-certs\") pod \"network-metrics-daemon-rbjvm\" (UID: \"66db3efe-80c5-48fe-88ef-48536557da73\") " pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:25.535594 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:25.534792 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bc0eede-3f89-44b8-9acc-244ddd68e26b-original-pull-secret\") pod \"global-pull-secret-syncer-wqmks\" (UID: \"1bc0eede-3f89-44b8-9acc-244ddd68e26b\") " pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:25.535594 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:25.534955 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 20:59:25.535594 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:25.535026 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bc0eede-3f89-44b8-9acc-244ddd68e26b-original-pull-secret podName:1bc0eede-3f89-44b8-9acc-244ddd68e26b nodeName:}" failed. No retries permitted until 2026-07-23 20:59:27.535007124 +0000 UTC m=+5.097441112 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1bc0eede-3f89-44b8-9acc-244ddd68e26b-original-pull-secret") pod "global-pull-secret-syncer-wqmks" (UID: "1bc0eede-3f89-44b8-9acc-244ddd68e26b") : object "kube-system"/"original-pull-secret" not registered Jul 23 20:59:25.535594 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:25.535476 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 20:59:25.535594 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:25.535527 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66db3efe-80c5-48fe-88ef-48536557da73-metrics-certs podName:66db3efe-80c5-48fe-88ef-48536557da73 nodeName:}" failed. No retries permitted until 2026-07-23 20:59:27.535511317 +0000 UTC m=+5.097945286 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66db3efe-80c5-48fe-88ef-48536557da73-metrics-certs") pod "network-metrics-daemon-rbjvm" (UID: "66db3efe-80c5-48fe-88ef-48536557da73") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 20:59:25.636323 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:25.636278 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dggz2\" (UniqueName: \"kubernetes.io/projected/01b37872-acdc-426d-9aef-d964ac7a91b4-kube-api-access-dggz2\") pod \"network-check-target-v2gxq\" (UID: \"01b37872-acdc-426d-9aef-d964ac7a91b4\") " pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 20:59:25.636517 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:25.636500 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 20:59:25.636601 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:25.636525 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 20:59:25.636601 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:25.636545 2575 projected.go:196] Error preparing data for projected volume kube-api-access-dggz2 for pod openshift-network-diagnostics/network-check-target-v2gxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 20:59:25.636708 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:25.636603 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01b37872-acdc-426d-9aef-d964ac7a91b4-kube-api-access-dggz2 podName:01b37872-acdc-426d-9aef-d964ac7a91b4 nodeName:}" failed. No retries permitted until 2026-07-23 20:59:27.636583754 +0000 UTC m=+5.199017735 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dggz2" (UniqueName: "kubernetes.io/projected/01b37872-acdc-426d-9aef-d964ac7a91b4-kube-api-access-dggz2") pod "network-check-target-v2gxq" (UID: "01b37872-acdc-426d-9aef-d964ac7a91b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 20:59:25.864802 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:25.864683 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 20:54:24 +0000 UTC" deadline="2028-03-06 00:30:02.591976802 +0000 UTC" Jul 23 20:59:25.864802 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:25.864720 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14187h30m36.727261664s" Jul 23 20:59:25.958280 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:25.958229 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 20:59:25.958468 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:25.958391 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v2gxq" podUID="01b37872-acdc-426d-9aef-d964ac7a91b4" Jul 23 20:59:25.958863 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:25.958842 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:25.959036 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:25.958982 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbjvm" podUID="66db3efe-80c5-48fe-88ef-48536557da73" Jul 23 20:59:25.959158 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:25.959142 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:25.959692 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:25.959645 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqmks" podUID="1bc0eede-3f89-44b8-9acc-244ddd68e26b" Jul 23 20:59:26.824426 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:26.824211 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 20:59:27.553851 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:27.553731 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66db3efe-80c5-48fe-88ef-48536557da73-metrics-certs\") pod \"network-metrics-daemon-rbjvm\" (UID: \"66db3efe-80c5-48fe-88ef-48536557da73\") " pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:27.554353 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:27.553913 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bc0eede-3f89-44b8-9acc-244ddd68e26b-original-pull-secret\") pod \"global-pull-secret-syncer-wqmks\" (UID: \"1bc0eede-3f89-44b8-9acc-244ddd68e26b\") " pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:27.554353 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:27.554075 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 20:59:27.554353 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:27.554147 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bc0eede-3f89-44b8-9acc-244ddd68e26b-original-pull-secret podName:1bc0eede-3f89-44b8-9acc-244ddd68e26b nodeName:}" failed. No retries permitted until 2026-07-23 20:59:31.554126602 +0000 UTC m=+9.116560572 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1bc0eede-3f89-44b8-9acc-244ddd68e26b-original-pull-secret") pod "global-pull-secret-syncer-wqmks" (UID: "1bc0eede-3f89-44b8-9acc-244ddd68e26b") : object "kube-system"/"original-pull-secret" not registered Jul 23 20:59:27.554643 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:27.554621 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 20:59:27.554708 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:27.554679 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66db3efe-80c5-48fe-88ef-48536557da73-metrics-certs podName:66db3efe-80c5-48fe-88ef-48536557da73 nodeName:}" failed. No retries permitted until 2026-07-23 20:59:31.554663537 +0000 UTC m=+9.117097508 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66db3efe-80c5-48fe-88ef-48536557da73-metrics-certs") pod "network-metrics-daemon-rbjvm" (UID: "66db3efe-80c5-48fe-88ef-48536557da73") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 20:59:27.655032 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:27.654978 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dggz2\" (UniqueName: \"kubernetes.io/projected/01b37872-acdc-426d-9aef-d964ac7a91b4-kube-api-access-dggz2\") pod \"network-check-target-v2gxq\" (UID: \"01b37872-acdc-426d-9aef-d964ac7a91b4\") " pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 20:59:27.655231 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:27.655163 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 20:59:27.655231 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:27.655184 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 20:59:27.655231 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:27.655197 2575 projected.go:196] Error preparing data for projected volume kube-api-access-dggz2 for pod openshift-network-diagnostics/network-check-target-v2gxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 20:59:27.655408 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:27.655256 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01b37872-acdc-426d-9aef-d964ac7a91b4-kube-api-access-dggz2 podName:01b37872-acdc-426d-9aef-d964ac7a91b4 nodeName:}" failed. No retries permitted until 2026-07-23 20:59:31.655235942 +0000 UTC m=+9.217669907 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dggz2" (UniqueName: "kubernetes.io/projected/01b37872-acdc-426d-9aef-d964ac7a91b4-kube-api-access-dggz2") pod "network-check-target-v2gxq" (UID: "01b37872-acdc-426d-9aef-d964ac7a91b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 20:59:27.957591 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:27.957447 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:27.957591 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:27.957447 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:27.957830 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:27.957614 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbjvm" podUID="66db3efe-80c5-48fe-88ef-48536557da73" Jul 23 20:59:27.957830 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:27.957700 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqmks" podUID="1bc0eede-3f89-44b8-9acc-244ddd68e26b" Jul 23 20:59:27.957830 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:27.957447 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 20:59:27.957830 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:27.957803 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v2gxq" podUID="01b37872-acdc-426d-9aef-d964ac7a91b4" Jul 23 20:59:29.957667 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:29.957593 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 20:59:29.957667 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:29.957623 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:29.957667 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:29.957631 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:29.958298 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:29.957735 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v2gxq" podUID="01b37872-acdc-426d-9aef-d964ac7a91b4" Jul 23 20:59:29.958298 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:29.957833 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbjvm" podUID="66db3efe-80c5-48fe-88ef-48536557da73" Jul 23 20:59:29.958298 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:29.957959 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqmks" podUID="1bc0eede-3f89-44b8-9acc-244ddd68e26b" Jul 23 20:59:31.591505 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:31.591457 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bc0eede-3f89-44b8-9acc-244ddd68e26b-original-pull-secret\") pod \"global-pull-secret-syncer-wqmks\" (UID: \"1bc0eede-3f89-44b8-9acc-244ddd68e26b\") " pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:31.591922 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:31.591555 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66db3efe-80c5-48fe-88ef-48536557da73-metrics-certs\") pod \"network-metrics-daemon-rbjvm\" (UID: \"66db3efe-80c5-48fe-88ef-48536557da73\") " pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:31.591922 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:31.591657 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 20:59:31.591922 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:31.591728 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bc0eede-3f89-44b8-9acc-244ddd68e26b-original-pull-secret podName:1bc0eede-3f89-44b8-9acc-244ddd68e26b nodeName:}" failed. No retries permitted until 2026-07-23 20:59:39.591707173 +0000 UTC m=+17.154141154 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1bc0eede-3f89-44b8-9acc-244ddd68e26b-original-pull-secret") pod "global-pull-secret-syncer-wqmks" (UID: "1bc0eede-3f89-44b8-9acc-244ddd68e26b") : object "kube-system"/"original-pull-secret" not registered Jul 23 20:59:31.591922 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:31.591657 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 20:59:31.591922 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:31.591787 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66db3efe-80c5-48fe-88ef-48536557da73-metrics-certs podName:66db3efe-80c5-48fe-88ef-48536557da73 nodeName:}" failed. No retries permitted until 2026-07-23 20:59:39.59177234 +0000 UTC m=+17.154206309 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66db3efe-80c5-48fe-88ef-48536557da73-metrics-certs") pod "network-metrics-daemon-rbjvm" (UID: "66db3efe-80c5-48fe-88ef-48536557da73") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 20:59:31.692649 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:31.692606 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dggz2\" (UniqueName: \"kubernetes.io/projected/01b37872-acdc-426d-9aef-d964ac7a91b4-kube-api-access-dggz2\") pod \"network-check-target-v2gxq\" (UID: \"01b37872-acdc-426d-9aef-d964ac7a91b4\") " pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 20:59:31.692851 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:31.692826 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 20:59:31.692968 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:31.692873 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 20:59:31.692968 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:31.692889 2575 projected.go:196] Error preparing data for projected volume kube-api-access-dggz2 for pod openshift-network-diagnostics/network-check-target-v2gxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 20:59:31.692968 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:31.692954 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01b37872-acdc-426d-9aef-d964ac7a91b4-kube-api-access-dggz2 podName:01b37872-acdc-426d-9aef-d964ac7a91b4 nodeName:}" failed. No retries permitted until 2026-07-23 20:59:39.692935012 +0000 UTC m=+17.255368978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dggz2" (UniqueName: "kubernetes.io/projected/01b37872-acdc-426d-9aef-d964ac7a91b4-kube-api-access-dggz2") pod "network-check-target-v2gxq" (UID: "01b37872-acdc-426d-9aef-d964ac7a91b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 20:59:31.958021 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:31.957206 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:31.958021 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:31.957340 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbjvm" podUID="66db3efe-80c5-48fe-88ef-48536557da73" Jul 23 20:59:31.958021 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:31.957703 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:31.958021 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:31.957791 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqmks" podUID="1bc0eede-3f89-44b8-9acc-244ddd68e26b" Jul 23 20:59:31.958021 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:31.957846 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 20:59:31.958021 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:31.957929 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v2gxq" podUID="01b37872-acdc-426d-9aef-d964ac7a91b4" Jul 23 20:59:33.957690 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:33.957608 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 20:59:33.958240 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:33.957621 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:33.958240 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:33.957730 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v2gxq" podUID="01b37872-acdc-426d-9aef-d964ac7a91b4" Jul 23 20:59:33.958240 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:33.957749 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:33.958240 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:33.957856 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbjvm" podUID="66db3efe-80c5-48fe-88ef-48536557da73" Jul 23 20:59:33.958240 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:33.957953 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqmks" podUID="1bc0eede-3f89-44b8-9acc-244ddd68e26b" Jul 23 20:59:35.958186 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:35.958011 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:35.958539 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:35.958041 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 20:59:35.958539 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:35.958262 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbjvm" podUID="66db3efe-80c5-48fe-88ef-48536557da73" Jul 23 20:59:35.958539 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:35.958066 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:35.958539 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:35.958323 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v2gxq" podUID="01b37872-acdc-426d-9aef-d964ac7a91b4" Jul 23 20:59:35.958539 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:35.958407 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqmks" podUID="1bc0eede-3f89-44b8-9acc-244ddd68e26b" Jul 23 20:59:37.957229 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:37.957196 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:37.957674 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:37.957303 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 20:59:37.957674 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:37.957327 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:37.957674 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:37.957316 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqmks" podUID="1bc0eede-3f89-44b8-9acc-244ddd68e26b" Jul 23 20:59:37.957674 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:37.957415 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v2gxq" podUID="01b37872-acdc-426d-9aef-d964ac7a91b4" Jul 23 20:59:37.957674 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:37.957515 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbjvm" podUID="66db3efe-80c5-48fe-88ef-48536557da73" Jul 23 20:59:39.648100 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:39.648064 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66db3efe-80c5-48fe-88ef-48536557da73-metrics-certs\") pod \"network-metrics-daemon-rbjvm\" (UID: \"66db3efe-80c5-48fe-88ef-48536557da73\") " pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:39.648609 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:39.648123 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bc0eede-3f89-44b8-9acc-244ddd68e26b-original-pull-secret\") pod \"global-pull-secret-syncer-wqmks\" (UID: \"1bc0eede-3f89-44b8-9acc-244ddd68e26b\") " pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:39.648609 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:39.648234 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 20:59:39.648609 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:39.648241 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 20:59:39.648609 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:39.648304 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66db3efe-80c5-48fe-88ef-48536557da73-metrics-certs podName:66db3efe-80c5-48fe-88ef-48536557da73 nodeName:}" failed. No retries permitted until 2026-07-23 20:59:55.648286087 +0000 UTC m=+33.210720050 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66db3efe-80c5-48fe-88ef-48536557da73-metrics-certs") pod "network-metrics-daemon-rbjvm" (UID: "66db3efe-80c5-48fe-88ef-48536557da73") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 20:59:39.648609 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:39.648353 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bc0eede-3f89-44b8-9acc-244ddd68e26b-original-pull-secret podName:1bc0eede-3f89-44b8-9acc-244ddd68e26b nodeName:}" failed. No retries permitted until 2026-07-23 20:59:55.648337134 +0000 UTC m=+33.210771111 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1bc0eede-3f89-44b8-9acc-244ddd68e26b-original-pull-secret") pod "global-pull-secret-syncer-wqmks" (UID: "1bc0eede-3f89-44b8-9acc-244ddd68e26b") : object "kube-system"/"original-pull-secret" not registered Jul 23 20:59:39.749450 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:39.749408 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dggz2\" (UniqueName: \"kubernetes.io/projected/01b37872-acdc-426d-9aef-d964ac7a91b4-kube-api-access-dggz2\") pod \"network-check-target-v2gxq\" (UID: \"01b37872-acdc-426d-9aef-d964ac7a91b4\") " pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 20:59:39.749617 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:39.749591 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 20:59:39.749662 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:39.749622 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 20:59:39.749662 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:39.749636 2575 projected.go:196] Error preparing data for projected volume kube-api-access-dggz2 for pod openshift-network-diagnostics/network-check-target-v2gxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 20:59:39.749729 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:39.749703 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01b37872-acdc-426d-9aef-d964ac7a91b4-kube-api-access-dggz2 podName:01b37872-acdc-426d-9aef-d964ac7a91b4 nodeName:}" failed. No retries permitted until 2026-07-23 20:59:55.749683212 +0000 UTC m=+33.312117190 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dggz2" (UniqueName: "kubernetes.io/projected/01b37872-acdc-426d-9aef-d964ac7a91b4-kube-api-access-dggz2") pod "network-check-target-v2gxq" (UID: "01b37872-acdc-426d-9aef-d964ac7a91b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 20:59:39.957790 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:39.957701 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 20:59:39.957790 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:39.957752 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:39.958015 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:39.957809 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:39.958015 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:39.957820 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v2gxq" podUID="01b37872-acdc-426d-9aef-d964ac7a91b4" Jul 23 20:59:39.958015 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:39.957920 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqmks" podUID="1bc0eede-3f89-44b8-9acc-244ddd68e26b" Jul 23 20:59:39.958015 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:39.958008 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbjvm" podUID="66db3efe-80c5-48fe-88ef-48536557da73" Jul 23 20:59:41.958125 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:41.958090 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:41.958662 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:41.958090 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 20:59:41.958662 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:41.958213 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqmks" podUID="1bc0eede-3f89-44b8-9acc-244ddd68e26b" Jul 23 20:59:41.958662 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:41.958298 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v2gxq" podUID="01b37872-acdc-426d-9aef-d964ac7a91b4" Jul 23 20:59:41.958662 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:41.958090 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:41.958662 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:41.958408 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbjvm" podUID="66db3efe-80c5-48fe-88ef-48536557da73" Jul 23 20:59:43.957484 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:43.957441 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:43.957952 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:43.957441 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 20:59:43.957952 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:43.957590 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqmks" podUID="1bc0eede-3f89-44b8-9acc-244ddd68e26b" Jul 23 20:59:43.957952 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:43.957442 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:43.957952 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:43.957681 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v2gxq" podUID="01b37872-acdc-426d-9aef-d964ac7a91b4" Jul 23 20:59:43.957952 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:43.957763 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbjvm" podUID="66db3efe-80c5-48fe-88ef-48536557da73" Jul 23 20:59:45.225919 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:45.225883 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xk77s" event={"ID":"a18eb347-e5e5-43ba-b5fa-f73884596341","Type":"ContainerStarted","Data":"4d4f91042ee5cd78667cd61f12084a02e2b6baa224f1d499c3173fcec44de608"} Jul 23 20:59:45.227445 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:45.227417 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" event={"ID":"5e727997-ea44-49f3-a78a-2e639ce8f1a7","Type":"ContainerStarted","Data":"a1f9691562d62cd0fa529e202e67d2829c492a6ada299c6ae5157c680923f315"} Jul 23 20:59:45.228881 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:45.228836 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lf85l" event={"ID":"132210c5-b5be-499e-98c1-113a40450446","Type":"ContainerStarted","Data":"731ff518d4930f9294c97e0250c728563e3f87012d82f9a02d90babc88ea3d27"} Jul 23 20:59:45.230394 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:45.230374 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-105.ec2.internal" event={"ID":"a88942796a5b6b2c5f36a7e709e10120","Type":"ContainerStarted","Data":"da083e98f11dcc367cd87f1d505733dad49a06f496e39f37f6eb1279d5450fba"} Jul 23 20:59:45.241823 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:45.241773 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xk77s" podStartSLOduration=1.81645126 podStartE2EDuration="22.241761458s" totalImagesPullingTime="20.425310198s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 20:59:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 20:59:45.241426108 +0000 UTC m=+22.803860094" watchObservedRunningTime="2026-07-23 20:59:45.241761458 +0000 UTC m=+22.804195443" Jul 23 20:59:45.254286 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:45.254233 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-105.ec2.internal" podStartSLOduration=21.254213167 podStartE2EDuration="21.254213167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 20:59:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 20:59:45.253457258 +0000 UTC m=+22.815891242" watchObservedRunningTime="2026-07-23 20:59:45.254213167 +0000 UTC m=+22.816647152" Jul 23 20:59:45.269515 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:45.269459 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lf85l" podStartSLOduration=1.758742188 podStartE2EDuration="22.269414678s" totalImagesPullingTime="20.51067249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 20:59:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 20:59:45.26932157 +0000 UTC m=+22.831755556" watchObservedRunningTime="2026-07-23 20:59:45.269414678 +0000 UTC m=+22.831848668" Jul 23 20:59:45.957777 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:45.957591 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:45.957993 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:45.957622 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 20:59:45.957993 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:45.957620 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:45.957993 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:45.957880 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbjvm" podUID="66db3efe-80c5-48fe-88ef-48536557da73" Jul 23 20:59:45.957993 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:45.957940 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v2gxq" podUID="01b37872-acdc-426d-9aef-d964ac7a91b4" Jul 23 20:59:45.958158 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:45.958028 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqmks" podUID="1bc0eede-3f89-44b8-9acc-244ddd68e26b" Jul 23 20:59:46.237153 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:46.235451 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dqgm_5e727997-ea44-49f3-a78a-2e639ce8f1a7/ovn-acl-logging/0.log" Jul 23 20:59:46.238230 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:46.238205 2575 generic.go:356] "Generic (PLEG): container finished" podID="5e727997-ea44-49f3-a78a-2e639ce8f1a7" containerID="5bd630ac11945d879c2ac7cc3e370f6ea630076959f4b92998a3c2c8ff295d71" exitCode=1 Jul 23 20:59:46.238310 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:46.238283 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" event={"ID":"5e727997-ea44-49f3-a78a-2e639ce8f1a7","Type":"ContainerStarted","Data":"5887c84a278a489065dc11a98f2a2d61ee068bc7b8720975e12e68ec1131e13b"} Jul 23 20:59:46.238416 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:46.238400 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" event={"ID":"5e727997-ea44-49f3-a78a-2e639ce8f1a7","Type":"ContainerStarted","Data":"cac01a1fef7adb4e4c70fd7268f33f65b88c92407af2deccd2c4704880b5d978"} Jul 23 20:59:46.238475 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:46.238456 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" event={"ID":"5e727997-ea44-49f3-a78a-2e639ce8f1a7","Type":"ContainerStarted","Data":"4023bd26e87b6165305470070c549de275d5bba47be31dcd252b5cd57b5055c5"} Jul 23 20:59:46.238529 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:46.238507 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" event={"ID":"5e727997-ea44-49f3-a78a-2e639ce8f1a7","Type":"ContainerStarted","Data":"0cd3d6f16743a831e88b6d6f27843e24df9d3e1103a17c5c5abb91acfedf1733"} Jul 23 20:59:46.238578 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:46.238555 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" event={"ID":"5e727997-ea44-49f3-a78a-2e639ce8f1a7","Type":"ContainerDied","Data":"5bd630ac11945d879c2ac7cc3e370f6ea630076959f4b92998a3c2c8ff295d71"} Jul 23 20:59:46.239711 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:46.239685 2575 generic.go:356] "Generic (PLEG): container finished" podID="db899d82-4b93-4bc9-9c96-7eff79204586" containerID="f60041b4b2296cc4058fb8ce8bba70dc5a600558dba92f9b3df0eef3913f2f6b" exitCode=0 Jul 23 20:59:46.239815 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:46.239764 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7lf94" event={"ID":"db899d82-4b93-4bc9-9c96-7eff79204586","Type":"ContainerDied","Data":"f60041b4b2296cc4058fb8ce8bba70dc5a600558dba92f9b3df0eef3913f2f6b"} Jul 23 20:59:46.241165 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:46.241141 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4" event={"ID":"c6d723d3-d280-4491-b3a4-7734f233fab1","Type":"ContainerStarted","Data":"688ecfc189bd2f97a0d0751c2585d8df44f58910ec65c17efc5a57b2ee19eac2"} Jul 23 20:59:46.242362 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:46.242343 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5t58l" event={"ID":"f66dc9f4-cf62-41d2-a924-3c99f035c6fa","Type":"ContainerStarted","Data":"efc9c313d2f4302488c21397920c228981ea316016b5cd557d0cc2451a76ed91"} Jul 23 20:59:46.243816 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:46.243790 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xrgfx" event={"ID":"9a5c7d21-3bf5-443a-bae4-31aef0469bdd","Type":"ContainerStarted","Data":"f07b8d222e1938310a892f5d6d62f47696ff719965dfbddf3dce1f1005133dfd"} Jul 23 20:59:46.245052 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:46.245031 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ndd69" event={"ID":"d6c822b6-da7a-488f-9c36-cfb188240ae4","Type":"ContainerStarted","Data":"3e534728e73bf6d8d8c760fd63052a9594a35b1f3c51e0d015337af9fcf76427"} Jul 23 20:59:46.246468 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:46.246446 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k4mpd" event={"ID":"c360a063-018a-4e22-978b-69dc9b659c9b","Type":"ContainerStarted","Data":"822b04b12b32799f32dfe0b5ce7012bcdc6b93010d7db6987c9371fb827afea7"} Jul 23 20:59:46.247919 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:46.247902 2575 generic.go:356] "Generic (PLEG): container finished" podID="6a91334f2b2daa9817292f0040684ba7" containerID="2d0bc1bca99def4e719c2546c562d6fe9b85d97993fddc7cf07fd15c1fcc254f" exitCode=0 Jul 23 20:59:46.247995 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:46.247976 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-105.ec2.internal" event={"ID":"6a91334f2b2daa9817292f0040684ba7","Type":"ContainerDied","Data":"2d0bc1bca99def4e719c2546c562d6fe9b85d97993fddc7cf07fd15c1fcc254f"} Jul 23 20:59:46.288009 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:46.287937 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xrgfx" podStartSLOduration=2.824474731 podStartE2EDuration="23.287919569s" totalImagesPullingTime="20.463444838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 20:59:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 20:59:46.287842197 +0000 UTC m=+23.850276182" watchObservedRunningTime="2026-07-23 20:59:46.287919569 +0000 UTC m=+23.850353580" Jul 23 20:59:46.324344 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:46.324297 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-k4mpd" podStartSLOduration=7.171315657 podStartE2EDuration="23.324278891s" totalImagesPullingTime="16.152963234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 20:59:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 20:59:46.324189901 +0000 UTC m=+23.886623887" watchObservedRunningTime="2026-07-23 20:59:46.324278891 +0000 UTC m=+23.886712879" Jul 23 20:59:46.342599 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:46.342561 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ndd69" podStartSLOduration=10.890037101 podStartE2EDuration="23.342542677s" totalImagesPullingTime="12.452505576s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 20:59:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 20:59:46.342463714 +0000 UTC m=+23.904897699" watchObservedRunningTime="2026-07-23 20:59:46.342542677 +0000 UTC m=+23.904976661" Jul 23 20:59:46.434835 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:46.434809 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 20:59:46.518659 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:46.518631 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 20:59:46.556940 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:46.556911 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 23 20:59:46.902123 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:46.902024 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T20:59:46.556933074Z","UUID":"21786bed-149f-4d87-895e-6e4a04962c56","Handler":null,"Name":"","Endpoint":""} Jul 23 20:59:46.903829 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:46.903801 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 23 20:59:46.903981 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:46.903845 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 23 20:59:46.927911 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:46.927882 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-k4mpd" Jul 23 20:59:46.928419 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:46.928395 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-k4mpd" Jul 23 20:59:46.941890 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:46.941820 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5t58l" podStartSLOduration=7.88561304 podStartE2EDuration="23.941801391s" totalImagesPullingTime="16.056188351s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 20:59:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 20:59:46.360538951 +0000 UTC m=+23.922972936" watchObservedRunningTime="2026-07-23 20:59:46.941801391 +0000 UTC m=+24.504235379" Jul 23 20:59:47.258397 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:47.258300 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-105.ec2.internal" event={"ID":"6a91334f2b2daa9817292f0040684ba7","Type":"ContainerStarted","Data":"1927cf9c42178e08f8d7bf5b2947a3ca1efe34a98ed883975155e73a764678d2"} Jul 23 20:59:47.260379 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:47.260352 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4" event={"ID":"c6d723d3-d280-4491-b3a4-7734f233fab1","Type":"ContainerStarted","Data":"f6008c088f94ac55ef5fb9897fd31897407c0fb4523b5209fd35fdba40f8bbbe"} Jul 23 20:59:47.260901 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:47.260875 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-k4mpd" Jul 23 20:59:47.261347 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:47.261315 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-k4mpd" Jul 23 20:59:47.273026 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:47.272977 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-105.ec2.internal" podStartSLOduration=23.272959197 podStartE2EDuration="23.272959197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 20:59:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 20:59:47.272683193 +0000 UTC m=+24.835117179" watchObservedRunningTime="2026-07-23 20:59:47.272959197 +0000 UTC m=+24.835393185" Jul 23 20:59:47.327784 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:47.327739 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 20:59:47.958062 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:47.958041 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 20:59:47.958288 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:47.958048 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:47.958288 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:47.958160 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v2gxq" podUID="01b37872-acdc-426d-9aef-d964ac7a91b4" Jul 23 20:59:47.958288 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:47.958048 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:47.958288 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:47.958250 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbjvm" podUID="66db3efe-80c5-48fe-88ef-48536557da73" Jul 23 20:59:47.958514 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:47.958291 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqmks" podUID="1bc0eede-3f89-44b8-9acc-244ddd68e26b" Jul 23 20:59:48.265995 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:48.265920 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dqgm_5e727997-ea44-49f3-a78a-2e639ce8f1a7/ovn-acl-logging/0.log" Jul 23 20:59:48.266528 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:48.266447 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" event={"ID":"5e727997-ea44-49f3-a78a-2e639ce8f1a7","Type":"ContainerStarted","Data":"1a2a2e3dd45f68d7db1f86663e70e8ec00f09d73e667a6a2a9fc8305e6eb3221"} Jul 23 20:59:48.268730 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:48.268701 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4" event={"ID":"c6d723d3-d280-4491-b3a4-7734f233fab1","Type":"ContainerStarted","Data":"1151ceee78b9f511d9ff1c790e240446357043e2b5c258f6abc66d04af3d4cdf"} Jul 23 20:59:48.291265 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:48.291220 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2vk4" podStartSLOduration=2.563443786 podStartE2EDuration="25.291204926s" totalImagesPullingTime="22.72776114s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 20:59:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 20:59:48.291040273 +0000 UTC m=+25.853474269" watchObservedRunningTime="2026-07-23 20:59:48.291204926 +0000 UTC m=+25.853638910" Jul 23 20:59:48.377272 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:48.377217 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 20:59:48.438043 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:48.438014 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 20:59:48.525303 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:48.525270 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 20:59:48.626941 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:48.626912 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 20:59:49.171649 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:49.171451 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 20:59:49.272573 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:49.272536 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 20:59:49.957411 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:49.957375 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:49.957411 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:49.957401 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 20:59:49.957622 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:49.957486 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:49.957622 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:49.957498 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqmks" podUID="1bc0eede-3f89-44b8-9acc-244ddd68e26b" Jul 23 20:59:49.957622 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:49.957579 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbjvm" podUID="66db3efe-80c5-48fe-88ef-48536557da73" Jul 23 20:59:49.957756 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:49.957617 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v2gxq" podUID="01b37872-acdc-426d-9aef-d964ac7a91b4" Jul 23 20:59:51.137741 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:51.137565 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 20:59:51.190689 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:51.190653 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 20:59:51.279393 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:51.279367 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dqgm_5e727997-ea44-49f3-a78a-2e639ce8f1a7/ovn-acl-logging/0.log" Jul 23 20:59:51.279806 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:51.279778 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" event={"ID":"5e727997-ea44-49f3-a78a-2e639ce8f1a7","Type":"ContainerStarted","Data":"554f7a38a3a48b66bbb4efc2bbc144b25b2cd151e6d8b539b492a8c3e9b466db"} Jul 23 20:59:51.280088 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:51.280060 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:51.280327 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:51.280308 2575 scope.go:117] "RemoveContainer" containerID="5bd630ac11945d879c2ac7cc3e370f6ea630076959f4b92998a3c2c8ff295d71" Jul 23 20:59:51.281595 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:51.281575 2575 generic.go:356] "Generic (PLEG): container finished" podID="db899d82-4b93-4bc9-9c96-7eff79204586" containerID="0681b60ac3f1e910c9c9707fad232828cbd405cf0fe559a85a75319f420e7e85" exitCode=0 Jul 23 20:59:51.281672 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:51.281628 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7lf94" event={"ID":"db899d82-4b93-4bc9-9c96-7eff79204586","Type":"ContainerDied","Data":"0681b60ac3f1e910c9c9707fad232828cbd405cf0fe559a85a75319f420e7e85"} Jul 23 20:59:51.296356 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:51.296336 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:51.958216 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:51.958189 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:51.958447 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:51.958227 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 20:59:51.958447 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:51.958298 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:51.958447 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:51.958315 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqmks" podUID="1bc0eede-3f89-44b8-9acc-244ddd68e26b" Jul 23 20:59:51.958447 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:51.958428 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbjvm" podUID="66db3efe-80c5-48fe-88ef-48536557da73" Jul 23 20:59:51.958630 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:51.958511 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v2gxq" podUID="01b37872-acdc-426d-9aef-d964ac7a91b4" Jul 23 20:59:52.287717 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:52.287691 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dqgm_5e727997-ea44-49f3-a78a-2e639ce8f1a7/ovn-acl-logging/0.log" Jul 23 20:59:52.288124 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:52.288102 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" event={"ID":"5e727997-ea44-49f3-a78a-2e639ce8f1a7","Type":"ContainerStarted","Data":"50e659e5ae300122ad74d5e84d6c0ba83e455235d5f3983b20c1e07fe03f5d5e"} Jul 23 20:59:52.288445 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:52.288396 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:52.288537 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:52.288484 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:52.290948 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:52.290824 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7lf94" event={"ID":"db899d82-4b93-4bc9-9c96-7eff79204586","Type":"ContainerStarted","Data":"bac2616b33d566d07b69f712523f160ab3f26b896c92663246993450ef8d501f"} Jul 23 20:59:52.304612 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:52.304590 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 20:59:52.313277 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:52.313203 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" podStartSLOduration=8.51309941 podStartE2EDuration="29.313188588s" totalImagesPullingTime="20.800089178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 20:59:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 20:59:52.312641024 +0000 UTC m=+29.875075022" watchObservedRunningTime="2026-07-23 20:59:52.313188588 +0000 UTC m=+29.875622572" Jul 23 20:59:52.483779 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:52.483697 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wqmks"] Jul 23 20:59:52.483925 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:52.483796 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:52.483925 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:52.483892 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqmks" podUID="1bc0eede-3f89-44b8-9acc-244ddd68e26b" Jul 23 20:59:52.487057 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:52.487032 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v2gxq"] Jul 23 20:59:52.487170 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:52.487135 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 20:59:52.487236 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:52.487215 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v2gxq" podUID="01b37872-acdc-426d-9aef-d964ac7a91b4" Jul 23 20:59:52.487744 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:52.487716 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rbjvm"] Jul 23 20:59:52.487846 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:52.487826 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:52.487956 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:52.487932 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbjvm" podUID="66db3efe-80c5-48fe-88ef-48536557da73" Jul 23 20:59:53.297999 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:53.297968 2575 generic.go:356] "Generic (PLEG): container finished" podID="db899d82-4b93-4bc9-9c96-7eff79204586" containerID="bac2616b33d566d07b69f712523f160ab3f26b896c92663246993450ef8d501f" exitCode=0 Jul 23 20:59:53.298461 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:53.298062 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7lf94" event={"ID":"db899d82-4b93-4bc9-9c96-7eff79204586","Type":"ContainerDied","Data":"bac2616b33d566d07b69f712523f160ab3f26b896c92663246993450ef8d501f"} Jul 23 20:59:53.957502 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:53.957469 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 20:59:53.957700 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:53.957582 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:53.957700 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:53.957588 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v2gxq" podUID="01b37872-acdc-426d-9aef-d964ac7a91b4" Jul 23 20:59:53.957700 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:53.957617 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:53.957887 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:53.957704 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqmks" podUID="1bc0eede-3f89-44b8-9acc-244ddd68e26b" Jul 23 20:59:53.957887 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:53.957843 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbjvm" podUID="66db3efe-80c5-48fe-88ef-48536557da73" Jul 23 20:59:54.611351 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:54.611177 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 20:59:54.679761 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:54.679728 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 20:59:54.860805 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:54.860773 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 20:59:54.927282 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:54.927253 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 20:59:54.988990 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:54.988958 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 20:59:55.169899 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:55.169788 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 20:59:55.271294 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:55.271259 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 20:59:55.304850 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:55.304821 2575 generic.go:356] "Generic (PLEG): container finished" podID="db899d82-4b93-4bc9-9c96-7eff79204586" containerID="55673d84736e5e69324645627cdf7b4810b68a0feac5d82eecba53a11cf08b0d" exitCode=0 Jul 23 20:59:55.305025 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:55.304891 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7lf94" event={"ID":"db899d82-4b93-4bc9-9c96-7eff79204586","Type":"ContainerDied","Data":"55673d84736e5e69324645627cdf7b4810b68a0feac5d82eecba53a11cf08b0d"} Jul 23 20:59:55.332643 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:55.332616 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 20:59:55.522780 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:55.522754 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 20:59:55.622900 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:55.622848 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 20:59:55.674726 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:55.674683 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bc0eede-3f89-44b8-9acc-244ddd68e26b-original-pull-secret\") pod \"global-pull-secret-syncer-wqmks\" (UID: \"1bc0eede-3f89-44b8-9acc-244ddd68e26b\") " pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:55.674921 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:55.674750 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66db3efe-80c5-48fe-88ef-48536557da73-metrics-certs\") pod \"network-metrics-daemon-rbjvm\" (UID: \"66db3efe-80c5-48fe-88ef-48536557da73\") " pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:55.674921 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:55.674844 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 20:59:55.674921 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:55.674857 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 20:59:55.674921 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:55.674914 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66db3efe-80c5-48fe-88ef-48536557da73-metrics-certs podName:66db3efe-80c5-48fe-88ef-48536557da73 nodeName:}" failed. No retries permitted until 2026-07-23 21:00:27.674900676 +0000 UTC m=+65.237334638 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66db3efe-80c5-48fe-88ef-48536557da73-metrics-certs") pod "network-metrics-daemon-rbjvm" (UID: "66db3efe-80c5-48fe-88ef-48536557da73") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 20:59:55.675087 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:55.674940 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bc0eede-3f89-44b8-9acc-244ddd68e26b-original-pull-secret podName:1bc0eede-3f89-44b8-9acc-244ddd68e26b nodeName:}" failed. No retries permitted until 2026-07-23 21:00:27.674922132 +0000 UTC m=+65.237356095 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1bc0eede-3f89-44b8-9acc-244ddd68e26b-original-pull-secret") pod "global-pull-secret-syncer-wqmks" (UID: "1bc0eede-3f89-44b8-9acc-244ddd68e26b") : object "kube-system"/"original-pull-secret" not registered Jul 23 20:59:55.775724 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:55.775633 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dggz2\" (UniqueName: \"kubernetes.io/projected/01b37872-acdc-426d-9aef-d964ac7a91b4-kube-api-access-dggz2\") pod \"network-check-target-v2gxq\" (UID: \"01b37872-acdc-426d-9aef-d964ac7a91b4\") " pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 20:59:55.775890 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:55.775808 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 20:59:55.775890 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:55.775837 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 20:59:55.775890 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:55.775850 2575 projected.go:196] Error preparing data for projected volume kube-api-access-dggz2 for pod openshift-network-diagnostics/network-check-target-v2gxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 20:59:55.775995 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:55.775923 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01b37872-acdc-426d-9aef-d964ac7a91b4-kube-api-access-dggz2 podName:01b37872-acdc-426d-9aef-d964ac7a91b4 nodeName:}" failed. No retries permitted until 2026-07-23 21:00:27.77590615 +0000 UTC m=+65.338340112 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dggz2" (UniqueName: "kubernetes.io/projected/01b37872-acdc-426d-9aef-d964ac7a91b4-kube-api-access-dggz2") pod "network-check-target-v2gxq" (UID: "01b37872-acdc-426d-9aef-d964ac7a91b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 20:59:55.958013 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:55.957979 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:55.958173 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:55.957979 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:55.958173 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:55.958116 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbjvm" podUID="66db3efe-80c5-48fe-88ef-48536557da73" Jul 23 20:59:55.958288 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:55.957979 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 20:59:55.958288 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:55.958167 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqmks" podUID="1bc0eede-3f89-44b8-9acc-244ddd68e26b" Jul 23 20:59:55.958396 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:55.958278 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v2gxq" podUID="01b37872-acdc-426d-9aef-d964ac7a91b4" Jul 23 20:59:55.973882 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:55.973844 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5t58l_f66dc9f4-cf62-41d2-a924-3c99f035c6fa/dns-node-resolver/0.log" Jul 23 20:59:57.165110 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:57.165029 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 20:59:57.216586 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:57.216556 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 20:59:57.373976 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:57.373933 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ndd69_d6c822b6-da7a-488f-9c36-cfb188240ae4/node-ca/0.log" Jul 23 20:59:57.463110 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:57.463031 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 20:59:57.958068 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:57.958028 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:57.958068 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:57.958054 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 20:59:57.958284 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:57.958164 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:57.958284 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:57.958160 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v2gxq" podUID="01b37872-acdc-426d-9aef-d964ac7a91b4" Jul 23 20:59:57.958284 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:57.958225 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqmks" podUID="1bc0eede-3f89-44b8-9acc-244ddd68e26b" Jul 23 20:59:57.958433 ip-10-0-139-105 kubenswrapper[2575]: E0723 20:59:57.958356 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbjvm" podUID="66db3efe-80c5-48fe-88ef-48536557da73" Jul 23 20:59:57.998118 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:57.998087 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 20:59:58.776166 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:58.776141 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-105.ec2.internal" event="NodeReady" Jul 23 20:59:58.776615 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:58.776287 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 23 20:59:59.317332 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:59.317302 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7lf94" event={"ID":"db899d82-4b93-4bc9-9c96-7eff79204586","Type":"ContainerStarted","Data":"6d4e2f503f213d4d105049ca30ddd3c1359b212afd3aba3a58327df01fb9f618"} Jul 23 20:59:59.957683 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:59.957639 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 20:59:59.958230 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:59.957639 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 20:59:59.958230 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:59.957667 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 20:59:59.961553 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:59.961530 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 20:59:59.962167 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:59.962144 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9qkcv\"" Jul 23 20:59:59.962293 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:59.962203 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 20:59:59.962293 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:59.962214 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 20:59:59.962293 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:59.962206 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-btkpz\"" Jul 23 20:59:59.963011 ip-10-0-139-105 kubenswrapper[2575]: I0723 20:59:59.962996 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 21:00:00.321820 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:00.321784 2575 generic.go:356] "Generic (PLEG): container finished" podID="db899d82-4b93-4bc9-9c96-7eff79204586" containerID="6d4e2f503f213d4d105049ca30ddd3c1359b212afd3aba3a58327df01fb9f618" exitCode=0 Jul 23 21:00:00.322045 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:00.321846 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7lf94" event={"ID":"db899d82-4b93-4bc9-9c96-7eff79204586","Type":"ContainerDied","Data":"6d4e2f503f213d4d105049ca30ddd3c1359b212afd3aba3a58327df01fb9f618"} Jul 23 21:00:01.069681 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:01.069649 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:01.197238 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:01.197209 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:01.295328 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:01.295298 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:01.327060 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:01.326986 2575 generic.go:356] "Generic (PLEG): container finished" podID="db899d82-4b93-4bc9-9c96-7eff79204586" containerID="ccc6d7b6dbbc844ceb8e99969453282de5199f83cd78f69d037f5fab34fa2817" exitCode=0 Jul 23 21:00:01.327060 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:01.327028 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7lf94" event={"ID":"db899d82-4b93-4bc9-9c96-7eff79204586","Type":"ContainerDied","Data":"ccc6d7b6dbbc844ceb8e99969453282de5199f83cd78f69d037f5fab34fa2817"} Jul 23 21:00:01.449740 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:01.449545 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:01.564987 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:01.564954 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:01.702681 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:01.702582 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:01.811597 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:01.811564 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:02.104698 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:02.104667 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:02.333692 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:02.333610 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7lf94" event={"ID":"db899d82-4b93-4bc9-9c96-7eff79204586","Type":"ContainerStarted","Data":"0900df853cfc41aa7d58447dd1697109c4686d3779d30c1b6cc0a292c7b8291a"} Jul 23 21:00:02.357147 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:02.357099 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7lf94" podStartSLOduration=8.605716652 podStartE2EDuration="39.357081855s" totalImagesPullingTime="30.751365203s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 20:59:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:00:02.355835675 +0000 UTC m=+39.918269662" watchObservedRunningTime="2026-07-23 21:00:02.357081855 +0000 UTC m=+39.919515890" Jul 23 21:00:02.361968 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:02.361939 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:02.420889 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:02.420323 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:03.261345 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:03.261312 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:03.439619 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:03.439576 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:03.635757 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:03.635721 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:03.837029 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:03.836998 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:04.037309 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:04.037276 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:05.038036 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:05.038002 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:05.265160 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:05.265123 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:05.420954 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:05.420878 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:05.512121 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:05.512085 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:05.638188 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:05.638161 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:05.690679 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:05.690600 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:05.855642 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:05.855610 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:05.956838 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:05.956774 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:06.056511 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:06.056480 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:06.157040 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:06.157004 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:06.469960 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:06.469929 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:07.043602 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:07.043568 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:07.247451 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:07.247417 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:07.446119 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:07.446044 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:07.547367 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:07.547334 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:07.650314 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:07.650262 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:07.750257 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:07.750169 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:07.863368 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:07.863317 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:08.036653 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:08.036628 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:09.248980 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:09.248929 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:09.470953 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:09.470923 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:09.543274 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:09.543241 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:09.636949 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:09.636919 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:09.844825 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:09.844749 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:10.046978 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:10.046945 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:11.240017 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:11.239985 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:11.439450 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:11.439415 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:11.644536 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:11.644502 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:11.836026 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:11.835994 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:12.043351 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:12.043322 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:12.438324 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:12.438236 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:14.667175 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:14.667143 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:14.716826 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:14.716793 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:16.066945 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:16.066914 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:16.166717 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:16.166686 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:16.886094 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:16.886061 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:16.915556 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:16.915525 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pxc5q"] Jul 23 21:00:16.937077 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:16.937059 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pxc5q" Jul 23 21:00:16.939362 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:16.939338 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 23 21:00:16.939575 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:16.939449 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 23 21:00:16.939667 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:16.939458 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 23 21:00:16.940118 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:16.940099 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fl7rl\"" Jul 23 21:00:16.940415 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:16.940392 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 23 21:00:16.941402 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:16.941385 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pxc5q"] Jul 23 21:00:16.944660 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:16.944640 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zd8fn"] Jul 23 21:00:16.968925 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:16.968905 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zd8fn" Jul 23 21:00:16.971160 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:16.971127 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dj8rg\"" Jul 23 21:00:16.971274 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:16.971199 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 23 21:00:16.971274 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:16.971179 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 23 21:00:16.972189 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:16.972173 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zd8fn"] Jul 23 21:00:16.996768 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:16.996727 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:17.036681 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.036656 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n6m9n"] Jul 23 21:00:17.052799 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.052778 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n6m9n"] Jul 23 21:00:17.052931 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.052895 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n6m9n" Jul 23 21:00:17.055655 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.055635 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k59g8\"" Jul 23 21:00:17.055766 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.055658 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 23 21:00:17.055766 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.055717 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 23 21:00:17.055766 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.055737 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 23 21:00:17.078929 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.078903 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:17.129913 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.129880 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/130c768a-ee37-4d6e-905b-443f99d697fa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pxc5q\" (UID: \"130c768a-ee37-4d6e-905b-443f99d697fa\") " pod="openshift-insights/insights-runtime-extractor-pxc5q" Jul 23 21:00:17.130045 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.129926 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/130c768a-ee37-4d6e-905b-443f99d697fa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pxc5q\" (UID: \"130c768a-ee37-4d6e-905b-443f99d697fa\") " pod="openshift-insights/insights-runtime-extractor-pxc5q" Jul 23 21:00:17.130045 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.129961 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/130c768a-ee37-4d6e-905b-443f99d697fa-data-volume\") pod \"insights-runtime-extractor-pxc5q\" (UID: \"130c768a-ee37-4d6e-905b-443f99d697fa\") " pod="openshift-insights/insights-runtime-extractor-pxc5q" Jul 23 21:00:17.130045 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.129991 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/130c768a-ee37-4d6e-905b-443f99d697fa-crio-socket\") pod \"insights-runtime-extractor-pxc5q\" (UID: \"130c768a-ee37-4d6e-905b-443f99d697fa\") " pod="openshift-insights/insights-runtime-extractor-pxc5q" Jul 23 21:00:17.130045 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.130015 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm78z\" (UniqueName: \"kubernetes.io/projected/8c5a9523-0ee8-46f8-9141-4adcb46752d8-kube-api-access-sm78z\") pod \"dns-default-zd8fn\" (UID: \"8c5a9523-0ee8-46f8-9141-4adcb46752d8\") " pod="openshift-dns/dns-default-zd8fn" Jul 23 21:00:17.130250 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.130080 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqxw6\" (UniqueName: \"kubernetes.io/projected/130c768a-ee37-4d6e-905b-443f99d697fa-kube-api-access-rqxw6\") pod \"insights-runtime-extractor-pxc5q\" (UID: \"130c768a-ee37-4d6e-905b-443f99d697fa\") " pod="openshift-insights/insights-runtime-extractor-pxc5q" Jul 23 21:00:17.130250 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.130107 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8c5a9523-0ee8-46f8-9141-4adcb46752d8-config-volume\") pod \"dns-default-zd8fn\" (UID: \"8c5a9523-0ee8-46f8-9141-4adcb46752d8\") " pod="openshift-dns/dns-default-zd8fn" Jul 23 21:00:17.130250 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.130141 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c5a9523-0ee8-46f8-9141-4adcb46752d8-metrics-tls\") pod \"dns-default-zd8fn\" (UID: \"8c5a9523-0ee8-46f8-9141-4adcb46752d8\") " pod="openshift-dns/dns-default-zd8fn" Jul 23 21:00:17.130250 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.130162 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c5a9523-0ee8-46f8-9141-4adcb46752d8-tmp-dir\") pod \"dns-default-zd8fn\" (UID: \"8c5a9523-0ee8-46f8-9141-4adcb46752d8\") " pod="openshift-dns/dns-default-zd8fn" Jul 23 21:00:17.165407 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.165333 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:17.231239 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.231209 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/130c768a-ee37-4d6e-905b-443f99d697fa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pxc5q\" (UID: \"130c768a-ee37-4d6e-905b-443f99d697fa\") " pod="openshift-insights/insights-runtime-extractor-pxc5q" Jul 23 21:00:17.231239 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.231246 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h47vv\" (UniqueName: \"kubernetes.io/projected/a00a011b-50be-45d9-814c-ac4d821e8038-kube-api-access-h47vv\") pod \"ingress-canary-n6m9n\" (UID: \"a00a011b-50be-45d9-814c-ac4d821e8038\") " pod="openshift-ingress-canary/ingress-canary-n6m9n" Jul 23 21:00:17.231415 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.231292 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/130c768a-ee37-4d6e-905b-443f99d697fa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pxc5q\" (UID: \"130c768a-ee37-4d6e-905b-443f99d697fa\") " pod="openshift-insights/insights-runtime-extractor-pxc5q" Jul 23 21:00:17.231466 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.231448 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/130c768a-ee37-4d6e-905b-443f99d697fa-data-volume\") pod \"insights-runtime-extractor-pxc5q\" (UID: \"130c768a-ee37-4d6e-905b-443f99d697fa\") " pod="openshift-insights/insights-runtime-extractor-pxc5q" Jul 23 21:00:17.231506 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.231485 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/130c768a-ee37-4d6e-905b-443f99d697fa-crio-socket\") pod \"insights-runtime-extractor-pxc5q\" (UID: \"130c768a-ee37-4d6e-905b-443f99d697fa\") " pod="openshift-insights/insights-runtime-extractor-pxc5q" Jul 23 21:00:17.231538 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.231524 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm78z\" (UniqueName: \"kubernetes.io/projected/8c5a9523-0ee8-46f8-9141-4adcb46752d8-kube-api-access-sm78z\") pod \"dns-default-zd8fn\" (UID: \"8c5a9523-0ee8-46f8-9141-4adcb46752d8\") " pod="openshift-dns/dns-default-zd8fn" Jul 23 21:00:17.231580 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.231563 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqxw6\" (UniqueName: \"kubernetes.io/projected/130c768a-ee37-4d6e-905b-443f99d697fa-kube-api-access-rqxw6\") pod \"insights-runtime-extractor-pxc5q\" (UID: \"130c768a-ee37-4d6e-905b-443f99d697fa\") " pod="openshift-insights/insights-runtime-extractor-pxc5q" Jul 23 21:00:17.231629 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.231599 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8c5a9523-0ee8-46f8-9141-4adcb46752d8-config-volume\") pod \"dns-default-zd8fn\" (UID: \"8c5a9523-0ee8-46f8-9141-4adcb46752d8\") " pod="openshift-dns/dns-default-zd8fn" Jul 23 21:00:17.231678 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.231625 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c5a9523-0ee8-46f8-9141-4adcb46752d8-metrics-tls\") pod \"dns-default-zd8fn\" (UID: \"8c5a9523-0ee8-46f8-9141-4adcb46752d8\") " pod="openshift-dns/dns-default-zd8fn" Jul 23 21:00:17.231678 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.231649 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c5a9523-0ee8-46f8-9141-4adcb46752d8-tmp-dir\") pod \"dns-default-zd8fn\" (UID: \"8c5a9523-0ee8-46f8-9141-4adcb46752d8\") " pod="openshift-dns/dns-default-zd8fn" Jul 23 21:00:17.231768 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.231701 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a00a011b-50be-45d9-814c-ac4d821e8038-cert\") pod \"ingress-canary-n6m9n\" (UID: \"a00a011b-50be-45d9-814c-ac4d821e8038\") " pod="openshift-ingress-canary/ingress-canary-n6m9n" Jul 23 21:00:17.231768 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.231739 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/130c768a-ee37-4d6e-905b-443f99d697fa-crio-socket\") pod \"insights-runtime-extractor-pxc5q\" (UID: \"130c768a-ee37-4d6e-905b-443f99d697fa\") " pod="openshift-insights/insights-runtime-extractor-pxc5q" Jul 23 21:00:17.231854 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.231801 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/130c768a-ee37-4d6e-905b-443f99d697fa-data-volume\") pod \"insights-runtime-extractor-pxc5q\" (UID: \"130c768a-ee37-4d6e-905b-443f99d697fa\") " pod="openshift-insights/insights-runtime-extractor-pxc5q" Jul 23 21:00:17.231854 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.231812 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/130c768a-ee37-4d6e-905b-443f99d697fa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pxc5q\" (UID: \"130c768a-ee37-4d6e-905b-443f99d697fa\") " pod="openshift-insights/insights-runtime-extractor-pxc5q" Jul 23 21:00:17.232026 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.231987 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c5a9523-0ee8-46f8-9141-4adcb46752d8-tmp-dir\") pod \"dns-default-zd8fn\" (UID: \"8c5a9523-0ee8-46f8-9141-4adcb46752d8\") " pod="openshift-dns/dns-default-zd8fn" Jul 23 21:00:17.232193 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.232169 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8c5a9523-0ee8-46f8-9141-4adcb46752d8-config-volume\") pod \"dns-default-zd8fn\" (UID: \"8c5a9523-0ee8-46f8-9141-4adcb46752d8\") " pod="openshift-dns/dns-default-zd8fn" Jul 23 21:00:17.235310 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.235290 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c5a9523-0ee8-46f8-9141-4adcb46752d8-metrics-tls\") pod \"dns-default-zd8fn\" (UID: \"8c5a9523-0ee8-46f8-9141-4adcb46752d8\") " pod="openshift-dns/dns-default-zd8fn" Jul 23 21:00:17.235359 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.235295 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/130c768a-ee37-4d6e-905b-443f99d697fa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pxc5q\" (UID: \"130c768a-ee37-4d6e-905b-443f99d697fa\") " pod="openshift-insights/insights-runtime-extractor-pxc5q" Jul 23 21:00:17.240849 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.240824 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm78z\" (UniqueName: \"kubernetes.io/projected/8c5a9523-0ee8-46f8-9141-4adcb46752d8-kube-api-access-sm78z\") pod \"dns-default-zd8fn\" (UID: \"8c5a9523-0ee8-46f8-9141-4adcb46752d8\") " pod="openshift-dns/dns-default-zd8fn" Jul 23 21:00:17.241163 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.241146 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqxw6\" (UniqueName: \"kubernetes.io/projected/130c768a-ee37-4d6e-905b-443f99d697fa-kube-api-access-rqxw6\") pod \"insights-runtime-extractor-pxc5q\" (UID: \"130c768a-ee37-4d6e-905b-443f99d697fa\") " pod="openshift-insights/insights-runtime-extractor-pxc5q" Jul 23 21:00:17.247019 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.247002 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pxc5q" Jul 23 21:00:17.276761 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.276735 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zd8fn" Jul 23 21:00:17.332683 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.332651 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h47vv\" (UniqueName: \"kubernetes.io/projected/a00a011b-50be-45d9-814c-ac4d821e8038-kube-api-access-h47vv\") pod \"ingress-canary-n6m9n\" (UID: \"a00a011b-50be-45d9-814c-ac4d821e8038\") " pod="openshift-ingress-canary/ingress-canary-n6m9n" Jul 23 21:00:17.332836 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.332744 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a00a011b-50be-45d9-814c-ac4d821e8038-cert\") pod \"ingress-canary-n6m9n\" (UID: \"a00a011b-50be-45d9-814c-ac4d821e8038\") " pod="openshift-ingress-canary/ingress-canary-n6m9n" Jul 23 21:00:17.335186 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.335153 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a00a011b-50be-45d9-814c-ac4d821e8038-cert\") pod \"ingress-canary-n6m9n\" (UID: \"a00a011b-50be-45d9-814c-ac4d821e8038\") " pod="openshift-ingress-canary/ingress-canary-n6m9n" Jul 23 21:00:17.342189 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.342166 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h47vv\" (UniqueName: \"kubernetes.io/projected/a00a011b-50be-45d9-814c-ac4d821e8038-kube-api-access-h47vv\") pod \"ingress-canary-n6m9n\" (UID: \"a00a011b-50be-45d9-814c-ac4d821e8038\") " pod="openshift-ingress-canary/ingress-canary-n6m9n" Jul 23 21:00:17.362074 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.362035 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n6m9n" Jul 23 21:00:17.458766 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.458744 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zd8fn"] Jul 23 21:00:17.461783 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:00:17.461748 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c5a9523_0ee8_46f8_9141_4adcb46752d8.slice/crio-b15d16407399fcf30ce319b39a9c8781f2fd28ac215fa3e867f6168142edd72a WatchSource:0}: Error finding container b15d16407399fcf30ce319b39a9c8781f2fd28ac215fa3e867f6168142edd72a: Status 404 returned error can't find the container with id b15d16407399fcf30ce319b39a9c8781f2fd28ac215fa3e867f6168142edd72a Jul 23 21:00:17.462022 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.462001 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pxc5q"] Jul 23 21:00:17.465356 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:00:17.465327 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod130c768a_ee37_4d6e_905b_443f99d697fa.slice/crio-e1bc53c691470340c937402af017b07999d97b63547fedb492a291f21e41d70b WatchSource:0}: Error finding container e1bc53c691470340c937402af017b07999d97b63547fedb492a291f21e41d70b: Status 404 returned error can't find the container with id e1bc53c691470340c937402af017b07999d97b63547fedb492a291f21e41d70b Jul 23 21:00:17.512025 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:17.511999 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n6m9n"] Jul 23 21:00:17.514654 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:00:17.514630 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda00a011b_50be_45d9_814c_ac4d821e8038.slice/crio-f14326f8dae543be204b4e1f5e21ddae8a4ea0431fda4da6a494f62b67a69661 WatchSource:0}: Error finding container f14326f8dae543be204b4e1f5e21ddae8a4ea0431fda4da6a494f62b67a69661: Status 404 returned error can't find the container with id f14326f8dae543be204b4e1f5e21ddae8a4ea0431fda4da6a494f62b67a69661 Jul 23 21:00:18.378088 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:18.378003 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n6m9n" event={"ID":"a00a011b-50be-45d9-814c-ac4d821e8038","Type":"ContainerStarted","Data":"f14326f8dae543be204b4e1f5e21ddae8a4ea0431fda4da6a494f62b67a69661"} Jul 23 21:00:18.379827 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:18.379753 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zd8fn" event={"ID":"8c5a9523-0ee8-46f8-9141-4adcb46752d8","Type":"ContainerStarted","Data":"b15d16407399fcf30ce319b39a9c8781f2fd28ac215fa3e867f6168142edd72a"} Jul 23 21:00:18.381937 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:18.381847 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pxc5q" event={"ID":"130c768a-ee37-4d6e-905b-443f99d697fa","Type":"ContainerStarted","Data":"e1bc53c691470340c937402af017b07999d97b63547fedb492a291f21e41d70b"} Jul 23 21:00:20.087430 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:20.087376 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:20.186788 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:20.186746 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:20.393689 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:20.392894 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zd8fn" event={"ID":"8c5a9523-0ee8-46f8-9141-4adcb46752d8","Type":"ContainerStarted","Data":"1fb17c2eb90f3a81f57e324799ca61d303d62d725acbe5b63d91d06e87c3c22d"} Jul 23 21:00:20.393689 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:20.392954 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zd8fn" event={"ID":"8c5a9523-0ee8-46f8-9141-4adcb46752d8","Type":"ContainerStarted","Data":"8b99ff0c630001fa7d1b729982a4ac3b7249ae044512c23a5019696184dc4538"} Jul 23 21:00:20.393689 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:20.393634 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zd8fn" Jul 23 21:00:20.411369 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:20.411323 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zd8fn" podStartSLOduration=2.405321765 podStartE2EDuration="4.411305499s" totalImagesPullingTime="2.005983734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:00:20.410085853 +0000 UTC m=+57.972519839" watchObservedRunningTime="2026-07-23 21:00:20.411305499 +0000 UTC m=+57.973739464" Jul 23 21:00:21.687764 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.687715 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:21.699665 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.699636 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65d87bb58b-68jmk"] Jul 23 21:00:21.710660 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.710633 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d87bb58b-68jmk" Jul 23 21:00:21.713541 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.713520 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 23 21:00:21.714371 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.714348 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qbctv\"" Jul 23 21:00:21.714482 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.714397 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 23 21:00:21.714482 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.714429 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 23 21:00:21.714593 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.714576 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 23 21:00:21.714841 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.714655 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 23 21:00:21.714841 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.714655 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 23 21:00:21.715038 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.715016 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 23 21:00:21.721545 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.721307 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65d87bb58b-68jmk"] Jul 23 21:00:21.771073 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.771045 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-service-ca\") pod \"console-65d87bb58b-68jmk\" (UID: \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\") " pod="openshift-console/console-65d87bb58b-68jmk" Jul 23 21:00:21.771242 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.771086 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-console-serving-cert\") pod \"console-65d87bb58b-68jmk\" (UID: \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\") " pod="openshift-console/console-65d87bb58b-68jmk" Jul 23 21:00:21.771242 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.771106 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-console-oauth-config\") pod \"console-65d87bb58b-68jmk\" (UID: \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\") " pod="openshift-console/console-65d87bb58b-68jmk" Jul 23 21:00:21.771242 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.771187 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckht9\" (UniqueName: \"kubernetes.io/projected/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-kube-api-access-ckht9\") pod \"console-65d87bb58b-68jmk\" (UID: \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\") " pod="openshift-console/console-65d87bb58b-68jmk" Jul 23 21:00:21.771383 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.771250 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-oauth-serving-cert\") pod \"console-65d87bb58b-68jmk\" (UID: \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\") " pod="openshift-console/console-65d87bb58b-68jmk" Jul 23 21:00:21.771383 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.771272 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-console-config\") pod \"console-65d87bb58b-68jmk\" (UID: \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\") " pod="openshift-console/console-65d87bb58b-68jmk" Jul 23 21:00:21.871556 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.871514 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-service-ca\") pod \"console-65d87bb58b-68jmk\" (UID: \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\") " pod="openshift-console/console-65d87bb58b-68jmk" Jul 23 21:00:21.871735 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.871584 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-console-serving-cert\") pod \"console-65d87bb58b-68jmk\" (UID: \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\") " pod="openshift-console/console-65d87bb58b-68jmk" Jul 23 21:00:21.871735 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.871608 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-console-oauth-config\") pod \"console-65d87bb58b-68jmk\" (UID: \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\") " pod="openshift-console/console-65d87bb58b-68jmk" Jul 23 21:00:21.871735 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.871696 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckht9\" (UniqueName: \"kubernetes.io/projected/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-kube-api-access-ckht9\") pod \"console-65d87bb58b-68jmk\" (UID: \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\") " pod="openshift-console/console-65d87bb58b-68jmk" Jul 23 21:00:21.871930 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.871737 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-oauth-serving-cert\") pod \"console-65d87bb58b-68jmk\" (UID: \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\") " pod="openshift-console/console-65d87bb58b-68jmk" Jul 23 21:00:21.871930 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.871763 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-console-config\") pod \"console-65d87bb58b-68jmk\" (UID: \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\") " pod="openshift-console/console-65d87bb58b-68jmk" Jul 23 21:00:21.872354 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.872300 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-service-ca\") pod \"console-65d87bb58b-68jmk\" (UID: \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\") " pod="openshift-console/console-65d87bb58b-68jmk" Jul 23 21:00:21.872477 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.872363 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-console-config\") pod \"console-65d87bb58b-68jmk\" (UID: \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\") " pod="openshift-console/console-65d87bb58b-68jmk" Jul 23 21:00:21.872477 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.872467 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-oauth-serving-cert\") pod \"console-65d87bb58b-68jmk\" (UID: \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\") " pod="openshift-console/console-65d87bb58b-68jmk" Jul 23 21:00:21.874306 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.874275 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-console-serving-cert\") pod \"console-65d87bb58b-68jmk\" (UID: \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\") " pod="openshift-console/console-65d87bb58b-68jmk" Jul 23 21:00:21.874407 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.874398 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-console-oauth-config\") pod \"console-65d87bb58b-68jmk\" (UID: \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\") " pod="openshift-console/console-65d87bb58b-68jmk" Jul 23 21:00:21.879881 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:21.879836 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckht9\" (UniqueName: \"kubernetes.io/projected/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-kube-api-access-ckht9\") pod \"console-65d87bb58b-68jmk\" (UID: \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\") " pod="openshift-console/console-65d87bb58b-68jmk" Jul 23 21:00:22.022501 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:22.022464 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d87bb58b-68jmk" Jul 23 21:00:23.082210 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.082173 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f84cddd8d-g5kdn"] Jul 23 21:00:23.084369 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.084343 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:00:23.086649 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.086618 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:23.092928 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.092904 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 23 21:00:23.096342 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.096319 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f84cddd8d-g5kdn"] Jul 23 21:00:23.148471 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.148438 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:23.181220 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.181186 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-service-ca\") pod \"console-f84cddd8d-g5kdn\" (UID: \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\") " pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:00:23.181220 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.181226 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-trusted-ca-bundle\") pod \"console-f84cddd8d-g5kdn\" (UID: \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\") " pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:00:23.181459 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.181267 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-console-serving-cert\") pod \"console-f84cddd8d-g5kdn\" (UID: \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\") " pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:00:23.181459 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.181326 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-console-oauth-config\") pod \"console-f84cddd8d-g5kdn\" (UID: \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\") " pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:00:23.181459 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.181363 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjc6q\" (UniqueName: \"kubernetes.io/projected/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-kube-api-access-sjc6q\") pod \"console-f84cddd8d-g5kdn\" (UID: \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\") " pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:00:23.181459 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.181443 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-console-config\") pod \"console-f84cddd8d-g5kdn\" (UID: \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\") " pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:00:23.181671 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.181474 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-oauth-serving-cert\") pod \"console-f84cddd8d-g5kdn\" (UID: \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\") " pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:00:23.282125 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.282086 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-service-ca\") pod \"console-f84cddd8d-g5kdn\" (UID: \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\") " pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:00:23.282323 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.282135 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-trusted-ca-bundle\") pod \"console-f84cddd8d-g5kdn\" (UID: \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\") " pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:00:23.282323 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.282182 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-console-serving-cert\") pod \"console-f84cddd8d-g5kdn\" (UID: \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\") " pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:00:23.282323 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.282208 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-console-oauth-config\") pod \"console-f84cddd8d-g5kdn\" (UID: \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\") " pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:00:23.282323 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.282286 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjc6q\" (UniqueName: \"kubernetes.io/projected/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-kube-api-access-sjc6q\") pod \"console-f84cddd8d-g5kdn\" (UID: \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\") " pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:00:23.282543 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.282396 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-console-config\") pod \"console-f84cddd8d-g5kdn\" (UID: \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\") " pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:00:23.282543 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.282493 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-oauth-serving-cert\") pod \"console-f84cddd8d-g5kdn\" (UID: \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\") " pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:00:23.282976 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.282929 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-service-ca\") pod \"console-f84cddd8d-g5kdn\" (UID: \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\") " pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:00:23.283266 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.283244 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-console-config\") pod \"console-f84cddd8d-g5kdn\" (UID: \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\") " pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:00:23.283266 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.283255 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-oauth-serving-cert\") pod \"console-f84cddd8d-g5kdn\" (UID: \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\") " pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:00:23.283622 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.283605 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-trusted-ca-bundle\") pod \"console-f84cddd8d-g5kdn\" (UID: \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\") " pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:00:23.285002 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.284968 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-console-serving-cert\") pod \"console-f84cddd8d-g5kdn\" (UID: \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\") " pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:00:23.285169 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.285105 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-console-oauth-config\") pod \"console-f84cddd8d-g5kdn\" (UID: \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\") " pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:00:23.293243 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.293217 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjc6q\" (UniqueName: \"kubernetes.io/projected/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-kube-api-access-sjc6q\") pod \"console-f84cddd8d-g5kdn\" (UID: \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\") " pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:00:23.395007 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.394801 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:00:23.474663 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.474632 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65d87bb58b-68jmk"] Jul 23 21:00:23.478788 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:00:23.478742 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2e122f0_3b29_42ff_ab75_25cf939aa0d0.slice/crio-b0374d2dca24ddbb434c7313620867eb91f4b63e54c24bd264432d76324e0295 WatchSource:0}: Error finding container b0374d2dca24ddbb434c7313620867eb91f4b63e54c24bd264432d76324e0295: Status 404 returned error can't find the container with id b0374d2dca24ddbb434c7313620867eb91f4b63e54c24bd264432d76324e0295 Jul 23 21:00:23.543346 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:23.543290 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f84cddd8d-g5kdn"] Jul 23 21:00:23.550179 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:00:23.550148 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb0a9a49_34c1_4ee9_b68c_80cb71b5234d.slice/crio-08739dfa89051769c045e3a0615f13cb81aa7b4485881187924a29dc706b0666 WatchSource:0}: Error finding container 08739dfa89051769c045e3a0615f13cb81aa7b4485881187924a29dc706b0666: Status 404 returned error can't find the container with id 08739dfa89051769c045e3a0615f13cb81aa7b4485881187924a29dc706b0666 Jul 23 21:00:24.323419 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:24.323138 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6dqgm" Jul 23 21:00:24.408830 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:24.408719 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pxc5q" event={"ID":"130c768a-ee37-4d6e-905b-443f99d697fa","Type":"ContainerStarted","Data":"acbfa67cda7860baf908b3a11fc9cd20c8c2aba50c43feb024990f62c9a4bb98"} Jul 23 21:00:24.411846 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:24.411126 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n6m9n" event={"ID":"a00a011b-50be-45d9-814c-ac4d821e8038","Type":"ContainerStarted","Data":"18c536ee3775ee2716b26b3f541d628bb9e99607726aa65eec96bc8c5c52da43"} Jul 23 21:00:24.413914 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:24.413840 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d87bb58b-68jmk" event={"ID":"a2e122f0-3b29-42ff-ab75-25cf939aa0d0","Type":"ContainerStarted","Data":"b0374d2dca24ddbb434c7313620867eb91f4b63e54c24bd264432d76324e0295"} Jul 23 21:00:24.417313 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:24.417263 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f84cddd8d-g5kdn" event={"ID":"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d","Type":"ContainerStarted","Data":"08739dfa89051769c045e3a0615f13cb81aa7b4485881187924a29dc706b0666"} Jul 23 21:00:24.456467 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:24.456366 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:24.517496 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:24.517459 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:24.883462 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:24.883419 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:24.983984 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:24.983947 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:26.657586 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:26.657546 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:26.724962 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:26.724927 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:27.078656 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:27.078613 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:27.137055 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:27.137019 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:27.725163 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:27.725124 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bc0eede-3f89-44b8-9acc-244ddd68e26b-original-pull-secret\") pod \"global-pull-secret-syncer-wqmks\" (UID: \"1bc0eede-3f89-44b8-9acc-244ddd68e26b\") " pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 21:00:27.725593 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:27.725191 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66db3efe-80c5-48fe-88ef-48536557da73-metrics-certs\") pod \"network-metrics-daemon-rbjvm\" (UID: \"66db3efe-80c5-48fe-88ef-48536557da73\") " pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 21:00:27.727466 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:27.727438 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 21:00:27.728250 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:27.728232 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 21:00:27.738666 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:27.738581 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66db3efe-80c5-48fe-88ef-48536557da73-metrics-certs\") pod \"network-metrics-daemon-rbjvm\" (UID: \"66db3efe-80c5-48fe-88ef-48536557da73\") " pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 21:00:27.738666 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:27.738618 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1bc0eede-3f89-44b8-9acc-244ddd68e26b-original-pull-secret\") pod \"global-pull-secret-syncer-wqmks\" (UID: \"1bc0eede-3f89-44b8-9acc-244ddd68e26b\") " pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 21:00:27.826259 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:27.826221 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dggz2\" (UniqueName: \"kubernetes.io/projected/01b37872-acdc-426d-9aef-d964ac7a91b4-kube-api-access-dggz2\") pod \"network-check-target-v2gxq\" (UID: \"01b37872-acdc-426d-9aef-d964ac7a91b4\") " pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 21:00:27.828573 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:27.828551 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 21:00:27.839215 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:27.839190 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 21:00:27.850522 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:27.850493 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dggz2\" (UniqueName: \"kubernetes.io/projected/01b37872-acdc-426d-9aef-d964ac7a91b4-kube-api-access-dggz2\") pod \"network-check-target-v2gxq\" (UID: \"01b37872-acdc-426d-9aef-d964ac7a91b4\") " pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 21:00:27.873740 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:27.873714 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-btkpz\"" Jul 23 21:00:27.876444 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:27.876425 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqmks" Jul 23 21:00:27.881471 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:27.881450 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbjvm" Jul 23 21:00:27.882799 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:27.882783 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9qkcv\"" Jul 23 21:00:27.891436 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:27.891420 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 21:00:28.710140 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:28.709312 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n6m9n" podStartSLOduration=5.883558688 podStartE2EDuration="11.709290492s" totalImagesPullingTime="5.825731804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:00:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:00:24.428902055 +0000 UTC m=+61.991336043" watchObservedRunningTime="2026-07-23 21:00:28.709290492 +0000 UTC m=+66.271724478" Jul 23 21:00:28.710342 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:28.710302 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wqmks"] Jul 23 21:00:28.714578 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:00:28.714503 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bc0eede_3f89_44b8_9acc_244ddd68e26b.slice/crio-5b6ce94346c1cf1c0ecd19a8b6be5553ba4136a791a60370b166cecefb89d7cf WatchSource:0}: Error finding container 5b6ce94346c1cf1c0ecd19a8b6be5553ba4136a791a60370b166cecefb89d7cf: Status 404 returned error can't find the container with id 5b6ce94346c1cf1c0ecd19a8b6be5553ba4136a791a60370b166cecefb89d7cf Jul 23 21:00:28.732982 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:28.732946 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rbjvm"] Jul 23 21:00:28.735290 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:00:28.735266 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66db3efe_80c5_48fe_88ef_48536557da73.slice/crio-e54c43874ca8e4ceef5fdcc0cf1da96b115512159f92c5f53f867e7922cc5e54 WatchSource:0}: Error finding container e54c43874ca8e4ceef5fdcc0cf1da96b115512159f92c5f53f867e7922cc5e54: Status 404 returned error can't find the container with id e54c43874ca8e4ceef5fdcc0cf1da96b115512159f92c5f53f867e7922cc5e54 Jul 23 21:00:28.934881 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:28.934760 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v2gxq"] Jul 23 21:00:28.938272 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:00:28.938247 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01b37872_acdc_426d_9aef_d964ac7a91b4.slice/crio-b43ca21890b7b772d3bb3c98774159328e19c5fa3f260623e39ab34ee30acd8b WatchSource:0}: Error finding container b43ca21890b7b772d3bb3c98774159328e19c5fa3f260623e39ab34ee30acd8b: Status 404 returned error can't find the container with id b43ca21890b7b772d3bb3c98774159328e19c5fa3f260623e39ab34ee30acd8b Jul 23 21:00:29.069629 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:29.069592 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:29.166178 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:29.166144 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:29.229856 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:29.229708 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8cskx"] Jul 23 21:00:29.232718 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:29.232698 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8cskx" Jul 23 21:00:29.236293 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:29.236117 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 23 21:00:29.236430 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:29.236297 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-vtq2r\"" Jul 23 21:00:29.244153 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:29.244129 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8cskx"] Jul 23 21:00:29.252299 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:29.252259 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:29.338345 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:29.338281 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4b602227-08f5-40ed-926f-85b793e1ffa4-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-8cskx\" (UID: \"4b602227-08f5-40ed-926f-85b793e1ffa4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8cskx" Jul 23 21:00:29.436293 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:29.436251 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d87bb58b-68jmk" event={"ID":"a2e122f0-3b29-42ff-ab75-25cf939aa0d0","Type":"ContainerStarted","Data":"4e839aa672d185b79fb3f28ec94f5b5b16cf93b23af59a8197c37d85267eef9e"} Jul 23 21:00:29.438545 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:29.438510 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rbjvm" event={"ID":"66db3efe-80c5-48fe-88ef-48536557da73","Type":"ContainerStarted","Data":"e54c43874ca8e4ceef5fdcc0cf1da96b115512159f92c5f53f867e7922cc5e54"} Jul 23 21:00:29.438881 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:29.438773 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4b602227-08f5-40ed-926f-85b793e1ffa4-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-8cskx\" (UID: \"4b602227-08f5-40ed-926f-85b793e1ffa4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8cskx" Jul 23 21:00:29.442438 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:29.441824 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wqmks" event={"ID":"1bc0eede-3f89-44b8-9acc-244ddd68e26b","Type":"ContainerStarted","Data":"5b6ce94346c1cf1c0ecd19a8b6be5553ba4136a791a60370b166cecefb89d7cf"} Jul 23 21:00:29.446400 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:29.446377 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f84cddd8d-g5kdn" event={"ID":"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d","Type":"ContainerStarted","Data":"087df76f84028d9834722130ff6115826e6766b322d4d212c6d57cd72497fb6d"} Jul 23 21:00:29.447383 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:29.447118 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4b602227-08f5-40ed-926f-85b793e1ffa4-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-8cskx\" (UID: \"4b602227-08f5-40ed-926f-85b793e1ffa4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8cskx" Jul 23 21:00:29.448217 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:29.448172 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v2gxq" event={"ID":"01b37872-acdc-426d-9aef-d964ac7a91b4","Type":"ContainerStarted","Data":"b43ca21890b7b772d3bb3c98774159328e19c5fa3f260623e39ab34ee30acd8b"} Jul 23 21:00:29.451489 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:29.451427 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pxc5q" event={"ID":"130c768a-ee37-4d6e-905b-443f99d697fa","Type":"ContainerStarted","Data":"be5deb2f12acda5eb4c2d125334e6042b4b2c1ca612e87cfa874f68b4ed3f743"} Jul 23 21:00:29.457899 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:29.457840 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65d87bb58b-68jmk" podStartSLOduration=3.387175058 podStartE2EDuration="8.45782714s" totalImagesPullingTime="5.070652082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:00:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:00:29.457344928 +0000 UTC m=+67.019778910" watchObservedRunningTime="2026-07-23 21:00:29.45782714 +0000 UTC m=+67.020261166" Jul 23 21:00:29.459549 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:29.459505 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:29.475463 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:29.475364 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f84cddd8d-g5kdn" podStartSLOduration=1.4749772349999999 podStartE2EDuration="6.475345567s" totalImagesPullingTime="5.000368332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:00:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:00:29.47426052 +0000 UTC m=+67.036694505" watchObservedRunningTime="2026-07-23 21:00:29.475345567 +0000 UTC m=+67.037779555" Jul 23 21:00:29.545916 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:29.545722 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8cskx" Jul 23 21:00:29.718309 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:29.718216 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:29.823166 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:29.823076 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:29.921697 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:29.921578 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:29.979299 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:29.979253 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8cskx"] Jul 23 21:00:29.984529 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:00:29.984498 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b602227_08f5_40ed_926f_85b793e1ffa4.slice/crio-443f1a55606abd033634bd71e86ff9e6629982d00e96ef43bd96497705464183 WatchSource:0}: Error finding container 443f1a55606abd033634bd71e86ff9e6629982d00e96ef43bd96497705464183: Status 404 returned error can't find the container with id 443f1a55606abd033634bd71e86ff9e6629982d00e96ef43bd96497705464183 Jul 23 21:00:29.986130 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:29.986100 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:30.301585 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:30.301547 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:30.396317 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:30.396195 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:30.459870 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:30.459822 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8cskx" event={"ID":"4b602227-08f5-40ed-926f-85b793e1ffa4","Type":"ContainerStarted","Data":"443f1a55606abd033634bd71e86ff9e6629982d00e96ef43bd96497705464183"} Jul 23 21:00:30.462837 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:30.462748 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rbjvm" event={"ID":"66db3efe-80c5-48fe-88ef-48536557da73","Type":"ContainerStarted","Data":"103d68887c48ef2892a578685977f2b5cf6cc16873d319fcf8a24d91cdf8c18a"} Jul 23 21:00:30.462837 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:30.462802 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rbjvm" event={"ID":"66db3efe-80c5-48fe-88ef-48536557da73","Type":"ContainerStarted","Data":"a6cbf0aaa003c4be69e085d0052f6ce35b47c04eff092b6cc5df0107b8dffb98"} Jul 23 21:00:31.302690 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:31.302654 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:31.400965 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:31.399999 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zd8fn" Jul 23 21:00:31.420090 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:31.420027 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rbjvm" podStartSLOduration=67.293916321 podStartE2EDuration="1m8.420006522s" totalImagesPullingTime="1.126090201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 20:59:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:00:30.482564417 +0000 UTC m=+68.044998403" watchObservedRunningTime="2026-07-23 21:00:31.420006522 +0000 UTC m=+68.982440508" Jul 23 21:00:31.487739 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:31.487612 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:31.545578 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:31.545482 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:31.687938 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:31.687846 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:31.786518 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:31.786489 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:32.023269 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:32.023201 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65d87bb58b-68jmk" Jul 23 21:00:32.024545 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:32.023832 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65d87bb58b-68jmk" Jul 23 21:00:32.024712 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:32.024678 2575 patch_prober.go:28] interesting pod/console-65d87bb58b-68jmk container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body= Jul 23 21:00:32.024823 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:32.024733 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-65d87bb58b-68jmk" podUID="a2e122f0-3b29-42ff-ab75-25cf939aa0d0" containerName="console" probeResult="failure" output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" Jul 23 21:00:32.345554 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:32.345463 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:32.445058 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:32.445001 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:32.499585 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:32.499549 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:33.395580 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:33.395537 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:00:33.396079 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:33.395609 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:00:33.397211 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:33.397188 2575 patch_prober.go:28] interesting pod/console-f84cddd8d-g5kdn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.10:8443/health\": dial tcp 10.134.0.10:8443: connect: connection refused" start-of-body= Jul 23 21:00:33.397309 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:33.397230 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-f84cddd8d-g5kdn" podUID="cb0a9a49-34c1-4ee9-b68c-80cb71b5234d" containerName="console" probeResult="failure" output="Get \"https://10.134.0.10:8443/health\": dial tcp 10.134.0.10:8443: connect: connection refused" Jul 23 21:00:36.487356 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:36.487320 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wqmks" event={"ID":"1bc0eede-3f89-44b8-9acc-244ddd68e26b","Type":"ContainerStarted","Data":"7aee3cf1b89773bdbab49864546a0d6b8135951657150553ad4acf2188c62000"} Jul 23 21:00:36.488891 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:36.488850 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v2gxq" event={"ID":"01b37872-acdc-426d-9aef-d964ac7a91b4","Type":"ContainerStarted","Data":"362f9ab1c7899bf9137ea648ec24d465d2bfb3a9eea6f68bfdcc5e63aa1637bd"} Jul 23 21:00:36.489017 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:36.488932 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 21:00:36.490812 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:36.490789 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pxc5q" event={"ID":"130c768a-ee37-4d6e-905b-443f99d697fa","Type":"ContainerStarted","Data":"d0b9ec8c4dcda601c064467dab587139867a69f9f84793cf1ab4f98fde5e5814"} Jul 23 21:00:36.492365 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:36.492344 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8cskx" event={"ID":"4b602227-08f5-40ed-926f-85b793e1ffa4","Type":"ContainerStarted","Data":"4158afa9b5ff8e36b37d365a181caebd1c7e7b4eef815a442c5617d5b72e8bf8"} Jul 23 21:00:36.492469 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:36.492452 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8cskx" Jul 23 21:00:36.496969 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:36.496950 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8cskx" Jul 23 21:00:36.503640 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:36.503590 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wqmks" podStartSLOduration=66.757413905 podStartE2EDuration="1m13.503575675s" totalImagesPullingTime="6.74616177s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 20:59:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:00:36.503535248 +0000 UTC m=+74.065969235" watchObservedRunningTime="2026-07-23 21:00:36.503575675 +0000 UTC m=+74.066009661" Jul 23 21:00:36.521933 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:36.521884 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pxc5q" podStartSLOduration=2.747680828 podStartE2EDuration="20.521852166s" totalImagesPullingTime="17.774171338s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:00:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:00:36.521227468 +0000 UTC m=+74.083661454" watchObservedRunningTime="2026-07-23 21:00:36.521852166 +0000 UTC m=+74.084286152" Jul 23 21:00:36.536536 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:36.536493 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8cskx" podStartSLOduration=2.072727176 podStartE2EDuration="7.536479387s" totalImagesPullingTime="5.463752211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:00:36.536027338 +0000 UTC m=+74.098461324" watchObservedRunningTime="2026-07-23 21:00:36.536479387 +0000 UTC m=+74.098913371" Jul 23 21:00:36.551015 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:36.550974 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-v2gxq" podStartSLOduration=67.02757547 podStartE2EDuration="1m13.550960248s" totalImagesPullingTime="6.523384778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 20:59:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:00:36.550187435 +0000 UTC m=+74.112621477" watchObservedRunningTime="2026-07-23 21:00:36.550960248 +0000 UTC m=+74.113394233" Jul 23 21:00:37.261696 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:37.261662 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:37.306189 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:37.306157 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-kqnm4"] Jul 23 21:00:37.308471 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:37.308455 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-kqnm4" Jul 23 21:00:37.310877 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:37.310835 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 23 21:00:37.310984 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:37.310912 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 23 21:00:37.310984 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:37.310956 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 23 21:00:37.311790 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:37.311774 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-m8q65\"" Jul 23 21:00:37.311891 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:37.311829 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 23 21:00:37.312107 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:37.312094 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 23 21:00:37.318805 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:37.318782 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-kqnm4"] Jul 23 21:00:37.344829 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:37.344798 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:37.401545 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:37.401514 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4049e25e-6c23-4409-b219-9de21593d82b-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-kqnm4\" (UID: \"4049e25e-6c23-4409-b219-9de21593d82b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-kqnm4" Jul 23 21:00:37.401694 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:37.401554 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4049e25e-6c23-4409-b219-9de21593d82b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-kqnm4\" (UID: \"4049e25e-6c23-4409-b219-9de21593d82b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-kqnm4" Jul 23 21:00:37.401694 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:37.401579 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4049e25e-6c23-4409-b219-9de21593d82b-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-kqnm4\" (UID: \"4049e25e-6c23-4409-b219-9de21593d82b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-kqnm4" Jul 23 21:00:37.401694 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:37.401671 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfzbt\" (UniqueName: \"kubernetes.io/projected/4049e25e-6c23-4409-b219-9de21593d82b-kube-api-access-vfzbt\") pod \"prometheus-operator-5945b5cfd-kqnm4\" (UID: \"4049e25e-6c23-4409-b219-9de21593d82b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-kqnm4" Jul 23 21:00:37.428743 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:37.428719 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:37.501945 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:37.501917 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfzbt\" (UniqueName: \"kubernetes.io/projected/4049e25e-6c23-4409-b219-9de21593d82b-kube-api-access-vfzbt\") pod \"prometheus-operator-5945b5cfd-kqnm4\" (UID: \"4049e25e-6c23-4409-b219-9de21593d82b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-kqnm4" Jul 23 21:00:37.502314 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:37.501954 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4049e25e-6c23-4409-b219-9de21593d82b-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-kqnm4\" (UID: \"4049e25e-6c23-4409-b219-9de21593d82b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-kqnm4" Jul 23 21:00:37.502314 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:37.501978 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4049e25e-6c23-4409-b219-9de21593d82b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-kqnm4\" (UID: \"4049e25e-6c23-4409-b219-9de21593d82b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-kqnm4" Jul 23 21:00:37.502314 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:37.502007 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4049e25e-6c23-4409-b219-9de21593d82b-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-kqnm4\" (UID: \"4049e25e-6c23-4409-b219-9de21593d82b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-kqnm4" Jul 23 21:00:37.502666 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:37.502646 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4049e25e-6c23-4409-b219-9de21593d82b-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-kqnm4\" (UID: \"4049e25e-6c23-4409-b219-9de21593d82b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-kqnm4" Jul 23 21:00:37.504363 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:37.504346 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4049e25e-6c23-4409-b219-9de21593d82b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-kqnm4\" (UID: \"4049e25e-6c23-4409-b219-9de21593d82b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-kqnm4" Jul 23 21:00:37.504436 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:37.504420 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4049e25e-6c23-4409-b219-9de21593d82b-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-kqnm4\" (UID: \"4049e25e-6c23-4409-b219-9de21593d82b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-kqnm4" Jul 23 21:00:37.510763 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:37.510735 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfzbt\" (UniqueName: \"kubernetes.io/projected/4049e25e-6c23-4409-b219-9de21593d82b-kube-api-access-vfzbt\") pod \"prometheus-operator-5945b5cfd-kqnm4\" (UID: \"4049e25e-6c23-4409-b219-9de21593d82b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-kqnm4" Jul 23 21:00:37.616953 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:37.616920 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-kqnm4" Jul 23 21:00:37.754590 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:37.754569 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-kqnm4"] Jul 23 21:00:37.757015 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:00:37.756988 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4049e25e_6c23_4409_b219_9de21593d82b.slice/crio-a75a93e439f54b6741c9316f0ec71231c28d35ead7fe763b98d2cae15575feb9 WatchSource:0}: Error finding container a75a93e439f54b6741c9316f0ec71231c28d35ead7fe763b98d2cae15575feb9: Status 404 returned error can't find the container with id a75a93e439f54b6741c9316f0ec71231c28d35ead7fe763b98d2cae15575feb9 Jul 23 21:00:38.499948 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:38.499913 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-kqnm4" event={"ID":"4049e25e-6c23-4409-b219-9de21593d82b","Type":"ContainerStarted","Data":"a75a93e439f54b6741c9316f0ec71231c28d35ead7fe763b98d2cae15575feb9"} Jul 23 21:00:38.669686 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:38.669650 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:38.725128 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:38.725095 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:39.492282 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:39.492190 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:39.505550 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:39.505516 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-kqnm4" event={"ID":"4049e25e-6c23-4409-b219-9de21593d82b","Type":"ContainerStarted","Data":"3a9ddf9f9eceeae07204089678ab259737999a018c7e1e6564676bb1ef04872a"} Jul 23 21:00:39.505698 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:39.505562 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-kqnm4" event={"ID":"4049e25e-6c23-4409-b219-9de21593d82b","Type":"ContainerStarted","Data":"4e9fe54c03c8d18bd15384a03a8a612b649b53e04a47f267ad8c2823f31b208b"} Jul 23 21:00:39.521481 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:39.521436 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-kqnm4" podStartSLOduration=1.076089943 podStartE2EDuration="2.521421287s" totalImagesPullingTime="1.445331344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:00:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:00:39.520298181 +0000 UTC m=+77.082732166" watchObservedRunningTime="2026-07-23 21:00:39.521421287 +0000 UTC m=+77.083855272" Jul 23 21:00:40.528525 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:40.528494 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:40.628286 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:40.628251 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:40.728142 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:40.728111 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:40.782720 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:40.782645 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:41.083058 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.082980 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:41.151217 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.151188 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:41.401894 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.401794 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:41.616832 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.616801 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:41.651572 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.651542 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-j5ph7"] Jul 23 21:00:41.653947 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.653907 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j5ph7" Jul 23 21:00:41.656167 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.656147 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-bwvvz\"" Jul 23 21:00:41.656725 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.656707 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 23 21:00:41.657215 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.657199 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 23 21:00:41.665135 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.665115 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-j5ph7"] Jul 23 21:00:41.674492 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.674468 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7wf6r"] Jul 23 21:00:41.676638 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.676620 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-jwggh"] Jul 23 21:00:41.676770 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.676752 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.678812 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.678794 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-jwggh" Jul 23 21:00:41.681158 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.680959 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 23 21:00:41.681158 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.681085 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 23 21:00:41.681423 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.681406 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-mbrmv\"" Jul 23 21:00:41.681756 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.681727 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 23 21:00:41.682299 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.682280 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 23 21:00:41.682390 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.682288 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 23 21:00:41.682588 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.682570 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 23 21:00:41.682668 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.682628 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pfj68\"" Jul 23 21:00:41.690335 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.690308 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-jwggh"] Jul 23 21:00:41.703433 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.703411 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:41.733376 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.733344 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49hpm\" (UniqueName: \"kubernetes.io/projected/dfbe5270-88f6-4718-b03c-a5282c6cf728-kube-api-access-49hpm\") pod \"kube-state-metrics-56c5594674-jwggh\" (UID: \"dfbe5270-88f6-4718-b03c-a5282c6cf728\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-jwggh" Jul 23 21:00:41.733539 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.733380 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2dcc106-2cc3-451a-8d1b-8d25448442f9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-j5ph7\" (UID: \"f2dcc106-2cc3-451a-8d1b-8d25448442f9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j5ph7" Jul 23 21:00:41.733539 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.733401 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ece2e4ce-4de0-4bb1-9991-13a53d8103b3-metrics-client-ca\") pod \"node-exporter-7wf6r\" (UID: \"ece2e4ce-4de0-4bb1-9991-13a53d8103b3\") " pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.733539 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.733424 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dfbe5270-88f6-4718-b03c-a5282c6cf728-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-jwggh\" (UID: \"dfbe5270-88f6-4718-b03c-a5282c6cf728\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-jwggh" Jul 23 21:00:41.733539 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.733476 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfbe5270-88f6-4718-b03c-a5282c6cf728-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-jwggh\" (UID: \"dfbe5270-88f6-4718-b03c-a5282c6cf728\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-jwggh" Jul 23 21:00:41.733539 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.733506 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dfbe5270-88f6-4718-b03c-a5282c6cf728-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-jwggh\" (UID: \"dfbe5270-88f6-4718-b03c-a5282c6cf728\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-jwggh" Jul 23 21:00:41.733539 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.733535 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ece2e4ce-4de0-4bb1-9991-13a53d8103b3-node-exporter-wtmp\") pod \"node-exporter-7wf6r\" (UID: \"ece2e4ce-4de0-4bb1-9991-13a53d8103b3\") " pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.733723 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.733562 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfbe5270-88f6-4718-b03c-a5282c6cf728-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-jwggh\" (UID: \"dfbe5270-88f6-4718-b03c-a5282c6cf728\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-jwggh" Jul 23 21:00:41.733723 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.733585 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dfbe5270-88f6-4718-b03c-a5282c6cf728-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-jwggh\" (UID: \"dfbe5270-88f6-4718-b03c-a5282c6cf728\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-jwggh" Jul 23 21:00:41.733723 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.733606 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2dcc106-2cc3-451a-8d1b-8d25448442f9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-j5ph7\" (UID: \"f2dcc106-2cc3-451a-8d1b-8d25448442f9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j5ph7" Jul 23 21:00:41.733723 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.733623 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ece2e4ce-4de0-4bb1-9991-13a53d8103b3-root\") pod \"node-exporter-7wf6r\" (UID: \"ece2e4ce-4de0-4bb1-9991-13a53d8103b3\") " pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.733723 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.733644 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ece2e4ce-4de0-4bb1-9991-13a53d8103b3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7wf6r\" (UID: \"ece2e4ce-4de0-4bb1-9991-13a53d8103b3\") " pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.733723 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.733703 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ece2e4ce-4de0-4bb1-9991-13a53d8103b3-node-exporter-accelerators-collector-config\") pod \"node-exporter-7wf6r\" (UID: \"ece2e4ce-4de0-4bb1-9991-13a53d8103b3\") " pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.733976 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.733740 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4nzz\" (UniqueName: \"kubernetes.io/projected/f2dcc106-2cc3-451a-8d1b-8d25448442f9-kube-api-access-r4nzz\") pod \"openshift-state-metrics-79f6958cdf-j5ph7\" (UID: \"f2dcc106-2cc3-451a-8d1b-8d25448442f9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j5ph7" Jul 23 21:00:41.733976 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.733759 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwfkj\" (UniqueName: \"kubernetes.io/projected/ece2e4ce-4de0-4bb1-9991-13a53d8103b3-kube-api-access-vwfkj\") pod \"node-exporter-7wf6r\" (UID: \"ece2e4ce-4de0-4bb1-9991-13a53d8103b3\") " pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.733976 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.733784 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2dcc106-2cc3-451a-8d1b-8d25448442f9-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-j5ph7\" (UID: \"f2dcc106-2cc3-451a-8d1b-8d25448442f9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j5ph7" Jul 23 21:00:41.733976 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.733818 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ece2e4ce-4de0-4bb1-9991-13a53d8103b3-node-exporter-textfile\") pod \"node-exporter-7wf6r\" (UID: \"ece2e4ce-4de0-4bb1-9991-13a53d8103b3\") " pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.733976 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.733836 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ece2e4ce-4de0-4bb1-9991-13a53d8103b3-node-exporter-tls\") pod \"node-exporter-7wf6r\" (UID: \"ece2e4ce-4de0-4bb1-9991-13a53d8103b3\") " pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.733976 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.733856 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ece2e4ce-4de0-4bb1-9991-13a53d8103b3-sys\") pod \"node-exporter-7wf6r\" (UID: \"ece2e4ce-4de0-4bb1-9991-13a53d8103b3\") " pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.770568 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.770539 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:41.834503 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.834466 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfbe5270-88f6-4718-b03c-a5282c6cf728-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-jwggh\" (UID: \"dfbe5270-88f6-4718-b03c-a5282c6cf728\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-jwggh" Jul 23 21:00:41.834503 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.834504 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dfbe5270-88f6-4718-b03c-a5282c6cf728-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-jwggh\" (UID: \"dfbe5270-88f6-4718-b03c-a5282c6cf728\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-jwggh" Jul 23 21:00:41.834742 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.834525 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2dcc106-2cc3-451a-8d1b-8d25448442f9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-j5ph7\" (UID: \"f2dcc106-2cc3-451a-8d1b-8d25448442f9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j5ph7" Jul 23 21:00:41.834742 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.834547 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ece2e4ce-4de0-4bb1-9991-13a53d8103b3-root\") pod \"node-exporter-7wf6r\" (UID: \"ece2e4ce-4de0-4bb1-9991-13a53d8103b3\") " pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.834742 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.834563 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ece2e4ce-4de0-4bb1-9991-13a53d8103b3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7wf6r\" (UID: \"ece2e4ce-4de0-4bb1-9991-13a53d8103b3\") " pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.834742 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.834582 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ece2e4ce-4de0-4bb1-9991-13a53d8103b3-node-exporter-accelerators-collector-config\") pod \"node-exporter-7wf6r\" (UID: \"ece2e4ce-4de0-4bb1-9991-13a53d8103b3\") " pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.834742 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.834609 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4nzz\" (UniqueName: \"kubernetes.io/projected/f2dcc106-2cc3-451a-8d1b-8d25448442f9-kube-api-access-r4nzz\") pod \"openshift-state-metrics-79f6958cdf-j5ph7\" (UID: \"f2dcc106-2cc3-451a-8d1b-8d25448442f9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j5ph7" Jul 23 21:00:41.834742 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.834625 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ece2e4ce-4de0-4bb1-9991-13a53d8103b3-root\") pod \"node-exporter-7wf6r\" (UID: \"ece2e4ce-4de0-4bb1-9991-13a53d8103b3\") " pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.834742 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.834628 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwfkj\" (UniqueName: \"kubernetes.io/projected/ece2e4ce-4de0-4bb1-9991-13a53d8103b3-kube-api-access-vwfkj\") pod \"node-exporter-7wf6r\" (UID: \"ece2e4ce-4de0-4bb1-9991-13a53d8103b3\") " pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.834742 ip-10-0-139-105 kubenswrapper[2575]: E0723 21:00:41.834628 2575 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 23 21:00:41.834742 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.834689 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2dcc106-2cc3-451a-8d1b-8d25448442f9-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-j5ph7\" (UID: \"f2dcc106-2cc3-451a-8d1b-8d25448442f9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j5ph7" Jul 23 21:00:41.834742 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.834722 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ece2e4ce-4de0-4bb1-9991-13a53d8103b3-node-exporter-textfile\") pod \"node-exporter-7wf6r\" (UID: \"ece2e4ce-4de0-4bb1-9991-13a53d8103b3\") " pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.834742 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.834749 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ece2e4ce-4de0-4bb1-9991-13a53d8103b3-node-exporter-tls\") pod \"node-exporter-7wf6r\" (UID: \"ece2e4ce-4de0-4bb1-9991-13a53d8103b3\") " pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.835328 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.834788 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ece2e4ce-4de0-4bb1-9991-13a53d8103b3-sys\") pod \"node-exporter-7wf6r\" (UID: \"ece2e4ce-4de0-4bb1-9991-13a53d8103b3\") " pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.835328 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.834826 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49hpm\" (UniqueName: \"kubernetes.io/projected/dfbe5270-88f6-4718-b03c-a5282c6cf728-kube-api-access-49hpm\") pod \"kube-state-metrics-56c5594674-jwggh\" (UID: \"dfbe5270-88f6-4718-b03c-a5282c6cf728\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-jwggh" Jul 23 21:00:41.835328 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.834936 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2dcc106-2cc3-451a-8d1b-8d25448442f9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-j5ph7\" (UID: \"f2dcc106-2cc3-451a-8d1b-8d25448442f9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j5ph7" Jul 23 21:00:41.835328 ip-10-0-139-105 kubenswrapper[2575]: E0723 21:00:41.834998 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2dcc106-2cc3-451a-8d1b-8d25448442f9-openshift-state-metrics-tls podName:f2dcc106-2cc3-451a-8d1b-8d25448442f9 nodeName:}" failed. No retries permitted until 2026-07-23 21:00:42.334940988 +0000 UTC m=+79.897374960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f2dcc106-2cc3-451a-8d1b-8d25448442f9-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-j5ph7" (UID: "f2dcc106-2cc3-451a-8d1b-8d25448442f9") : secret "openshift-state-metrics-tls" not found Jul 23 21:00:41.835328 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.835133 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ece2e4ce-4de0-4bb1-9991-13a53d8103b3-metrics-client-ca\") pod \"node-exporter-7wf6r\" (UID: \"ece2e4ce-4de0-4bb1-9991-13a53d8103b3\") " pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.835328 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.835176 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ece2e4ce-4de0-4bb1-9991-13a53d8103b3-sys\") pod \"node-exporter-7wf6r\" (UID: \"ece2e4ce-4de0-4bb1-9991-13a53d8103b3\") " pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.835328 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.835177 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dfbe5270-88f6-4718-b03c-a5282c6cf728-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-jwggh\" (UID: \"dfbe5270-88f6-4718-b03c-a5282c6cf728\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-jwggh" Jul 23 21:00:41.835328 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.835240 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfbe5270-88f6-4718-b03c-a5282c6cf728-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-jwggh\" (UID: \"dfbe5270-88f6-4718-b03c-a5282c6cf728\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-jwggh" Jul 23 21:00:41.841312 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.836412 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ece2e4ce-4de0-4bb1-9991-13a53d8103b3-node-exporter-accelerators-collector-config\") pod \"node-exporter-7wf6r\" (UID: \"ece2e4ce-4de0-4bb1-9991-13a53d8103b3\") " pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.841312 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.836694 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dfbe5270-88f6-4718-b03c-a5282c6cf728-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-jwggh\" (UID: \"dfbe5270-88f6-4718-b03c-a5282c6cf728\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-jwggh" Jul 23 21:00:41.841312 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.836910 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dfbe5270-88f6-4718-b03c-a5282c6cf728-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-jwggh\" (UID: \"dfbe5270-88f6-4718-b03c-a5282c6cf728\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-jwggh" Jul 23 21:00:41.841312 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.836979 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ece2e4ce-4de0-4bb1-9991-13a53d8103b3-node-exporter-wtmp\") pod \"node-exporter-7wf6r\" (UID: \"ece2e4ce-4de0-4bb1-9991-13a53d8103b3\") " pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.841312 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.837088 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ece2e4ce-4de0-4bb1-9991-13a53d8103b3-node-exporter-textfile\") pod \"node-exporter-7wf6r\" (UID: \"ece2e4ce-4de0-4bb1-9991-13a53d8103b3\") " pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.841312 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.837180 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2dcc106-2cc3-451a-8d1b-8d25448442f9-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-j5ph7\" (UID: \"f2dcc106-2cc3-451a-8d1b-8d25448442f9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j5ph7" Jul 23 21:00:41.841312 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.837221 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ece2e4ce-4de0-4bb1-9991-13a53d8103b3-node-exporter-wtmp\") pod \"node-exporter-7wf6r\" (UID: \"ece2e4ce-4de0-4bb1-9991-13a53d8103b3\") " pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.841312 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.837695 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfbe5270-88f6-4718-b03c-a5282c6cf728-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-jwggh\" (UID: \"dfbe5270-88f6-4718-b03c-a5282c6cf728\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-jwggh" Jul 23 21:00:41.841312 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.837810 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfbe5270-88f6-4718-b03c-a5282c6cf728-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-jwggh\" (UID: \"dfbe5270-88f6-4718-b03c-a5282c6cf728\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-jwggh" Jul 23 21:00:41.841312 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.838080 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dfbe5270-88f6-4718-b03c-a5282c6cf728-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-jwggh\" (UID: \"dfbe5270-88f6-4718-b03c-a5282c6cf728\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-jwggh" Jul 23 21:00:41.841312 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.838148 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ece2e4ce-4de0-4bb1-9991-13a53d8103b3-metrics-client-ca\") pod \"node-exporter-7wf6r\" (UID: \"ece2e4ce-4de0-4bb1-9991-13a53d8103b3\") " pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.841312 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.838491 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2dcc106-2cc3-451a-8d1b-8d25448442f9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-j5ph7\" (UID: \"f2dcc106-2cc3-451a-8d1b-8d25448442f9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j5ph7" Jul 23 21:00:41.842279 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.842257 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ece2e4ce-4de0-4bb1-9991-13a53d8103b3-node-exporter-tls\") pod \"node-exporter-7wf6r\" (UID: \"ece2e4ce-4de0-4bb1-9991-13a53d8103b3\") " pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.842380 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.842364 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dfbe5270-88f6-4718-b03c-a5282c6cf728-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-jwggh\" (UID: \"dfbe5270-88f6-4718-b03c-a5282c6cf728\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-jwggh" Jul 23 21:00:41.843044 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.843029 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ece2e4ce-4de0-4bb1-9991-13a53d8103b3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7wf6r\" (UID: \"ece2e4ce-4de0-4bb1-9991-13a53d8103b3\") " pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.845662 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.845638 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwfkj\" (UniqueName: \"kubernetes.io/projected/ece2e4ce-4de0-4bb1-9991-13a53d8103b3-kube-api-access-vwfkj\") pod \"node-exporter-7wf6r\" (UID: \"ece2e4ce-4de0-4bb1-9991-13a53d8103b3\") " pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.846055 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.846034 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4nzz\" (UniqueName: \"kubernetes.io/projected/f2dcc106-2cc3-451a-8d1b-8d25448442f9-kube-api-access-r4nzz\") pod \"openshift-state-metrics-79f6958cdf-j5ph7\" (UID: \"f2dcc106-2cc3-451a-8d1b-8d25448442f9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j5ph7" Jul 23 21:00:41.847170 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.847153 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49hpm\" (UniqueName: \"kubernetes.io/projected/dfbe5270-88f6-4718-b03c-a5282c6cf728-kube-api-access-49hpm\") pod \"kube-state-metrics-56c5594674-jwggh\" (UID: \"dfbe5270-88f6-4718-b03c-a5282c6cf728\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-jwggh" Jul 23 21:00:41.887682 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.887648 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:41.983388 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.983299 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:41.986248 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.986233 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7wf6r" Jul 23 21:00:41.991917 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:41.991896 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-jwggh" Jul 23 21:00:41.999273 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:00:41.999243 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podece2e4ce_4de0_4bb1_9991_13a53d8103b3.slice/crio-5025b6954dbfe2606362278677df577153b6aedbc03777c5d520a848de0da2fc WatchSource:0}: Error finding container 5025b6954dbfe2606362278677df577153b6aedbc03777c5d520a848de0da2fc: Status 404 returned error can't find the container with id 5025b6954dbfe2606362278677df577153b6aedbc03777c5d520a848de0da2fc Jul 23 21:00:42.027408 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.027380 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65d87bb58b-68jmk" Jul 23 21:00:42.031520 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.031494 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65d87bb58b-68jmk" Jul 23 21:00:42.050598 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.050575 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:42.129689 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.129658 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-jwggh"] Jul 23 21:00:42.131125 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.131096 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:42.132485 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:00:42.132463 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfbe5270_88f6_4718_b03c_a5282c6cf728.slice/crio-4c9756ce2ebff347a869b5e4292f0b46c53638c53b7e87a8766d802fbccd20b5 WatchSource:0}: Error finding container 4c9756ce2ebff347a869b5e4292f0b46c53638c53b7e87a8766d802fbccd20b5: Status 404 returned error can't find the container with id 4c9756ce2ebff347a869b5e4292f0b46c53638c53b7e87a8766d802fbccd20b5 Jul 23 21:00:42.229768 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.229732 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:42.341976 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.341942 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2dcc106-2cc3-451a-8d1b-8d25448442f9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-j5ph7\" (UID: \"f2dcc106-2cc3-451a-8d1b-8d25448442f9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j5ph7" Jul 23 21:00:42.344248 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.344227 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2dcc106-2cc3-451a-8d1b-8d25448442f9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-j5ph7\" (UID: \"f2dcc106-2cc3-451a-8d1b-8d25448442f9\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j5ph7" Jul 23 21:00:42.518104 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.518059 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-jwggh" event={"ID":"dfbe5270-88f6-4718-b03c-a5282c6cf728","Type":"ContainerStarted","Data":"4c9756ce2ebff347a869b5e4292f0b46c53638c53b7e87a8766d802fbccd20b5"} Jul 23 21:00:42.519917 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.519819 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7wf6r" event={"ID":"ece2e4ce-4de0-4bb1-9991-13a53d8103b3","Type":"ContainerStarted","Data":"5025b6954dbfe2606362278677df577153b6aedbc03777c5d520a848de0da2fc"} Jul 23 21:00:42.562902 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.562849 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j5ph7" Jul 23 21:00:42.627096 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.626954 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:42.721410 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.721323 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-j5ph7"] Jul 23 21:00:42.724742 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.724713 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:42.725879 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:00:42.725831 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2dcc106_2cc3_451a_8d1b_8d25448442f9.slice/crio-51628b21ea5e1eca3c232e54db4c7975f707c5fcf471ce71a493afac4226af71 WatchSource:0}: Error finding container 51628b21ea5e1eca3c232e54db4c7975f707c5fcf471ce71a493afac4226af71: Status 404 returned error can't find the container with id 51628b21ea5e1eca3c232e54db4c7975f707c5fcf471ce71a493afac4226af71 Jul 23 21:00:42.732697 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.732671 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 21:00:42.735822 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.735798 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.741145 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.738381 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 23 21:00:42.741145 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.738911 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 23 21:00:42.741145 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.738964 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 23 21:00:42.741145 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.739177 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 23 21:00:42.741145 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.739646 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 23 21:00:42.741145 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.739757 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wqwhw\"" Jul 23 21:00:42.741145 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.739841 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 23 21:00:42.741145 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.739992 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 23 21:00:42.741145 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.740094 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 23 21:00:42.741997 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.741790 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 23 21:00:42.753344 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.753314 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 21:00:42.799652 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.799621 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:42.846186 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.846140 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/998be41c-d4c6-475f-a6e1-ecc5d2091633-config-volume\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.846186 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.846190 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/998be41c-d4c6-475f-a6e1-ecc5d2091633-web-config\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.846410 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.846226 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/998be41c-d4c6-475f-a6e1-ecc5d2091633-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.846410 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.846260 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/998be41c-d4c6-475f-a6e1-ecc5d2091633-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.846410 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.846315 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/998be41c-d4c6-475f-a6e1-ecc5d2091633-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.846410 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.846358 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/998be41c-d4c6-475f-a6e1-ecc5d2091633-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.846410 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.846387 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/998be41c-d4c6-475f-a6e1-ecc5d2091633-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.846657 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.846425 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/998be41c-d4c6-475f-a6e1-ecc5d2091633-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.846657 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.846451 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjjcj\" (UniqueName: \"kubernetes.io/projected/998be41c-d4c6-475f-a6e1-ecc5d2091633-kube-api-access-wjjcj\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.846657 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.846476 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/998be41c-d4c6-475f-a6e1-ecc5d2091633-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.846657 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.846510 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/998be41c-d4c6-475f-a6e1-ecc5d2091633-tls-assets\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.846657 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.846525 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/998be41c-d4c6-475f-a6e1-ecc5d2091633-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.846657 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.846561 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/998be41c-d4c6-475f-a6e1-ecc5d2091633-config-out\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.947187 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.947096 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/998be41c-d4c6-475f-a6e1-ecc5d2091633-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.947187 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.947149 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/998be41c-d4c6-475f-a6e1-ecc5d2091633-tls-assets\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.947187 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.947179 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/998be41c-d4c6-475f-a6e1-ecc5d2091633-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.947467 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.947215 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/998be41c-d4c6-475f-a6e1-ecc5d2091633-config-out\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.947467 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.947249 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/998be41c-d4c6-475f-a6e1-ecc5d2091633-config-volume\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.947467 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.947271 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/998be41c-d4c6-475f-a6e1-ecc5d2091633-web-config\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.947467 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.947303 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/998be41c-d4c6-475f-a6e1-ecc5d2091633-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.947467 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.947333 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/998be41c-d4c6-475f-a6e1-ecc5d2091633-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.947467 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.947385 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/998be41c-d4c6-475f-a6e1-ecc5d2091633-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.947467 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.947425 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/998be41c-d4c6-475f-a6e1-ecc5d2091633-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.947467 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.947454 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/998be41c-d4c6-475f-a6e1-ecc5d2091633-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.947854 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.947488 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/998be41c-d4c6-475f-a6e1-ecc5d2091633-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.947854 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.947515 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjjcj\" (UniqueName: \"kubernetes.io/projected/998be41c-d4c6-475f-a6e1-ecc5d2091633-kube-api-access-wjjcj\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.948028 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.947986 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/998be41c-d4c6-475f-a6e1-ecc5d2091633-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.948489 ip-10-0-139-105 kubenswrapper[2575]: E0723 21:00:42.948470 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/998be41c-d4c6-475f-a6e1-ecc5d2091633-alertmanager-trusted-ca-bundle podName:998be41c-d4c6-475f-a6e1-ecc5d2091633 nodeName:}" failed. No retries permitted until 2026-07-23 21:00:43.448448016 +0000 UTC m=+81.010882002 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/998be41c-d4c6-475f-a6e1-ecc5d2091633-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "998be41c-d4c6-475f-a6e1-ecc5d2091633") : configmap references non-existent config key: ca-bundle.crt Jul 23 21:00:42.949342 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.949319 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/998be41c-d4c6-475f-a6e1-ecc5d2091633-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.950829 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.950807 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/998be41c-d4c6-475f-a6e1-ecc5d2091633-config-out\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.953199 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.953172 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/998be41c-d4c6-475f-a6e1-ecc5d2091633-config-volume\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.953738 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.953297 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/998be41c-d4c6-475f-a6e1-ecc5d2091633-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.953738 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.953665 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/998be41c-d4c6-475f-a6e1-ecc5d2091633-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.953738 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.953700 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/998be41c-d4c6-475f-a6e1-ecc5d2091633-tls-assets\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.953738 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.953700 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/998be41c-d4c6-475f-a6e1-ecc5d2091633-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.954000 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.953781 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/998be41c-d4c6-475f-a6e1-ecc5d2091633-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.954102 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.954063 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/998be41c-d4c6-475f-a6e1-ecc5d2091633-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.955339 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.955294 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/998be41c-d4c6-475f-a6e1-ecc5d2091633-web-config\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:42.965841 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:42.965814 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjjcj\" (UniqueName: \"kubernetes.io/projected/998be41c-d4c6-475f-a6e1-ecc5d2091633-kube-api-access-wjjcj\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:43.400054 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.400030 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:00:43.406548 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.406490 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:00:43.452925 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.452889 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/998be41c-d4c6-475f-a6e1-ecc5d2091633-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:43.453779 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.453728 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/998be41c-d4c6-475f-a6e1-ecc5d2091633-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"998be41c-d4c6-475f-a6e1-ecc5d2091633\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:43.479043 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.479006 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65d87bb58b-68jmk"] Jul 23 21:00:43.526974 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.526785 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-jwggh" event={"ID":"dfbe5270-88f6-4718-b03c-a5282c6cf728","Type":"ContainerStarted","Data":"5899756bd16e90e096d4619625f1f6b8cdabe5bbffb93034a2a8b2ff2f2fd1f2"} Jul 23 21:00:43.526974 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.526839 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-jwggh" event={"ID":"dfbe5270-88f6-4718-b03c-a5282c6cf728","Type":"ContainerStarted","Data":"05eaa4760cec01f41630c8d819a3f004b5f9d054974adf5bfd17f1f378adc4c3"} Jul 23 21:00:43.528815 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.528783 2575 generic.go:356] "Generic (PLEG): container finished" podID="ece2e4ce-4de0-4bb1-9991-13a53d8103b3" containerID="4e4ee5891e3127b2c741d95309687dc54873c105d439d3c299c4a4607887c1bf" exitCode=0 Jul 23 21:00:43.528947 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.528893 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7wf6r" event={"ID":"ece2e4ce-4de0-4bb1-9991-13a53d8103b3","Type":"ContainerDied","Data":"4e4ee5891e3127b2c741d95309687dc54873c105d439d3c299c4a4607887c1bf"} Jul 23 21:00:43.532716 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.532221 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j5ph7" event={"ID":"f2dcc106-2cc3-451a-8d1b-8d25448442f9","Type":"ContainerStarted","Data":"2a029a2e6f0a986c8f312c15540b236b645c46194103894757df3e3fd24619b1"} Jul 23 21:00:43.532716 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.532274 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j5ph7" event={"ID":"f2dcc106-2cc3-451a-8d1b-8d25448442f9","Type":"ContainerStarted","Data":"51f77a54eeb56f53e73a364e0155e12e6402371ba680f7d77e39688cafb926da"} Jul 23 21:00:43.532716 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.532302 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j5ph7" event={"ID":"f2dcc106-2cc3-451a-8d1b-8d25448442f9","Type":"ContainerStarted","Data":"51628b21ea5e1eca3c232e54db4c7975f707c5fcf471ce71a493afac4226af71"} Jul 23 21:00:43.618044 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.618020 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:43.648758 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.648738 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 21:00:43.651355 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.651330 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-86b5585fff-nr566"] Jul 23 21:00:43.657274 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.657259 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" Jul 23 21:00:43.659890 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.659576 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 23 21:00:43.659890 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.659714 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 23 21:00:43.659890 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.659780 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 23 21:00:43.660104 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.660055 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7vk13056um2ip\"" Jul 23 21:00:43.660283 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.660259 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 23 21:00:43.660391 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.660320 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 23 21:00:43.660464 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.660262 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-kltsv\"" Jul 23 21:00:43.667131 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.667025 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-86b5585fff-nr566"] Jul 23 21:00:43.700531 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.700496 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:43.755759 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.755724 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/760c8194-715d-4d30-b590-275c2f457a8a-metrics-client-ca\") pod \"thanos-querier-86b5585fff-nr566\" (UID: \"760c8194-715d-4d30-b590-275c2f457a8a\") " pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" Jul 23 21:00:43.755950 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.755771 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/760c8194-715d-4d30-b590-275c2f457a8a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86b5585fff-nr566\" (UID: \"760c8194-715d-4d30-b590-275c2f457a8a\") " pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" Jul 23 21:00:43.755950 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.755924 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnn7d\" (UniqueName: \"kubernetes.io/projected/760c8194-715d-4d30-b590-275c2f457a8a-kube-api-access-vnn7d\") pod \"thanos-querier-86b5585fff-nr566\" (UID: \"760c8194-715d-4d30-b590-275c2f457a8a\") " pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" Jul 23 21:00:43.756067 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.755981 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/760c8194-715d-4d30-b590-275c2f457a8a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86b5585fff-nr566\" (UID: \"760c8194-715d-4d30-b590-275c2f457a8a\") " pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" Jul 23 21:00:43.756067 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.756012 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/760c8194-715d-4d30-b590-275c2f457a8a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86b5585fff-nr566\" (UID: \"760c8194-715d-4d30-b590-275c2f457a8a\") " pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" Jul 23 21:00:43.756067 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.756044 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/760c8194-715d-4d30-b590-275c2f457a8a-secret-thanos-querier-tls\") pod \"thanos-querier-86b5585fff-nr566\" (UID: \"760c8194-715d-4d30-b590-275c2f457a8a\") " pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" Jul 23 21:00:43.756220 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.756080 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/760c8194-715d-4d30-b590-275c2f457a8a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86b5585fff-nr566\" (UID: \"760c8194-715d-4d30-b590-275c2f457a8a\") " pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" Jul 23 21:00:43.756220 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.756106 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/760c8194-715d-4d30-b590-275c2f457a8a-secret-grpc-tls\") pod \"thanos-querier-86b5585fff-nr566\" (UID: \"760c8194-715d-4d30-b590-275c2f457a8a\") " pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" Jul 23 21:00:43.792795 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.789849 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:43.799777 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.799665 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 21:00:43.801888 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:00:43.801849 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod998be41c_d4c6_475f_a6e1_ecc5d2091633.slice/crio-a24ab3cdabc968480d4651fa237d09886e6c22c4de741070758e4d7e26eac6cd WatchSource:0}: Error finding container a24ab3cdabc968480d4651fa237d09886e6c22c4de741070758e4d7e26eac6cd: Status 404 returned error can't find the container with id a24ab3cdabc968480d4651fa237d09886e6c22c4de741070758e4d7e26eac6cd Jul 23 21:00:43.861394 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.858215 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/760c8194-715d-4d30-b590-275c2f457a8a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86b5585fff-nr566\" (UID: \"760c8194-715d-4d30-b590-275c2f457a8a\") " pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" Jul 23 21:00:43.861394 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.858267 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/760c8194-715d-4d30-b590-275c2f457a8a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86b5585fff-nr566\" (UID: \"760c8194-715d-4d30-b590-275c2f457a8a\") " pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" Jul 23 21:00:43.861394 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.858302 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/760c8194-715d-4d30-b590-275c2f457a8a-secret-thanos-querier-tls\") pod \"thanos-querier-86b5585fff-nr566\" (UID: \"760c8194-715d-4d30-b590-275c2f457a8a\") " pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" Jul 23 21:00:43.861394 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.858340 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/760c8194-715d-4d30-b590-275c2f457a8a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86b5585fff-nr566\" (UID: \"760c8194-715d-4d30-b590-275c2f457a8a\") " pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" Jul 23 21:00:43.861394 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.858368 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/760c8194-715d-4d30-b590-275c2f457a8a-secret-grpc-tls\") pod \"thanos-querier-86b5585fff-nr566\" (UID: \"760c8194-715d-4d30-b590-275c2f457a8a\") " pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" Jul 23 21:00:43.861394 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.858419 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/760c8194-715d-4d30-b590-275c2f457a8a-metrics-client-ca\") pod \"thanos-querier-86b5585fff-nr566\" (UID: \"760c8194-715d-4d30-b590-275c2f457a8a\") " pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" Jul 23 21:00:43.861394 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.858449 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/760c8194-715d-4d30-b590-275c2f457a8a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86b5585fff-nr566\" (UID: \"760c8194-715d-4d30-b590-275c2f457a8a\") " pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" Jul 23 21:00:43.861394 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.858511 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnn7d\" (UniqueName: \"kubernetes.io/projected/760c8194-715d-4d30-b590-275c2f457a8a-kube-api-access-vnn7d\") pod \"thanos-querier-86b5585fff-nr566\" (UID: \"760c8194-715d-4d30-b590-275c2f457a8a\") " pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" Jul 23 21:00:43.861394 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.860814 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/760c8194-715d-4d30-b590-275c2f457a8a-metrics-client-ca\") pod \"thanos-querier-86b5585fff-nr566\" (UID: \"760c8194-715d-4d30-b590-275c2f457a8a\") " pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" Jul 23 21:00:43.864138 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.863793 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/760c8194-715d-4d30-b590-275c2f457a8a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86b5585fff-nr566\" (UID: \"760c8194-715d-4d30-b590-275c2f457a8a\") " pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" Jul 23 21:00:43.864138 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.864007 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/760c8194-715d-4d30-b590-275c2f457a8a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86b5585fff-nr566\" (UID: \"760c8194-715d-4d30-b590-275c2f457a8a\") " pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" Jul 23 21:00:43.864138 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.864102 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/760c8194-715d-4d30-b590-275c2f457a8a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86b5585fff-nr566\" (UID: \"760c8194-715d-4d30-b590-275c2f457a8a\") " pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" Jul 23 21:00:43.864809 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.864780 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/760c8194-715d-4d30-b590-275c2f457a8a-secret-thanos-querier-tls\") pod \"thanos-querier-86b5585fff-nr566\" (UID: \"760c8194-715d-4d30-b590-275c2f457a8a\") " pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" Jul 23 21:00:43.864995 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.864972 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/760c8194-715d-4d30-b590-275c2f457a8a-secret-grpc-tls\") pod \"thanos-querier-86b5585fff-nr566\" (UID: \"760c8194-715d-4d30-b590-275c2f457a8a\") " pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" Jul 23 21:00:43.865070 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.865047 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/760c8194-715d-4d30-b590-275c2f457a8a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86b5585fff-nr566\" (UID: \"760c8194-715d-4d30-b590-275c2f457a8a\") " pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" Jul 23 21:00:43.867029 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.867009 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnn7d\" (UniqueName: \"kubernetes.io/projected/760c8194-715d-4d30-b590-275c2f457a8a-kube-api-access-vnn7d\") pod \"thanos-querier-86b5585fff-nr566\" (UID: \"760c8194-715d-4d30-b590-275c2f457a8a\") " pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" Jul 23 21:00:43.887408 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.887380 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:43.969811 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:43.969773 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" Jul 23 21:00:44.111756 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:44.111714 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-86b5585fff-nr566"] Jul 23 21:00:44.116571 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:00:44.116542 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod760c8194_715d_4d30_b590_275c2f457a8a.slice/crio-8f823449ae6e650a1fc755b9003fd76796691faca926c3cfc2a1123c76309fc2 WatchSource:0}: Error finding container 8f823449ae6e650a1fc755b9003fd76796691faca926c3cfc2a1123c76309fc2: Status 404 returned error can't find the container with id 8f823449ae6e650a1fc755b9003fd76796691faca926c3cfc2a1123c76309fc2 Jul 23 21:00:44.539067 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:44.539037 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-jwggh" event={"ID":"dfbe5270-88f6-4718-b03c-a5282c6cf728","Type":"ContainerStarted","Data":"24bca0e837bd710a60b6b1f8c263c678a9ee0ec840098737eb882898e31096cf"} Jul 23 21:00:44.541337 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:44.541315 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7wf6r" event={"ID":"ece2e4ce-4de0-4bb1-9991-13a53d8103b3","Type":"ContainerStarted","Data":"a0c0da133706c096fb08c64a2cabadfedd8115222fcaba284fe54cdf57050928"} Jul 23 21:00:44.541467 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:44.541358 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7wf6r" event={"ID":"ece2e4ce-4de0-4bb1-9991-13a53d8103b3","Type":"ContainerStarted","Data":"13589cb50566414f5b99364d462113eec05ab6583ce74ff7ee9749541aa05378"} Jul 23 21:00:44.542674 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:44.542648 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" event={"ID":"760c8194-715d-4d30-b590-275c2f457a8a","Type":"ContainerStarted","Data":"8f823449ae6e650a1fc755b9003fd76796691faca926c3cfc2a1123c76309fc2"} Jul 23 21:00:44.545328 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:44.545307 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j5ph7" event={"ID":"f2dcc106-2cc3-451a-8d1b-8d25448442f9","Type":"ContainerStarted","Data":"42cfc431130ec321ba307c4224b831c9bce32710370683af10ef4e9b3c186ff5"} Jul 23 21:00:44.546687 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:44.546665 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"998be41c-d4c6-475f-a6e1-ecc5d2091633","Type":"ContainerStarted","Data":"a24ab3cdabc968480d4651fa237d09886e6c22c4de741070758e4d7e26eac6cd"} Jul 23 21:00:44.560315 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:44.560255 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-jwggh" podStartSLOduration=2.379151287 podStartE2EDuration="3.560236654s" totalImagesPullingTime="1.181085367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:00:44.558684542 +0000 UTC m=+82.121118526" watchObservedRunningTime="2026-07-23 21:00:44.560236654 +0000 UTC m=+82.122670640" Jul 23 21:00:44.580057 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:44.580007 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7wf6r" podStartSLOduration=2.166200997 podStartE2EDuration="3.579991442s" totalImagesPullingTime="1.313379934s" totalInitContainerRuntime="100.410511ms" isStatefulPod=true podCreationTimestamp="2026-07-23 21:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:00:44.579212962 +0000 UTC m=+82.141646964" watchObservedRunningTime="2026-07-23 21:00:44.579991442 +0000 UTC m=+82.142425476" Jul 23 21:00:44.602006 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:44.601945 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-j5ph7" podStartSLOduration=2.565165036 podStartE2EDuration="3.601927726s" totalImagesPullingTime="1.03676269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:00:44.601750542 +0000 UTC m=+82.164184528" watchObservedRunningTime="2026-07-23 21:00:44.601927726 +0000 UTC m=+82.164361702" Jul 23 21:00:44.644094 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:44.644064 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:44.745170 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:44.745051 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:45.087456 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:45.087380 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:45.211419 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:45.211345 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:45.552280 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:45.552246 2575 generic.go:356] "Generic (PLEG): container finished" podID="998be41c-d4c6-475f-a6e1-ecc5d2091633" containerID="9c993716ab0f229d82ddfc084f77e8ca75011ab047ec155d72fc609b835776fc" exitCode=0 Jul 23 21:00:45.552450 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:45.552406 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"998be41c-d4c6-475f-a6e1-ecc5d2091633","Type":"ContainerDied","Data":"9c993716ab0f229d82ddfc084f77e8ca75011ab047ec155d72fc609b835776fc"} Jul 23 21:00:46.079625 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.079593 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-588596fc7-s4mbs"] Jul 23 21:00:46.083762 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.083156 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" Jul 23 21:00:46.085833 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.085629 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-9brx9\"" Jul 23 21:00:46.085833 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.085638 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 23 21:00:46.086383 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.086269 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-588596fc7-s4mbs"] Jul 23 21:00:46.086383 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.086325 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 23 21:00:46.086738 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.086720 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2h3sjnjnjn48h\"" Jul 23 21:00:46.086946 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.086750 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 23 21:00:46.087072 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.086953 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 23 21:00:46.179398 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.179207 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d25481e8-e46e-4575-8c72-a127394fbda3-secret-metrics-server-tls\") pod \"metrics-server-588596fc7-s4mbs\" (UID: \"d25481e8-e46e-4575-8c72-a127394fbda3\") " pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" Jul 23 21:00:46.179398 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.179308 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d25481e8-e46e-4575-8c72-a127394fbda3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-588596fc7-s4mbs\" (UID: \"d25481e8-e46e-4575-8c72-a127394fbda3\") " pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" Jul 23 21:00:46.179398 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.179367 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d25481e8-e46e-4575-8c72-a127394fbda3-secret-metrics-server-client-certs\") pod \"metrics-server-588596fc7-s4mbs\" (UID: \"d25481e8-e46e-4575-8c72-a127394fbda3\") " pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" Jul 23 21:00:46.179635 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.179426 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d25481e8-e46e-4575-8c72-a127394fbda3-metrics-server-audit-profiles\") pod \"metrics-server-588596fc7-s4mbs\" (UID: \"d25481e8-e46e-4575-8c72-a127394fbda3\") " pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" Jul 23 21:00:46.179635 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.179463 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d25481e8-e46e-4575-8c72-a127394fbda3-client-ca-bundle\") pod \"metrics-server-588596fc7-s4mbs\" (UID: \"d25481e8-e46e-4575-8c72-a127394fbda3\") " pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" Jul 23 21:00:46.179635 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.179489 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d25481e8-e46e-4575-8c72-a127394fbda3-audit-log\") pod \"metrics-server-588596fc7-s4mbs\" (UID: \"d25481e8-e46e-4575-8c72-a127394fbda3\") " pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" Jul 23 21:00:46.179635 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.179526 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g5l6\" (UniqueName: \"kubernetes.io/projected/d25481e8-e46e-4575-8c72-a127394fbda3-kube-api-access-2g5l6\") pod \"metrics-server-588596fc7-s4mbs\" (UID: \"d25481e8-e46e-4575-8c72-a127394fbda3\") " pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" Jul 23 21:00:46.280409 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.280376 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d25481e8-e46e-4575-8c72-a127394fbda3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-588596fc7-s4mbs\" (UID: \"d25481e8-e46e-4575-8c72-a127394fbda3\") " pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" Jul 23 21:00:46.280577 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.280437 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d25481e8-e46e-4575-8c72-a127394fbda3-secret-metrics-server-client-certs\") pod \"metrics-server-588596fc7-s4mbs\" (UID: \"d25481e8-e46e-4575-8c72-a127394fbda3\") " pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" Jul 23 21:00:46.281011 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.280987 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d25481e8-e46e-4575-8c72-a127394fbda3-metrics-server-audit-profiles\") pod \"metrics-server-588596fc7-s4mbs\" (UID: \"d25481e8-e46e-4575-8c72-a127394fbda3\") " pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" Jul 23 21:00:46.281138 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.281034 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d25481e8-e46e-4575-8c72-a127394fbda3-client-ca-bundle\") pod \"metrics-server-588596fc7-s4mbs\" (UID: \"d25481e8-e46e-4575-8c72-a127394fbda3\") " pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" Jul 23 21:00:46.281138 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.281062 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d25481e8-e46e-4575-8c72-a127394fbda3-audit-log\") pod \"metrics-server-588596fc7-s4mbs\" (UID: \"d25481e8-e46e-4575-8c72-a127394fbda3\") " pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" Jul 23 21:00:46.281138 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.281096 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g5l6\" (UniqueName: \"kubernetes.io/projected/d25481e8-e46e-4575-8c72-a127394fbda3-kube-api-access-2g5l6\") pod \"metrics-server-588596fc7-s4mbs\" (UID: \"d25481e8-e46e-4575-8c72-a127394fbda3\") " pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" Jul 23 21:00:46.281138 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.281127 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d25481e8-e46e-4575-8c72-a127394fbda3-secret-metrics-server-tls\") pod \"metrics-server-588596fc7-s4mbs\" (UID: \"d25481e8-e46e-4575-8c72-a127394fbda3\") " pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" Jul 23 21:00:46.281618 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.281594 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d25481e8-e46e-4575-8c72-a127394fbda3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-588596fc7-s4mbs\" (UID: \"d25481e8-e46e-4575-8c72-a127394fbda3\") " pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" Jul 23 21:00:46.281740 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.281704 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d25481e8-e46e-4575-8c72-a127394fbda3-audit-log\") pod \"metrics-server-588596fc7-s4mbs\" (UID: \"d25481e8-e46e-4575-8c72-a127394fbda3\") " pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" Jul 23 21:00:46.282486 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.282461 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d25481e8-e46e-4575-8c72-a127394fbda3-metrics-server-audit-profiles\") pod \"metrics-server-588596fc7-s4mbs\" (UID: \"d25481e8-e46e-4575-8c72-a127394fbda3\") " pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" Jul 23 21:00:46.283407 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.283383 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d25481e8-e46e-4575-8c72-a127394fbda3-secret-metrics-server-client-certs\") pod \"metrics-server-588596fc7-s4mbs\" (UID: \"d25481e8-e46e-4575-8c72-a127394fbda3\") " pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" Jul 23 21:00:46.284333 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.284312 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d25481e8-e46e-4575-8c72-a127394fbda3-secret-metrics-server-tls\") pod \"metrics-server-588596fc7-s4mbs\" (UID: \"d25481e8-e46e-4575-8c72-a127394fbda3\") " pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" Jul 23 21:00:46.284417 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.284320 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d25481e8-e46e-4575-8c72-a127394fbda3-client-ca-bundle\") pod \"metrics-server-588596fc7-s4mbs\" (UID: \"d25481e8-e46e-4575-8c72-a127394fbda3\") " pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" Jul 23 21:00:46.289272 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.289253 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g5l6\" (UniqueName: \"kubernetes.io/projected/d25481e8-e46e-4575-8c72-a127394fbda3-kube-api-access-2g5l6\") pod \"metrics-server-588596fc7-s4mbs\" (UID: \"d25481e8-e46e-4575-8c72-a127394fbda3\") " pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" Jul 23 21:00:46.403790 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.403742 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" Jul 23 21:00:46.449061 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.448617 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rp65r"] Jul 23 21:00:46.451123 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.451056 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:46.451795 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.451646 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rp65r" Jul 23 21:00:46.459145 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.459120 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 23 21:00:46.459274 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.459240 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-tkgtx\"" Jul 23 21:00:46.470539 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.470462 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rp65r"] Jul 23 21:00:46.472114 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.472092 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65bf49986f-llnj9"] Jul 23 21:00:46.479900 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.479838 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:00:46.486680 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.485895 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65bf49986f-llnj9"] Jul 23 21:00:46.516009 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.515960 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:46.565627 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.565551 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" event={"ID":"760c8194-715d-4d30-b590-275c2f457a8a","Type":"ContainerStarted","Data":"500745541cf300a6c46a56f43417c8116dad031e38ad1f4c5bf5d6a142d03117"} Jul 23 21:00:46.565627 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.565614 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" event={"ID":"760c8194-715d-4d30-b590-275c2f457a8a","Type":"ContainerStarted","Data":"d7ceac484a56ea085c19e15d35c6d37be60a3ac87f4cc1d605a91645442b1d91"} Jul 23 21:00:46.565831 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.565648 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" event={"ID":"760c8194-715d-4d30-b590-275c2f457a8a","Type":"ContainerStarted","Data":"2bdda483e1682b7726a8a4c23e7707a76615553b8720271eec95b236943247e2"} Jul 23 21:00:46.584187 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.584157 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-588596fc7-s4mbs"] Jul 23 21:00:46.588028 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.587983 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-service-ca\") pod \"console-65bf49986f-llnj9\" (UID: \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\") " pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:00:46.588211 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.588189 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-console-config\") pod \"console-65bf49986f-llnj9\" (UID: \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\") " pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:00:46.588362 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:00:46.588071 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd25481e8_e46e_4575_8c72_a127394fbda3.slice/crio-aee4af8575a035ba868830a98ec9db3358db9cac142bb5ffd5c836ea85a35035 WatchSource:0}: Error finding container aee4af8575a035ba868830a98ec9db3358db9cac142bb5ffd5c836ea85a35035: Status 404 returned error can't find the container with id aee4af8575a035ba868830a98ec9db3358db9cac142bb5ffd5c836ea85a35035 Jul 23 21:00:46.588362 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.588226 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hkcg\" (UniqueName: \"kubernetes.io/projected/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-kube-api-access-8hkcg\") pod \"console-65bf49986f-llnj9\" (UID: \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\") " pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:00:46.588362 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.588292 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-trusted-ca-bundle\") pod \"console-65bf49986f-llnj9\" (UID: \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\") " pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:00:46.588362 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.588343 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz4xt\" (UniqueName: \"kubernetes.io/projected/69121ee2-87c5-4d30-9c8d-36d216bf259e-kube-api-access-tz4xt\") pod \"monitoring-plugin-7b7b7bc8bf-rp65r\" (UID: \"69121ee2-87c5-4d30-9c8d-36d216bf259e\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rp65r" Jul 23 21:00:46.588546 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.588393 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-console-serving-cert\") pod \"console-65bf49986f-llnj9\" (UID: \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\") " pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:00:46.588546 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.588420 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-console-oauth-config\") pod \"console-65bf49986f-llnj9\" (UID: \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\") " pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:00:46.588546 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.588466 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69121ee2-87c5-4d30-9c8d-36d216bf259e-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-rp65r\" (UID: \"69121ee2-87c5-4d30-9c8d-36d216bf259e\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rp65r" Jul 23 21:00:46.588546 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.588501 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-oauth-serving-cert\") pod \"console-65bf49986f-llnj9\" (UID: \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\") " pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:00:46.656491 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.656455 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:46.689169 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.689132 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hkcg\" (UniqueName: \"kubernetes.io/projected/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-kube-api-access-8hkcg\") pod \"console-65bf49986f-llnj9\" (UID: \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\") " pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:00:46.689338 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.689175 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-trusted-ca-bundle\") pod \"console-65bf49986f-llnj9\" (UID: \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\") " pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:00:46.689338 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.689251 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz4xt\" (UniqueName: \"kubernetes.io/projected/69121ee2-87c5-4d30-9c8d-36d216bf259e-kube-api-access-tz4xt\") pod \"monitoring-plugin-7b7b7bc8bf-rp65r\" (UID: \"69121ee2-87c5-4d30-9c8d-36d216bf259e\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rp65r" Jul 23 21:00:46.689338 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.689281 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-console-serving-cert\") pod \"console-65bf49986f-llnj9\" (UID: \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\") " pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:00:46.689338 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.689308 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-console-oauth-config\") pod \"console-65bf49986f-llnj9\" (UID: \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\") " pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:00:46.689563 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.689347 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69121ee2-87c5-4d30-9c8d-36d216bf259e-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-rp65r\" (UID: \"69121ee2-87c5-4d30-9c8d-36d216bf259e\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rp65r" Jul 23 21:00:46.689563 ip-10-0-139-105 kubenswrapper[2575]: E0723 21:00:46.689429 2575 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 23 21:00:46.689563 ip-10-0-139-105 kubenswrapper[2575]: E0723 21:00:46.689485 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69121ee2-87c5-4d30-9c8d-36d216bf259e-monitoring-plugin-cert podName:69121ee2-87c5-4d30-9c8d-36d216bf259e nodeName:}" failed. No retries permitted until 2026-07-23 21:00:47.189466485 +0000 UTC m=+84.751900449 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/69121ee2-87c5-4d30-9c8d-36d216bf259e-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-rp65r" (UID: "69121ee2-87c5-4d30-9c8d-36d216bf259e") : secret "monitoring-plugin-cert" not found Jul 23 21:00:46.689563 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.689537 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-oauth-serving-cert\") pod \"console-65bf49986f-llnj9\" (UID: \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\") " pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:00:46.689758 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.689594 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-service-ca\") pod \"console-65bf49986f-llnj9\" (UID: \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\") " pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:00:46.689758 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.689628 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-console-config\") pod \"console-65bf49986f-llnj9\" (UID: \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\") " pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:00:46.690220 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.690186 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-trusted-ca-bundle\") pod \"console-65bf49986f-llnj9\" (UID: \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\") " pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:00:46.690328 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.690259 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-oauth-serving-cert\") pod \"console-65bf49986f-llnj9\" (UID: \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\") " pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:00:46.690328 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.690278 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-console-config\") pod \"console-65bf49986f-llnj9\" (UID: \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\") " pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:00:46.690557 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.690539 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-service-ca\") pod \"console-65bf49986f-llnj9\" (UID: \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\") " pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:00:46.692216 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.692194 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-console-oauth-config\") pod \"console-65bf49986f-llnj9\" (UID: \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\") " pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:00:46.692410 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.692395 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-console-serving-cert\") pod \"console-65bf49986f-llnj9\" (UID: \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\") " pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:00:46.700320 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.700297 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz4xt\" (UniqueName: \"kubernetes.io/projected/69121ee2-87c5-4d30-9c8d-36d216bf259e-kube-api-access-tz4xt\") pod \"monitoring-plugin-7b7b7bc8bf-rp65r\" (UID: \"69121ee2-87c5-4d30-9c8d-36d216bf259e\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rp65r" Jul 23 21:00:46.700432 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.700375 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hkcg\" (UniqueName: \"kubernetes.io/projected/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-kube-api-access-8hkcg\") pod \"console-65bf49986f-llnj9\" (UID: \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\") " pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:00:46.756131 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.756095 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:46.810545 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.810512 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:00:46.812398 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:46.812373 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:47.117936 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.117815 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65bf49986f-llnj9"] Jul 23 21:00:47.120686 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:00:47.120657 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7eee33b_12ca_4f04_8da1_2c4fe09916f9.slice/crio-11fe1a413832f2144b0d08ddd19e4dcf26ba36c30f433eee1e00bae719d0f10d WatchSource:0}: Error finding container 11fe1a413832f2144b0d08ddd19e4dcf26ba36c30f433eee1e00bae719d0f10d: Status 404 returned error can't find the container with id 11fe1a413832f2144b0d08ddd19e4dcf26ba36c30f433eee1e00bae719d0f10d Jul 23 21:00:47.195730 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.195698 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69121ee2-87c5-4d30-9c8d-36d216bf259e-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-rp65r\" (UID: \"69121ee2-87c5-4d30-9c8d-36d216bf259e\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rp65r" Jul 23 21:00:47.203842 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.203781 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69121ee2-87c5-4d30-9c8d-36d216bf259e-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-rp65r\" (UID: \"69121ee2-87c5-4d30-9c8d-36d216bf259e\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rp65r" Jul 23 21:00:47.223052 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.223021 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:47.321375 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.321255 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:47.369432 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.369399 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rp65r" Jul 23 21:00:47.573938 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.573903 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65bf49986f-llnj9" event={"ID":"c7eee33b-12ca-4f04-8da1-2c4fe09916f9","Type":"ContainerStarted","Data":"188c39118d262a867a8ce8ec0205d01402da688ab3166afb4af3fe5de309b6b0"} Jul 23 21:00:47.574093 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.574051 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65bf49986f-llnj9" event={"ID":"c7eee33b-12ca-4f04-8da1-2c4fe09916f9","Type":"ContainerStarted","Data":"11fe1a413832f2144b0d08ddd19e4dcf26ba36c30f433eee1e00bae719d0f10d"} Jul 23 21:00:47.575815 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.575795 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" event={"ID":"d25481e8-e46e-4575-8c72-a127394fbda3","Type":"ContainerStarted","Data":"aee4af8575a035ba868830a98ec9db3358db9cac142bb5ffd5c836ea85a35035"} Jul 23 21:00:47.579021 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.578966 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" event={"ID":"760c8194-715d-4d30-b590-275c2f457a8a","Type":"ContainerStarted","Data":"6d1e8eafb5d9b113c3f07a01451b2ac669cc9f809f935768037f99232d1269c7"} Jul 23 21:00:47.585453 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.585430 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"998be41c-d4c6-475f-a6e1-ecc5d2091633","Type":"ContainerStarted","Data":"cd6cfcf7312eb0acea259f99691320053d18b3dcf9cb250127d2f2fabd23c6e4"} Jul 23 21:00:47.585686 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.585667 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"998be41c-d4c6-475f-a6e1-ecc5d2091633","Type":"ContainerStarted","Data":"4990b0ba5022ea334d9386997f70b641356b15aac14e944fdcef6a361bd670ab"} Jul 23 21:00:47.585872 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.585836 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"998be41c-d4c6-475f-a6e1-ecc5d2091633","Type":"ContainerStarted","Data":"474f4efee53b79a4987ba0b9eda2991fc7a3cae28f0661cc632df9ea4f2e162f"} Jul 23 21:00:47.586012 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.585996 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"998be41c-d4c6-475f-a6e1-ecc5d2091633","Type":"ContainerStarted","Data":"c5ae907060bd9f39345f7f8618cc9508f75bfcd6b224d8ee87628e795cc894cf"} Jul 23 21:00:47.586156 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.586141 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"998be41c-d4c6-475f-a6e1-ecc5d2091633","Type":"ContainerStarted","Data":"909e21b29a4aa798c17ee3fd512ed65fff46a655e63554385e378cfc651e3fb4"} Jul 23 21:00:47.591121 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.591094 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rp65r"] Jul 23 21:00:47.593584 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.593517 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65bf49986f-llnj9" podStartSLOduration=1.5935011650000002 podStartE2EDuration="1.593501165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:00:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:00:47.592984439 +0000 UTC m=+85.155418423" watchObservedRunningTime="2026-07-23 21:00:47.593501165 +0000 UTC m=+85.155935145" Jul 23 21:00:47.601121 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:00:47.601089 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69121ee2_87c5_4d30_9c8d_36d216bf259e.slice/crio-9ba0c0b5617eeebbb4c8ab9a6492be1c290709a514d67a1c173bf4b8ba20cea0 WatchSource:0}: Error finding container 9ba0c0b5617eeebbb4c8ab9a6492be1c290709a514d67a1c173bf4b8ba20cea0: Status 404 returned error can't find the container with id 9ba0c0b5617eeebbb4c8ab9a6492be1c290709a514d67a1c173bf4b8ba20cea0 Jul 23 21:00:47.932757 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.932718 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 21:00:47.936505 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.936409 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:47.938483 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.938453 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:47.941084 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.941051 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 23 21:00:47.941200 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.941187 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 23 21:00:47.941412 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.941396 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 23 21:00:47.941497 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.941409 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 23 21:00:47.942048 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.941662 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-l5hbl\"" Jul 23 21:00:47.942048 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.941702 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 23 21:00:47.942048 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.941714 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 23 21:00:47.942048 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.941788 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 23 21:00:47.942048 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.941789 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 23 21:00:47.942048 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.941879 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 23 21:00:47.942048 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.941962 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4a7odvlh1mv16\"" Jul 23 21:00:47.942434 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.942150 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 23 21:00:47.942434 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.942180 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 23 21:00:47.942434 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.942208 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 23 21:00:47.942850 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.942805 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 23 21:00:47.945813 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.945687 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 23 21:00:47.954632 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:47.954609 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 21:00:48.106663 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.106627 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/caea3587-84a9-45bf-ac03-b7b0e70315e4-web-config\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.106663 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.106666 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/caea3587-84a9-45bf-ac03-b7b0e70315e4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.106926 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.106789 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/caea3587-84a9-45bf-ac03-b7b0e70315e4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.106926 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.106826 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/caea3587-84a9-45bf-ac03-b7b0e70315e4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.106926 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.106854 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/caea3587-84a9-45bf-ac03-b7b0e70315e4-config\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.107051 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.106943 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/caea3587-84a9-45bf-ac03-b7b0e70315e4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.107051 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.106993 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/caea3587-84a9-45bf-ac03-b7b0e70315e4-config-out\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.107051 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.107018 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/caea3587-84a9-45bf-ac03-b7b0e70315e4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.107051 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.107041 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caea3587-84a9-45bf-ac03-b7b0e70315e4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.107223 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.107076 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/caea3587-84a9-45bf-ac03-b7b0e70315e4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.107223 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.107110 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caea3587-84a9-45bf-ac03-b7b0e70315e4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.107223 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.107157 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caea3587-84a9-45bf-ac03-b7b0e70315e4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.107363 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.107226 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caea3587-84a9-45bf-ac03-b7b0e70315e4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.107363 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.107263 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/caea3587-84a9-45bf-ac03-b7b0e70315e4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.107363 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.107307 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/caea3587-84a9-45bf-ac03-b7b0e70315e4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.107507 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.107363 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/caea3587-84a9-45bf-ac03-b7b0e70315e4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.107507 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.107409 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/caea3587-84a9-45bf-ac03-b7b0e70315e4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.107507 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.107433 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqj6z\" (UniqueName: \"kubernetes.io/projected/caea3587-84a9-45bf-ac03-b7b0e70315e4-kube-api-access-bqj6z\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.107507 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.107491 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/caea3587-84a9-45bf-ac03-b7b0e70315e4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.107684 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.107520 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/caea3587-84a9-45bf-ac03-b7b0e70315e4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.149960 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.149881 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:48.209492 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.209406 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caea3587-84a9-45bf-ac03-b7b0e70315e4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.209492 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.209463 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/caea3587-84a9-45bf-ac03-b7b0e70315e4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.209693 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.209580 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/caea3587-84a9-45bf-ac03-b7b0e70315e4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.209693 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.209631 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/caea3587-84a9-45bf-ac03-b7b0e70315e4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.209693 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.209682 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/caea3587-84a9-45bf-ac03-b7b0e70315e4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.209841 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.209707 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqj6z\" (UniqueName: \"kubernetes.io/projected/caea3587-84a9-45bf-ac03-b7b0e70315e4-kube-api-access-bqj6z\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.209841 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.209748 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/caea3587-84a9-45bf-ac03-b7b0e70315e4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.209841 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.209781 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/caea3587-84a9-45bf-ac03-b7b0e70315e4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.209841 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.209811 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/caea3587-84a9-45bf-ac03-b7b0e70315e4-web-config\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.209841 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.209839 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/caea3587-84a9-45bf-ac03-b7b0e70315e4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.210089 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.209923 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/caea3587-84a9-45bf-ac03-b7b0e70315e4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.210089 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.209948 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/caea3587-84a9-45bf-ac03-b7b0e70315e4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.210382 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.210361 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caea3587-84a9-45bf-ac03-b7b0e70315e4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.210382 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.210363 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/caea3587-84a9-45bf-ac03-b7b0e70315e4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.210507 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.210397 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/caea3587-84a9-45bf-ac03-b7b0e70315e4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.210614 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.210601 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/caea3587-84a9-45bf-ac03-b7b0e70315e4-config\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.210666 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.210631 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/caea3587-84a9-45bf-ac03-b7b0e70315e4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.212892 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.212709 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/caea3587-84a9-45bf-ac03-b7b0e70315e4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.212999 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.212920 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/caea3587-84a9-45bf-ac03-b7b0e70315e4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.213582 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.213185 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/caea3587-84a9-45bf-ac03-b7b0e70315e4-config-out\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.213582 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.213222 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/caea3587-84a9-45bf-ac03-b7b0e70315e4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.213582 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.213251 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caea3587-84a9-45bf-ac03-b7b0e70315e4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.213582 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.213296 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/caea3587-84a9-45bf-ac03-b7b0e70315e4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.213582 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.213334 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caea3587-84a9-45bf-ac03-b7b0e70315e4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.213582 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.213392 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caea3587-84a9-45bf-ac03-b7b0e70315e4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.213582 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.213511 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/caea3587-84a9-45bf-ac03-b7b0e70315e4-config\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.216540 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.215186 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caea3587-84a9-45bf-ac03-b7b0e70315e4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.216540 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.215196 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caea3587-84a9-45bf-ac03-b7b0e70315e4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.216540 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.215620 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/caea3587-84a9-45bf-ac03-b7b0e70315e4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.216540 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.215716 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/caea3587-84a9-45bf-ac03-b7b0e70315e4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.216540 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.216307 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/caea3587-84a9-45bf-ac03-b7b0e70315e4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.216540 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.216393 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/caea3587-84a9-45bf-ac03-b7b0e70315e4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.216846 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.216780 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/caea3587-84a9-45bf-ac03-b7b0e70315e4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.219901 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.217270 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/caea3587-84a9-45bf-ac03-b7b0e70315e4-web-config\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.220463 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.220438 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caea3587-84a9-45bf-ac03-b7b0e70315e4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.220535 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.220441 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/caea3587-84a9-45bf-ac03-b7b0e70315e4-config-out\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.222307 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.222261 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/caea3587-84a9-45bf-ac03-b7b0e70315e4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.222490 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.222446 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/caea3587-84a9-45bf-ac03-b7b0e70315e4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.223477 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.223432 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/caea3587-84a9-45bf-ac03-b7b0e70315e4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.225380 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.225357 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqj6z\" (UniqueName: \"kubernetes.io/projected/caea3587-84a9-45bf-ac03-b7b0e70315e4-kube-api-access-bqj6z\") pod \"prometheus-k8s-0\" (UID: \"caea3587-84a9-45bf-ac03-b7b0e70315e4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.249702 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.249673 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:48.257240 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.257212 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:48.418833 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.416534 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 21:00:48.419623 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:00:48.419593 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaea3587_84a9_45bf_ac03_b7b0e70315e4.slice/crio-43143cb336338b9aba6e14cb0ef9ed1faee6390c3d50c9cd473125f32c0b7ef0 WatchSource:0}: Error finding container 43143cb336338b9aba6e14cb0ef9ed1faee6390c3d50c9cd473125f32c0b7ef0: Status 404 returned error can't find the container with id 43143cb336338b9aba6e14cb0ef9ed1faee6390c3d50c9cd473125f32c0b7ef0 Jul 23 21:00:48.591666 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.591633 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rp65r" event={"ID":"69121ee2-87c5-4d30-9c8d-36d216bf259e","Type":"ContainerStarted","Data":"9ba0c0b5617eeebbb4c8ab9a6492be1c290709a514d67a1c173bf4b8ba20cea0"} Jul 23 21:00:48.593559 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.593532 2575 generic.go:356] "Generic (PLEG): container finished" podID="caea3587-84a9-45bf-ac03-b7b0e70315e4" containerID="18463c0fd9f15db4c0ced2dd68ab8ef58fa44a793f374f97951eb90f80c769cb" exitCode=0 Jul 23 21:00:48.593746 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.593635 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caea3587-84a9-45bf-ac03-b7b0e70315e4","Type":"ContainerDied","Data":"18463c0fd9f15db4c0ced2dd68ab8ef58fa44a793f374f97951eb90f80c769cb"} Jul 23 21:00:48.593746 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.593703 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caea3587-84a9-45bf-ac03-b7b0e70315e4","Type":"ContainerStarted","Data":"43143cb336338b9aba6e14cb0ef9ed1faee6390c3d50c9cd473125f32c0b7ef0"} Jul 23 21:00:48.598758 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.598732 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" event={"ID":"760c8194-715d-4d30-b590-275c2f457a8a","Type":"ContainerStarted","Data":"760159eef33f4839011b408d46489ab625dea6e27655da5a5d0a3a04134f8ff8"} Jul 23 21:00:48.598848 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.598804 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" event={"ID":"760c8194-715d-4d30-b590-275c2f457a8a","Type":"ContainerStarted","Data":"5ed4afa438961a703553b81085e6dca7bd64c494ba3dc31103db6171c407c911"} Jul 23 21:00:48.599000 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.598985 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" Jul 23 21:00:48.603235 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.602910 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"998be41c-d4c6-475f-a6e1-ecc5d2091633","Type":"ContainerStarted","Data":"429d001fef93fe40d731e635820c341120902f00f4120b4378d2b1d89745d039"} Jul 23 21:00:48.604511 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.604480 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" event={"ID":"d25481e8-e46e-4575-8c72-a127394fbda3","Type":"ContainerStarted","Data":"b44e9ef20c719b910efe5670c8622ed236bbee9d0873bab73cce44b4d22ee03b"} Jul 23 21:00:48.642452 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.642391 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.700271362 podStartE2EDuration="6.642368789s" totalImagesPullingTime="2.927362116s" totalInitContainerRuntime="14.735311ms" isStatefulPod=false podCreationTimestamp="2026-07-23 21:00:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:00:48.6405087 +0000 UTC m=+86.202942688" watchObservedRunningTime="2026-07-23 21:00:48.642368789 +0000 UTC m=+86.204802755" Jul 23 21:00:48.664358 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.661927 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" podStartSLOduration=2.521185896 podStartE2EDuration="5.66190519s" totalImagesPullingTime="3.140719294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:00:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:00:48.659723667 +0000 UTC m=+86.222157690" watchObservedRunningTime="2026-07-23 21:00:48.66190519 +0000 UTC m=+86.224339176" Jul 23 21:00:48.681435 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:48.681382 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" podStartSLOduration=1.014146949 podStartE2EDuration="2.681359871s" totalImagesPullingTime="1.667212922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:00:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:00:48.679481035 +0000 UTC m=+86.241915021" watchObservedRunningTime="2026-07-23 21:00:48.681359871 +0000 UTC m=+86.243793858" Jul 23 21:00:49.535413 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:49.535380 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:49.611001 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:49.610896 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rp65r" event={"ID":"69121ee2-87c5-4d30-9c8d-36d216bf259e","Type":"ContainerStarted","Data":"4c0aac0b1dbf86e9118f7e74351912a7d72e5137849b7a9d4319be3376d66536"} Jul 23 21:00:49.634632 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:49.634569 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rp65r" podStartSLOduration=2.005088882 podStartE2EDuration="3.634548065s" totalImagesPullingTime="1.629459183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:00:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:00:49.631731296 +0000 UTC m=+87.194165285" watchObservedRunningTime="2026-07-23 21:00:49.634548065 +0000 UTC m=+87.196982054" Jul 23 21:00:50.615422 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:50.615387 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rp65r" Jul 23 21:00:50.620543 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:50.620516 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rp65r" Jul 23 21:00:52.052240 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:52.052086 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:52.157072 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:52.156889 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:52.627204 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:52.627171 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caea3587-84a9-45bf-ac03-b7b0e70315e4","Type":"ContainerStarted","Data":"4a445547b89a05985e41f916e74ee4c0ed568144fa4b337859cc8f5cff097b83"} Jul 23 21:00:52.627371 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:52.627235 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caea3587-84a9-45bf-ac03-b7b0e70315e4","Type":"ContainerStarted","Data":"d12a92994edb40d7c6691e99227b59be689b869f6717b183db01627ee927cbc5"} Jul 23 21:00:52.627371 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:52.627265 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caea3587-84a9-45bf-ac03-b7b0e70315e4","Type":"ContainerStarted","Data":"133fc81971ba986801b9c54bfc4bee81ab0a561e1ba54686ddce9a72cef1c9f7"} Jul 23 21:00:52.627371 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:52.627295 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caea3587-84a9-45bf-ac03-b7b0e70315e4","Type":"ContainerStarted","Data":"ad91cc5ad4a8a18a9c072423cba7322483bacf20c0ba243f384b225fc293d27b"} Jul 23 21:00:52.627371 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:52.627320 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caea3587-84a9-45bf-ac03-b7b0e70315e4","Type":"ContainerStarted","Data":"6073fd89e57987fe489aa8c92c2f68034b6af83b61bd275bd34381d34ee0a737"} Jul 23 21:00:52.627371 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:52.627352 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caea3587-84a9-45bf-ac03-b7b0e70315e4","Type":"ContainerStarted","Data":"10a54046f7c69783e67e0595500a36fd05272f54e0cf2ef241a64cf1a077fd4a"} Jul 23 21:00:52.663066 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:52.663004 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.433566596 podStartE2EDuration="5.662984117s" totalImagesPullingTime="3.206122678s" totalInitContainerRuntime="23.294843ms" isStatefulPod=false podCreationTimestamp="2026-07-23 21:00:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:00:52.657512458 +0000 UTC m=+90.219946440" watchObservedRunningTime="2026-07-23 21:00:52.662984117 +0000 UTC m=+90.225418104" Jul 23 21:00:53.258081 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:53.258046 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:00:54.616720 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:54.616691 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-86b5585fff-nr566" Jul 23 21:00:56.811049 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:56.811008 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:00:56.811441 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:56.811064 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:00:56.815720 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:56.815699 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:00:57.652125 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:57.652095 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:00:57.700008 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:57.699970 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f84cddd8d-g5kdn"] Jul 23 21:00:57.803151 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:57.803098 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:57.910295 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:57.910217 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:00:58.003519 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:00:58.003487 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:01:01.077144 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:01.077107 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:01:01.177879 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:01.177828 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:01:06.404714 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:06.404677 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" Jul 23 21:01:06.405111 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:06.404739 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" Jul 23 21:01:07.498128 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:07.498093 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-v2gxq" Jul 23 21:01:08.563768 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:08.563702 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65d87bb58b-68jmk" podUID="a2e122f0-3b29-42ff-ab75-25cf939aa0d0" containerName="console" containerID="cri-o://4e839aa672d185b79fb3f28ec94f5b5b16cf93b23af59a8197c37d85267eef9e" gracePeriod=15 Jul 23 21:01:09.347323 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:09.347298 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d87bb58b-68jmk" Jul 23 21:01:09.406243 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:09.406215 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-service-ca\") pod \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\" (UID: \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\") " Jul 23 21:01:09.406414 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:09.406269 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-console-oauth-config\") pod \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\" (UID: \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\") " Jul 23 21:01:09.406414 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:09.406289 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-console-config\") pod \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\" (UID: \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\") " Jul 23 21:01:09.406414 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:09.406318 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckht9\" (UniqueName: \"kubernetes.io/projected/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-kube-api-access-ckht9\") pod \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\" (UID: \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\") " Jul 23 21:01:09.406414 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:09.406361 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-console-serving-cert\") pod \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\" (UID: \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\") " Jul 23 21:01:09.406414 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:09.406414 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-oauth-serving-cert\") pod \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\" (UID: \"a2e122f0-3b29-42ff-ab75-25cf939aa0d0\") " Jul 23 21:01:09.406685 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:09.406659 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-service-ca" (OuterVolumeSpecName: "service-ca") pod "a2e122f0-3b29-42ff-ab75-25cf939aa0d0" (UID: "a2e122f0-3b29-42ff-ab75-25cf939aa0d0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:01:09.406914 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:09.406881 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-console-config" (OuterVolumeSpecName: "console-config") pod "a2e122f0-3b29-42ff-ab75-25cf939aa0d0" (UID: "a2e122f0-3b29-42ff-ab75-25cf939aa0d0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:01:09.407045 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:09.406929 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a2e122f0-3b29-42ff-ab75-25cf939aa0d0" (UID: "a2e122f0-3b29-42ff-ab75-25cf939aa0d0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:01:09.408761 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:09.408733 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a2e122f0-3b29-42ff-ab75-25cf939aa0d0" (UID: "a2e122f0-3b29-42ff-ab75-25cf939aa0d0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:01:09.408850 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:09.408770 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a2e122f0-3b29-42ff-ab75-25cf939aa0d0" (UID: "a2e122f0-3b29-42ff-ab75-25cf939aa0d0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:01:09.408850 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:09.408765 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-kube-api-access-ckht9" (OuterVolumeSpecName: "kube-api-access-ckht9") pod "a2e122f0-3b29-42ff-ab75-25cf939aa0d0" (UID: "a2e122f0-3b29-42ff-ab75-25cf939aa0d0"). InnerVolumeSpecName "kube-api-access-ckht9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:01:09.507298 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:09.507211 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckht9\" (UniqueName: \"kubernetes.io/projected/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-kube-api-access-ckht9\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:01:09.507298 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:09.507245 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-console-serving-cert\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:01:09.507298 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:09.507254 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-oauth-serving-cert\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:01:09.507298 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:09.507264 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-service-ca\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:01:09.507298 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:09.507273 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-console-oauth-config\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:01:09.507298 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:09.507281 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2e122f0-3b29-42ff-ab75-25cf939aa0d0-console-config\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:01:09.696772 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:09.696737 2575 generic.go:356] "Generic (PLEG): container finished" podID="a2e122f0-3b29-42ff-ab75-25cf939aa0d0" containerID="4e839aa672d185b79fb3f28ec94f5b5b16cf93b23af59a8197c37d85267eef9e" exitCode=0 Jul 23 21:01:09.697168 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:09.696783 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d87bb58b-68jmk" Jul 23 21:01:09.697168 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:09.696820 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d87bb58b-68jmk" event={"ID":"a2e122f0-3b29-42ff-ab75-25cf939aa0d0","Type":"ContainerDied","Data":"4e839aa672d185b79fb3f28ec94f5b5b16cf93b23af59a8197c37d85267eef9e"} Jul 23 21:01:09.697168 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:09.696885 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d87bb58b-68jmk" event={"ID":"a2e122f0-3b29-42ff-ab75-25cf939aa0d0","Type":"ContainerDied","Data":"b0374d2dca24ddbb434c7313620867eb91f4b63e54c24bd264432d76324e0295"} Jul 23 21:01:09.697168 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:09.696912 2575 scope.go:117] "RemoveContainer" containerID="4e839aa672d185b79fb3f28ec94f5b5b16cf93b23af59a8197c37d85267eef9e" Jul 23 21:01:09.706189 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:09.706174 2575 scope.go:117] "RemoveContainer" containerID="4e839aa672d185b79fb3f28ec94f5b5b16cf93b23af59a8197c37d85267eef9e" Jul 23 21:01:09.706444 ip-10-0-139-105 kubenswrapper[2575]: E0723 21:01:09.706424 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e839aa672d185b79fb3f28ec94f5b5b16cf93b23af59a8197c37d85267eef9e\": container with ID starting with 4e839aa672d185b79fb3f28ec94f5b5b16cf93b23af59a8197c37d85267eef9e not found: ID does not exist" containerID="4e839aa672d185b79fb3f28ec94f5b5b16cf93b23af59a8197c37d85267eef9e" Jul 23 21:01:09.706490 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:09.706452 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e839aa672d185b79fb3f28ec94f5b5b16cf93b23af59a8197c37d85267eef9e"} err="failed to get container status \"4e839aa672d185b79fb3f28ec94f5b5b16cf93b23af59a8197c37d85267eef9e\": rpc error: code = NotFound desc = could not find container \"4e839aa672d185b79fb3f28ec94f5b5b16cf93b23af59a8197c37d85267eef9e\": container with ID starting with 4e839aa672d185b79fb3f28ec94f5b5b16cf93b23af59a8197c37d85267eef9e not found: ID does not exist" Jul 23 21:01:09.716644 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:09.716614 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65d87bb58b-68jmk"] Jul 23 21:01:09.725057 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:09.725032 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65d87bb58b-68jmk"] Jul 23 21:01:10.963244 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:10.963210 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2e122f0-3b29-42ff-ab75-25cf939aa0d0" path="/var/lib/kubelet/pods/a2e122f0-3b29-42ff-ab75-25cf939aa0d0/volumes" Jul 23 21:01:16.077356 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:16.077314 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:01:16.177546 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:16.177511 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:01:22.722520 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:22.722448 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f84cddd8d-g5kdn" podUID="cb0a9a49-34c1-4ee9-b68c-80cb71b5234d" containerName="console" containerID="cri-o://087df76f84028d9834722130ff6115826e6766b322d4d212c6d57cd72497fb6d" gracePeriod=15 Jul 23 21:01:23.010500 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.010106 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:01:23.134744 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.134712 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-service-ca\") pod \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\" (UID: \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\") " Jul 23 21:01:23.134971 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.134763 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-console-serving-cert\") pod \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\" (UID: \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\") " Jul 23 21:01:23.134971 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.134800 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjc6q\" (UniqueName: \"kubernetes.io/projected/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-kube-api-access-sjc6q\") pod \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\" (UID: \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\") " Jul 23 21:01:23.134971 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.134883 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-console-oauth-config\") pod \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\" (UID: \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\") " Jul 23 21:01:23.134971 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.134920 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-console-config\") pod \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\" (UID: \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\") " Jul 23 21:01:23.134971 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.134962 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-trusted-ca-bundle\") pod \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\" (UID: \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\") " Jul 23 21:01:23.135236 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.135040 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-oauth-serving-cert\") pod \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\" (UID: \"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d\") " Jul 23 21:01:23.135236 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.135162 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-service-ca" (OuterVolumeSpecName: "service-ca") pod "cb0a9a49-34c1-4ee9-b68c-80cb71b5234d" (UID: "cb0a9a49-34c1-4ee9-b68c-80cb71b5234d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:01:23.135339 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.135306 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cb0a9a49-34c1-4ee9-b68c-80cb71b5234d" (UID: "cb0a9a49-34c1-4ee9-b68c-80cb71b5234d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:01:23.135392 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.135330 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-console-config" (OuterVolumeSpecName: "console-config") pod "cb0a9a49-34c1-4ee9-b68c-80cb71b5234d" (UID: "cb0a9a49-34c1-4ee9-b68c-80cb71b5234d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:01:23.135392 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.135341 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-service-ca\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:01:23.135493 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.135476 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cb0a9a49-34c1-4ee9-b68c-80cb71b5234d" (UID: "cb0a9a49-34c1-4ee9-b68c-80cb71b5234d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:01:23.137193 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.137170 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cb0a9a49-34c1-4ee9-b68c-80cb71b5234d" (UID: "cb0a9a49-34c1-4ee9-b68c-80cb71b5234d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:01:23.137304 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.137222 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-kube-api-access-sjc6q" (OuterVolumeSpecName: "kube-api-access-sjc6q") pod "cb0a9a49-34c1-4ee9-b68c-80cb71b5234d" (UID: "cb0a9a49-34c1-4ee9-b68c-80cb71b5234d"). InnerVolumeSpecName "kube-api-access-sjc6q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:01:23.137304 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.137237 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cb0a9a49-34c1-4ee9-b68c-80cb71b5234d" (UID: "cb0a9a49-34c1-4ee9-b68c-80cb71b5234d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:01:23.237023 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.236914 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-console-serving-cert\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:01:23.237023 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.236949 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjc6q\" (UniqueName: \"kubernetes.io/projected/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-kube-api-access-sjc6q\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:01:23.237023 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.236962 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-console-oauth-config\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:01:23.237023 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.236974 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-console-config\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:01:23.237023 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.236987 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-trusted-ca-bundle\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:01:23.237023 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.236998 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d-oauth-serving-cert\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:01:23.762569 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.762530 2575 generic.go:356] "Generic (PLEG): container finished" podID="cb0a9a49-34c1-4ee9-b68c-80cb71b5234d" containerID="087df76f84028d9834722130ff6115826e6766b322d4d212c6d57cd72497fb6d" exitCode=0 Jul 23 21:01:23.763030 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.762594 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f84cddd8d-g5kdn" event={"ID":"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d","Type":"ContainerDied","Data":"087df76f84028d9834722130ff6115826e6766b322d4d212c6d57cd72497fb6d"} Jul 23 21:01:23.763030 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.762598 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f84cddd8d-g5kdn" Jul 23 21:01:23.763030 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.762648 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f84cddd8d-g5kdn" event={"ID":"cb0a9a49-34c1-4ee9-b68c-80cb71b5234d","Type":"ContainerDied","Data":"08739dfa89051769c045e3a0615f13cb81aa7b4485881187924a29dc706b0666"} Jul 23 21:01:23.763030 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.762679 2575 scope.go:117] "RemoveContainer" containerID="087df76f84028d9834722130ff6115826e6766b322d4d212c6d57cd72497fb6d" Jul 23 21:01:23.776693 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.776675 2575 scope.go:117] "RemoveContainer" containerID="087df76f84028d9834722130ff6115826e6766b322d4d212c6d57cd72497fb6d" Jul 23 21:01:23.777005 ip-10-0-139-105 kubenswrapper[2575]: E0723 21:01:23.776984 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"087df76f84028d9834722130ff6115826e6766b322d4d212c6d57cd72497fb6d\": container with ID starting with 087df76f84028d9834722130ff6115826e6766b322d4d212c6d57cd72497fb6d not found: ID does not exist" containerID="087df76f84028d9834722130ff6115826e6766b322d4d212c6d57cd72497fb6d" Jul 23 21:01:23.777070 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.777017 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"087df76f84028d9834722130ff6115826e6766b322d4d212c6d57cd72497fb6d"} err="failed to get container status \"087df76f84028d9834722130ff6115826e6766b322d4d212c6d57cd72497fb6d\": rpc error: code = NotFound desc = could not find container \"087df76f84028d9834722130ff6115826e6766b322d4d212c6d57cd72497fb6d\": container with ID starting with 087df76f84028d9834722130ff6115826e6766b322d4d212c6d57cd72497fb6d not found: ID does not exist" Jul 23 21:01:23.789293 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.789261 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f84cddd8d-g5kdn"] Jul 23 21:01:23.793933 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:23.793900 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f84cddd8d-g5kdn"] Jul 23 21:01:24.962034 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:24.961998 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb0a9a49-34c1-4ee9-b68c-80cb71b5234d" path="/var/lib/kubelet/pods/cb0a9a49-34c1-4ee9-b68c-80cb71b5234d/volumes" Jul 23 21:01:26.410254 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:26.410222 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" Jul 23 21:01:26.414230 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:26.414207 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-588596fc7-s4mbs" Jul 23 21:01:48.258007 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:48.257967 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:01:48.277740 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:48.277712 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:01:48.880541 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:01:48.880516 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:02:00.944658 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:00.944618 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:02:01.396937 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:01.396902 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:02:06.034525 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.034474 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr"] Jul 23 21:02:06.034983 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.034935 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2e122f0-3b29-42ff-ab75-25cf939aa0d0" containerName="console" Jul 23 21:02:06.034983 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.034951 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2e122f0-3b29-42ff-ab75-25cf939aa0d0" containerName="console" Jul 23 21:02:06.034983 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.034962 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb0a9a49-34c1-4ee9-b68c-80cb71b5234d" containerName="console" Jul 23 21:02:06.034983 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.034967 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb0a9a49-34c1-4ee9-b68c-80cb71b5234d" containerName="console" Jul 23 21:02:06.035110 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.035023 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2e122f0-3b29-42ff-ab75-25cf939aa0d0" containerName="console" Jul 23 21:02:06.035110 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.035033 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb0a9a49-34c1-4ee9-b68c-80cb71b5234d" containerName="console" Jul 23 21:02:06.038348 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.038327 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" Jul 23 21:02:06.040742 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.040714 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 23 21:02:06.041015 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.040990 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 23 21:02:06.041138 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.041066 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 23 21:02:06.041209 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.041146 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-s4c9h\"" Jul 23 21:02:06.041266 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.041222 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 23 21:02:06.041714 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.041697 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 23 21:02:06.045022 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.045004 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 23 21:02:06.049565 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.049429 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr"] Jul 23 21:02:06.112034 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.111998 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/30fe405a-4de9-4bb9-afae-baadcb814267-federate-client-tls\") pod \"telemeter-client-d6b84f7cf-vwmcr\" (UID: \"30fe405a-4de9-4bb9-afae-baadcb814267\") " pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" Jul 23 21:02:06.112034 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.112035 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30fe405a-4de9-4bb9-afae-baadcb814267-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d6b84f7cf-vwmcr\" (UID: \"30fe405a-4de9-4bb9-afae-baadcb814267\") " pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" Jul 23 21:02:06.112234 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.112062 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30fe405a-4de9-4bb9-afae-baadcb814267-serving-certs-ca-bundle\") pod \"telemeter-client-d6b84f7cf-vwmcr\" (UID: \"30fe405a-4de9-4bb9-afae-baadcb814267\") " pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" Jul 23 21:02:06.112234 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.112154 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/30fe405a-4de9-4bb9-afae-baadcb814267-secret-telemeter-client\") pod \"telemeter-client-d6b84f7cf-vwmcr\" (UID: \"30fe405a-4de9-4bb9-afae-baadcb814267\") " pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" Jul 23 21:02:06.112234 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.112182 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30fe405a-4de9-4bb9-afae-baadcb814267-metrics-client-ca\") pod \"telemeter-client-d6b84f7cf-vwmcr\" (UID: \"30fe405a-4de9-4bb9-afae-baadcb814267\") " pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" Jul 23 21:02:06.112234 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.112215 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbvtz\" (UniqueName: \"kubernetes.io/projected/30fe405a-4de9-4bb9-afae-baadcb814267-kube-api-access-fbvtz\") pod \"telemeter-client-d6b84f7cf-vwmcr\" (UID: \"30fe405a-4de9-4bb9-afae-baadcb814267\") " pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" Jul 23 21:02:06.112360 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.112267 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/30fe405a-4de9-4bb9-afae-baadcb814267-telemeter-client-tls\") pod \"telemeter-client-d6b84f7cf-vwmcr\" (UID: \"30fe405a-4de9-4bb9-afae-baadcb814267\") " pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" Jul 23 21:02:06.112360 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.112296 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30fe405a-4de9-4bb9-afae-baadcb814267-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d6b84f7cf-vwmcr\" (UID: \"30fe405a-4de9-4bb9-afae-baadcb814267\") " pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" Jul 23 21:02:06.212972 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.212934 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/30fe405a-4de9-4bb9-afae-baadcb814267-secret-telemeter-client\") pod \"telemeter-client-d6b84f7cf-vwmcr\" (UID: \"30fe405a-4de9-4bb9-afae-baadcb814267\") " pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" Jul 23 21:02:06.212972 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.212976 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30fe405a-4de9-4bb9-afae-baadcb814267-metrics-client-ca\") pod \"telemeter-client-d6b84f7cf-vwmcr\" (UID: \"30fe405a-4de9-4bb9-afae-baadcb814267\") " pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" Jul 23 21:02:06.213336 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.213009 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbvtz\" (UniqueName: \"kubernetes.io/projected/30fe405a-4de9-4bb9-afae-baadcb814267-kube-api-access-fbvtz\") pod \"telemeter-client-d6b84f7cf-vwmcr\" (UID: \"30fe405a-4de9-4bb9-afae-baadcb814267\") " pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" Jul 23 21:02:06.213336 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.213030 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/30fe405a-4de9-4bb9-afae-baadcb814267-telemeter-client-tls\") pod \"telemeter-client-d6b84f7cf-vwmcr\" (UID: \"30fe405a-4de9-4bb9-afae-baadcb814267\") " pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" Jul 23 21:02:06.213336 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.213081 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30fe405a-4de9-4bb9-afae-baadcb814267-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d6b84f7cf-vwmcr\" (UID: \"30fe405a-4de9-4bb9-afae-baadcb814267\") " pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" Jul 23 21:02:06.213336 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.213133 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/30fe405a-4de9-4bb9-afae-baadcb814267-federate-client-tls\") pod \"telemeter-client-d6b84f7cf-vwmcr\" (UID: \"30fe405a-4de9-4bb9-afae-baadcb814267\") " pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" Jul 23 21:02:06.213336 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.213161 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30fe405a-4de9-4bb9-afae-baadcb814267-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d6b84f7cf-vwmcr\" (UID: \"30fe405a-4de9-4bb9-afae-baadcb814267\") " pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" Jul 23 21:02:06.213336 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.213197 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30fe405a-4de9-4bb9-afae-baadcb814267-serving-certs-ca-bundle\") pod \"telemeter-client-d6b84f7cf-vwmcr\" (UID: \"30fe405a-4de9-4bb9-afae-baadcb814267\") " pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" Jul 23 21:02:06.213844 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.213815 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30fe405a-4de9-4bb9-afae-baadcb814267-metrics-client-ca\") pod \"telemeter-client-d6b84f7cf-vwmcr\" (UID: \"30fe405a-4de9-4bb9-afae-baadcb814267\") " pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" Jul 23 21:02:06.213954 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.213841 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30fe405a-4de9-4bb9-afae-baadcb814267-serving-certs-ca-bundle\") pod \"telemeter-client-d6b84f7cf-vwmcr\" (UID: \"30fe405a-4de9-4bb9-afae-baadcb814267\") " pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" Jul 23 21:02:06.214294 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.214264 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30fe405a-4de9-4bb9-afae-baadcb814267-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d6b84f7cf-vwmcr\" (UID: \"30fe405a-4de9-4bb9-afae-baadcb814267\") " pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" Jul 23 21:02:06.215540 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.215515 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30fe405a-4de9-4bb9-afae-baadcb814267-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d6b84f7cf-vwmcr\" (UID: \"30fe405a-4de9-4bb9-afae-baadcb814267\") " pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" Jul 23 21:02:06.215737 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.215722 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/30fe405a-4de9-4bb9-afae-baadcb814267-federate-client-tls\") pod \"telemeter-client-d6b84f7cf-vwmcr\" (UID: \"30fe405a-4de9-4bb9-afae-baadcb814267\") " pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" Jul 23 21:02:06.215790 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.215771 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/30fe405a-4de9-4bb9-afae-baadcb814267-secret-telemeter-client\") pod \"telemeter-client-d6b84f7cf-vwmcr\" (UID: \"30fe405a-4de9-4bb9-afae-baadcb814267\") " pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" Jul 23 21:02:06.215830 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.215820 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/30fe405a-4de9-4bb9-afae-baadcb814267-telemeter-client-tls\") pod \"telemeter-client-d6b84f7cf-vwmcr\" (UID: \"30fe405a-4de9-4bb9-afae-baadcb814267\") " pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" Jul 23 21:02:06.220929 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.220910 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbvtz\" (UniqueName: \"kubernetes.io/projected/30fe405a-4de9-4bb9-afae-baadcb814267-kube-api-access-fbvtz\") pod \"telemeter-client-d6b84f7cf-vwmcr\" (UID: \"30fe405a-4de9-4bb9-afae-baadcb814267\") " pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" Jul 23 21:02:06.351119 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.351029 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" Jul 23 21:02:06.482885 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.482844 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr"] Jul 23 21:02:06.485334 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:02:06.485307 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30fe405a_4de9_4bb9_afae_baadcb814267.slice/crio-8f57fff0baeefce15512ba2846ae26c244eb3528320afb7cf943526387eaee31 WatchSource:0}: Error finding container 8f57fff0baeefce15512ba2846ae26c244eb3528320afb7cf943526387eaee31: Status 404 returned error can't find the container with id 8f57fff0baeefce15512ba2846ae26c244eb3528320afb7cf943526387eaee31 Jul 23 21:02:06.933201 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:06.933167 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" event={"ID":"30fe405a-4de9-4bb9-afae-baadcb814267","Type":"ContainerStarted","Data":"8f57fff0baeefce15512ba2846ae26c244eb3528320afb7cf943526387eaee31"} Jul 23 21:02:08.943838 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:08.943801 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" event={"ID":"30fe405a-4de9-4bb9-afae-baadcb814267","Type":"ContainerStarted","Data":"d58df2d5fa0e32e6c36b8f0278e78c391e0924d820f1828db0484ae367217ce0"} Jul 23 21:02:08.944247 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:08.943876 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" event={"ID":"30fe405a-4de9-4bb9-afae-baadcb814267","Type":"ContainerStarted","Data":"f5164271a701b51b593beb8fc64143f6a9e29f023d41316513aeac23e27eb7f4"} Jul 23 21:02:08.944247 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:08.943897 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" event={"ID":"30fe405a-4de9-4bb9-afae-baadcb814267","Type":"ContainerStarted","Data":"704ee17a981690bb16d88dd7faf90192748d0a829283d9d81e69299c8b2bf629"} Jul 23 21:02:08.968254 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:08.968192 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-d6b84f7cf-vwmcr" podStartSLOduration=1.153876081 podStartE2EDuration="2.968172694s" totalImagesPullingTime="1.814296613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:02:08.967260593 +0000 UTC m=+166.529694578" watchObservedRunningTime="2026-07-23 21:02:08.968172694 +0000 UTC m=+166.530606681" Jul 23 21:02:09.753527 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:09.753490 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bf579b7c7-6c8gt"] Jul 23 21:02:09.755783 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:09.755757 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:09.768792 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:09.768768 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bf579b7c7-6c8gt"] Jul 23 21:02:09.814327 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:09.814292 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:02:09.848512 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:09.848473 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-console-serving-cert\") pod \"console-bf579b7c7-6c8gt\" (UID: \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\") " pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:09.848512 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:09.848513 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-console-oauth-config\") pod \"console-bf579b7c7-6c8gt\" (UID: \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\") " pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:09.848715 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:09.848530 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-service-ca\") pod \"console-bf579b7c7-6c8gt\" (UID: \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\") " pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:09.848715 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:09.848547 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-trusted-ca-bundle\") pod \"console-bf579b7c7-6c8gt\" (UID: \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\") " pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:09.848715 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:09.848640 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxkp2\" (UniqueName: \"kubernetes.io/projected/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-kube-api-access-rxkp2\") pod \"console-bf579b7c7-6c8gt\" (UID: \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\") " pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:09.848715 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:09.848674 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-console-config\") pod \"console-bf579b7c7-6c8gt\" (UID: \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\") " pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:09.848841 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:09.848740 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-oauth-serving-cert\") pod \"console-bf579b7c7-6c8gt\" (UID: \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\") " pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:09.866273 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:09.866246 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:02:09.947423 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:09.947393 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:02:09.949261 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:09.949243 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-console-serving-cert\") pod \"console-bf579b7c7-6c8gt\" (UID: \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\") " pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:09.949312 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:09.949269 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-console-oauth-config\") pod \"console-bf579b7c7-6c8gt\" (UID: \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\") " pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:09.949312 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:09.949287 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-service-ca\") pod \"console-bf579b7c7-6c8gt\" (UID: \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\") " pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:09.949312 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:09.949301 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-trusted-ca-bundle\") pod \"console-bf579b7c7-6c8gt\" (UID: \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\") " pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:09.949452 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:09.949330 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxkp2\" (UniqueName: \"kubernetes.io/projected/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-kube-api-access-rxkp2\") pod \"console-bf579b7c7-6c8gt\" (UID: \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\") " pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:09.949452 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:09.949353 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-console-config\") pod \"console-bf579b7c7-6c8gt\" (UID: \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\") " pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:09.949452 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:09.949401 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-oauth-serving-cert\") pod \"console-bf579b7c7-6c8gt\" (UID: \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\") " pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:09.950197 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:09.950166 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-oauth-serving-cert\") pod \"console-bf579b7c7-6c8gt\" (UID: \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\") " pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:09.950306 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:09.950166 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-service-ca\") pod \"console-bf579b7c7-6c8gt\" (UID: \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\") " pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:09.950306 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:09.950269 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-trusted-ca-bundle\") pod \"console-bf579b7c7-6c8gt\" (UID: \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\") " pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:09.950306 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:09.950296 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-console-config\") pod \"console-bf579b7c7-6c8gt\" (UID: \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\") " pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:09.951719 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:09.951699 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-console-serving-cert\") pod \"console-bf579b7c7-6c8gt\" (UID: \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\") " pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:09.951796 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:09.951755 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-console-oauth-config\") pod \"console-bf579b7c7-6c8gt\" (UID: \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\") " pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:09.957938 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:09.957915 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxkp2\" (UniqueName: \"kubernetes.io/projected/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-kube-api-access-rxkp2\") pod \"console-bf579b7c7-6c8gt\" (UID: \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\") " pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:10.004553 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:10.004449 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:02:10.065561 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:10.065529 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:10.205407 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:10.205383 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bf579b7c7-6c8gt"] Jul 23 21:02:10.208131 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:02:10.208090 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64fb68cb_4133_4fb3_93f6_4bd2c343ea8e.slice/crio-be3da567e45f1ce80a880ac9b144dc4ac189ecb1e7428356357ec7969a38b8a8 WatchSource:0}: Error finding container be3da567e45f1ce80a880ac9b144dc4ac189ecb1e7428356357ec7969a38b8a8: Status 404 returned error can't find the container with id be3da567e45f1ce80a880ac9b144dc4ac189ecb1e7428356357ec7969a38b8a8 Jul 23 21:02:10.558396 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:10.558366 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:02:10.660317 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:10.660285 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:02:10.954264 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:10.954182 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bf579b7c7-6c8gt" event={"ID":"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e","Type":"ContainerStarted","Data":"4024be4be2c10ad809a0dd8712718a1c10ad94f5d0372020bbc32d421e436611"} Jul 23 21:02:10.954264 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:10.954237 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bf579b7c7-6c8gt" event={"ID":"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e","Type":"ContainerStarted","Data":"be3da567e45f1ce80a880ac9b144dc4ac189ecb1e7428356357ec7969a38b8a8"} Jul 23 21:02:10.973752 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:10.973709 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bf579b7c7-6c8gt" podStartSLOduration=1.973693369 podStartE2EDuration="1.973693369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:02:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:02:10.972977618 +0000 UTC m=+168.535411604" watchObservedRunningTime="2026-07-23 21:02:10.973693369 +0000 UTC m=+168.536127355" Jul 23 21:02:16.188804 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:16.188726 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:02:16.249268 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:16.249235 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:02:20.066041 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:20.065997 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:20.066041 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:20.066053 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:20.070751 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:20.070730 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:20.078489 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:20.078469 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:02:20.998732 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:20.998706 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:21.046978 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.046937 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65bf49986f-llnj9"] Jul 23 21:02:21.165458 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.165427 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fd88c5d5b-nbk6j"] Jul 23 21:02:21.167996 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.167979 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:02:21.178731 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.178707 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fd88c5d5b-nbk6j"] Jul 23 21:02:21.184360 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.184337 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:02:21.248263 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.248228 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:02:21.255436 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.255378 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb71af3a-e358-41cd-9cfa-7753dcccbeac-console-serving-cert\") pod \"console-fd88c5d5b-nbk6j\" (UID: \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\") " pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:02:21.255436 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.255407 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb71af3a-e358-41cd-9cfa-7753dcccbeac-console-oauth-config\") pod \"console-fd88c5d5b-nbk6j\" (UID: \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\") " pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:02:21.255436 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.255424 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb71af3a-e358-41cd-9cfa-7753dcccbeac-console-config\") pod \"console-fd88c5d5b-nbk6j\" (UID: \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\") " pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:02:21.255584 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.255505 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb71af3a-e358-41cd-9cfa-7753dcccbeac-oauth-serving-cert\") pod \"console-fd88c5d5b-nbk6j\" (UID: \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\") " pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:02:21.255584 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.255528 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5z7k\" (UniqueName: \"kubernetes.io/projected/bb71af3a-e358-41cd-9cfa-7753dcccbeac-kube-api-access-k5z7k\") pod \"console-fd88c5d5b-nbk6j\" (UID: \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\") " pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:02:21.255584 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.255574 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb71af3a-e358-41cd-9cfa-7753dcccbeac-trusted-ca-bundle\") pod \"console-fd88c5d5b-nbk6j\" (UID: \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\") " pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:02:21.255681 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.255638 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb71af3a-e358-41cd-9cfa-7753dcccbeac-service-ca\") pod \"console-fd88c5d5b-nbk6j\" (UID: \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\") " pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:02:21.356505 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.356467 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb71af3a-e358-41cd-9cfa-7753dcccbeac-oauth-serving-cert\") pod \"console-fd88c5d5b-nbk6j\" (UID: \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\") " pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:02:21.356505 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.356508 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5z7k\" (UniqueName: \"kubernetes.io/projected/bb71af3a-e358-41cd-9cfa-7753dcccbeac-kube-api-access-k5z7k\") pod \"console-fd88c5d5b-nbk6j\" (UID: \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\") " pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:02:21.356758 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.356545 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb71af3a-e358-41cd-9cfa-7753dcccbeac-trusted-ca-bundle\") pod \"console-fd88c5d5b-nbk6j\" (UID: \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\") " pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:02:21.356758 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.356596 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb71af3a-e358-41cd-9cfa-7753dcccbeac-service-ca\") pod \"console-fd88c5d5b-nbk6j\" (UID: \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\") " pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:02:21.356758 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.356648 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb71af3a-e358-41cd-9cfa-7753dcccbeac-console-serving-cert\") pod \"console-fd88c5d5b-nbk6j\" (UID: \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\") " pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:02:21.356758 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.356670 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb71af3a-e358-41cd-9cfa-7753dcccbeac-console-oauth-config\") pod \"console-fd88c5d5b-nbk6j\" (UID: \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\") " pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:02:21.356758 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.356691 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb71af3a-e358-41cd-9cfa-7753dcccbeac-console-config\") pod \"console-fd88c5d5b-nbk6j\" (UID: \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\") " pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:02:21.357313 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.357285 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb71af3a-e358-41cd-9cfa-7753dcccbeac-oauth-serving-cert\") pod \"console-fd88c5d5b-nbk6j\" (UID: \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\") " pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:02:21.357416 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.357353 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb71af3a-e358-41cd-9cfa-7753dcccbeac-service-ca\") pod \"console-fd88c5d5b-nbk6j\" (UID: \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\") " pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:02:21.357515 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.357495 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb71af3a-e358-41cd-9cfa-7753dcccbeac-trusted-ca-bundle\") pod \"console-fd88c5d5b-nbk6j\" (UID: \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\") " pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:02:21.357553 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.357504 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb71af3a-e358-41cd-9cfa-7753dcccbeac-console-config\") pod \"console-fd88c5d5b-nbk6j\" (UID: \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\") " pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:02:21.359255 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.359235 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb71af3a-e358-41cd-9cfa-7753dcccbeac-console-oauth-config\") pod \"console-fd88c5d5b-nbk6j\" (UID: \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\") " pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:02:21.359321 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.359260 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb71af3a-e358-41cd-9cfa-7753dcccbeac-console-serving-cert\") pod \"console-fd88c5d5b-nbk6j\" (UID: \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\") " pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:02:21.364101 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.364075 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5z7k\" (UniqueName: \"kubernetes.io/projected/bb71af3a-e358-41cd-9cfa-7753dcccbeac-kube-api-access-k5z7k\") pod \"console-fd88c5d5b-nbk6j\" (UID: \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\") " pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:02:21.479634 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.479586 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:02:21.492250 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.492217 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:02:21.552135 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.552089 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:02:21.617715 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:21.617691 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fd88c5d5b-nbk6j"] Jul 23 21:02:21.619749 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:02:21.619718 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb71af3a_e358_41cd_9cfa_7753dcccbeac.slice/crio-c3283f90c8eb95b9cea349473c18c646abdc655690ade876e6aba00748f848c9 WatchSource:0}: Error finding container c3283f90c8eb95b9cea349473c18c646abdc655690ade876e6aba00748f848c9: Status 404 returned error can't find the container with id c3283f90c8eb95b9cea349473c18c646abdc655690ade876e6aba00748f848c9 Jul 23 21:02:22.001169 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:22.001082 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fd88c5d5b-nbk6j" event={"ID":"bb71af3a-e358-41cd-9cfa-7753dcccbeac","Type":"ContainerStarted","Data":"e961c9c1581b6d48f3e067d11d977bad0a8acfe09c0bfd28f0de6dc292b4a9f8"} Jul 23 21:02:22.001169 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:22.001140 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fd88c5d5b-nbk6j" event={"ID":"bb71af3a-e358-41cd-9cfa-7753dcccbeac","Type":"ContainerStarted","Data":"c3283f90c8eb95b9cea349473c18c646abdc655690ade876e6aba00748f848c9"} Jul 23 21:02:22.019894 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:22.019827 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fd88c5d5b-nbk6j" podStartSLOduration=1.019811407 podStartE2EDuration="1.019811407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:02:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:02:22.017673734 +0000 UTC m=+179.580107711" watchObservedRunningTime="2026-07-23 21:02:22.019811407 +0000 UTC m=+179.582245393" Jul 23 21:02:22.092705 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:22.092667 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:02:23.092018 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:23.091928 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:02:23.148040 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:23.148009 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:02:28.142172 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:28.142137 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:02:28.201318 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:28.201285 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:02:31.076422 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:31.076389 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:02:31.176908 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:31.176853 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:02:31.480523 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:31.480436 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:02:31.480523 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:31.480494 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:02:31.485622 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:31.485595 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:02:32.047210 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:32.047181 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:02:32.094476 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:32.094445 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bf579b7c7-6c8gt"] Jul 23 21:02:32.211879 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:32.211840 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:02:32.303964 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:32.303837 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:02:32.357482 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:32.357449 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:02:41.200790 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:41.200718 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:02:41.302877 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:41.302835 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:02:46.070998 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:46.070931 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65bf49986f-llnj9" podUID="c7eee33b-12ca-4f04-8da1-2c4fe09916f9" containerName="console" containerID="cri-o://188c39118d262a867a8ce8ec0205d01402da688ab3166afb4af3fe5de309b6b0" gracePeriod=15 Jul 23 21:02:46.306180 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:46.306151 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:02:46.384755 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:46.384664 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hkcg\" (UniqueName: \"kubernetes.io/projected/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-kube-api-access-8hkcg\") pod \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\" (UID: \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\") " Jul 23 21:02:46.384755 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:46.384706 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-console-config\") pod \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\" (UID: \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\") " Jul 23 21:02:46.384755 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:46.384726 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-service-ca\") pod \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\" (UID: \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\") " Jul 23 21:02:46.385146 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:46.384763 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-console-oauth-config\") pod \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\" (UID: \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\") " Jul 23 21:02:46.385146 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:46.384947 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-oauth-serving-cert\") pod \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\" (UID: \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\") " Jul 23 21:02:46.385146 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:46.385043 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-trusted-ca-bundle\") pod \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\" (UID: \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\") " Jul 23 21:02:46.385146 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:46.385074 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-console-serving-cert\") pod \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\" (UID: \"c7eee33b-12ca-4f04-8da1-2c4fe09916f9\") " Jul 23 21:02:46.385355 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:46.385190 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-service-ca" (OuterVolumeSpecName: "service-ca") pod "c7eee33b-12ca-4f04-8da1-2c4fe09916f9" (UID: "c7eee33b-12ca-4f04-8da1-2c4fe09916f9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:02:46.385355 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:46.385320 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-console-config" (OuterVolumeSpecName: "console-config") pod "c7eee33b-12ca-4f04-8da1-2c4fe09916f9" (UID: "c7eee33b-12ca-4f04-8da1-2c4fe09916f9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:02:46.385462 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:46.385372 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c7eee33b-12ca-4f04-8da1-2c4fe09916f9" (UID: "c7eee33b-12ca-4f04-8da1-2c4fe09916f9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:02:46.385462 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:46.385436 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c7eee33b-12ca-4f04-8da1-2c4fe09916f9" (UID: "c7eee33b-12ca-4f04-8da1-2c4fe09916f9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:02:46.385575 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:46.385484 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-console-config\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:02:46.385575 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:46.385497 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-service-ca\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:02:46.385575 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:46.385505 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-oauth-serving-cert\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:02:46.386957 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:46.386921 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c7eee33b-12ca-4f04-8da1-2c4fe09916f9" (UID: "c7eee33b-12ca-4f04-8da1-2c4fe09916f9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:02:46.387110 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:46.387091 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-kube-api-access-8hkcg" (OuterVolumeSpecName: "kube-api-access-8hkcg") pod "c7eee33b-12ca-4f04-8da1-2c4fe09916f9" (UID: "c7eee33b-12ca-4f04-8da1-2c4fe09916f9"). InnerVolumeSpecName "kube-api-access-8hkcg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:02:46.387179 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:46.387137 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c7eee33b-12ca-4f04-8da1-2c4fe09916f9" (UID: "c7eee33b-12ca-4f04-8da1-2c4fe09916f9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:02:46.486063 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:46.486030 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hkcg\" (UniqueName: \"kubernetes.io/projected/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-kube-api-access-8hkcg\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:02:46.486063 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:46.486058 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-console-oauth-config\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:02:46.486063 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:46.486071 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-trusted-ca-bundle\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:02:46.486290 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:46.486083 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7eee33b-12ca-4f04-8da1-2c4fe09916f9-console-serving-cert\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:02:47.114103 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:47.114067 2575 generic.go:356] "Generic (PLEG): container finished" podID="c7eee33b-12ca-4f04-8da1-2c4fe09916f9" containerID="188c39118d262a867a8ce8ec0205d01402da688ab3166afb4af3fe5de309b6b0" exitCode=0 Jul 23 21:02:47.114515 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:47.114110 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65bf49986f-llnj9" Jul 23 21:02:47.114515 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:47.114149 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65bf49986f-llnj9" event={"ID":"c7eee33b-12ca-4f04-8da1-2c4fe09916f9","Type":"ContainerDied","Data":"188c39118d262a867a8ce8ec0205d01402da688ab3166afb4af3fe5de309b6b0"} Jul 23 21:02:47.114515 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:47.114195 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65bf49986f-llnj9" event={"ID":"c7eee33b-12ca-4f04-8da1-2c4fe09916f9","Type":"ContainerDied","Data":"11fe1a413832f2144b0d08ddd19e4dcf26ba36c30f433eee1e00bae719d0f10d"} Jul 23 21:02:47.114515 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:47.114214 2575 scope.go:117] "RemoveContainer" containerID="188c39118d262a867a8ce8ec0205d01402da688ab3166afb4af3fe5de309b6b0" Jul 23 21:02:47.124952 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:47.124931 2575 scope.go:117] "RemoveContainer" containerID="188c39118d262a867a8ce8ec0205d01402da688ab3166afb4af3fe5de309b6b0" Jul 23 21:02:47.125299 ip-10-0-139-105 kubenswrapper[2575]: E0723 21:02:47.125274 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"188c39118d262a867a8ce8ec0205d01402da688ab3166afb4af3fe5de309b6b0\": container with ID starting with 188c39118d262a867a8ce8ec0205d01402da688ab3166afb4af3fe5de309b6b0 not found: ID does not exist" containerID="188c39118d262a867a8ce8ec0205d01402da688ab3166afb4af3fe5de309b6b0" Jul 23 21:02:47.125409 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:47.125312 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"188c39118d262a867a8ce8ec0205d01402da688ab3166afb4af3fe5de309b6b0"} err="failed to get container status \"188c39118d262a867a8ce8ec0205d01402da688ab3166afb4af3fe5de309b6b0\": rpc error: code = NotFound desc = could not find container \"188c39118d262a867a8ce8ec0205d01402da688ab3166afb4af3fe5de309b6b0\": container with ID starting with 188c39118d262a867a8ce8ec0205d01402da688ab3166afb4af3fe5de309b6b0 not found: ID does not exist" Jul 23 21:02:47.130056 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:47.130033 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65bf49986f-llnj9"] Jul 23 21:02:47.135697 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:47.135672 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65bf49986f-llnj9"] Jul 23 21:02:48.962398 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:48.962364 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7eee33b-12ca-4f04-8da1-2c4fe09916f9" path="/var/lib/kubelet/pods/c7eee33b-12ca-4f04-8da1-2c4fe09916f9/volumes" Jul 23 21:02:57.116631 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:57.116561 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-bf579b7c7-6c8gt" podUID="64fb68cb-4133-4fb3-93f6-4bd2c343ea8e" containerName="console" containerID="cri-o://4024be4be2c10ad809a0dd8712718a1c10ad94f5d0372020bbc32d421e436611" gracePeriod=15 Jul 23 21:02:57.355112 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:57.355086 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:57.487827 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:57.487733 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-console-oauth-config\") pod \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\" (UID: \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\") " Jul 23 21:02:57.487827 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:57.487779 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-console-config\") pod \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\" (UID: \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\") " Jul 23 21:02:57.487827 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:57.487801 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-console-serving-cert\") pod \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\" (UID: \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\") " Jul 23 21:02:57.488092 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:57.487907 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-service-ca\") pod \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\" (UID: \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\") " Jul 23 21:02:57.488092 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:57.487945 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxkp2\" (UniqueName: \"kubernetes.io/projected/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-kube-api-access-rxkp2\") pod \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\" (UID: \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\") " Jul 23 21:02:57.488092 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:57.487986 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-trusted-ca-bundle\") pod \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\" (UID: \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\") " Jul 23 21:02:57.488092 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:57.488011 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-oauth-serving-cert\") pod \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\" (UID: \"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e\") " Jul 23 21:02:57.488276 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:57.488240 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-console-config" (OuterVolumeSpecName: "console-config") pod "64fb68cb-4133-4fb3-93f6-4bd2c343ea8e" (UID: "64fb68cb-4133-4fb3-93f6-4bd2c343ea8e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:02:57.488334 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:57.488268 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-service-ca" (OuterVolumeSpecName: "service-ca") pod "64fb68cb-4133-4fb3-93f6-4bd2c343ea8e" (UID: "64fb68cb-4133-4fb3-93f6-4bd2c343ea8e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:02:57.488504 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:57.488473 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "64fb68cb-4133-4fb3-93f6-4bd2c343ea8e" (UID: "64fb68cb-4133-4fb3-93f6-4bd2c343ea8e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:02:57.488504 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:57.488487 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "64fb68cb-4133-4fb3-93f6-4bd2c343ea8e" (UID: "64fb68cb-4133-4fb3-93f6-4bd2c343ea8e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:02:57.490035 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:57.490019 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "64fb68cb-4133-4fb3-93f6-4bd2c343ea8e" (UID: "64fb68cb-4133-4fb3-93f6-4bd2c343ea8e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:02:57.490397 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:57.490380 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-kube-api-access-rxkp2" (OuterVolumeSpecName: "kube-api-access-rxkp2") pod "64fb68cb-4133-4fb3-93f6-4bd2c343ea8e" (UID: "64fb68cb-4133-4fb3-93f6-4bd2c343ea8e"). InnerVolumeSpecName "kube-api-access-rxkp2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:02:57.490442 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:57.490393 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "64fb68cb-4133-4fb3-93f6-4bd2c343ea8e" (UID: "64fb68cb-4133-4fb3-93f6-4bd2c343ea8e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:02:57.589058 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:57.589009 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-console-config\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:02:57.589058 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:57.589050 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-console-serving-cert\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:02:57.589058 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:57.589060 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-service-ca\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:02:57.589058 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:57.589070 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxkp2\" (UniqueName: \"kubernetes.io/projected/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-kube-api-access-rxkp2\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:02:57.589058 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:57.589078 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-trusted-ca-bundle\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:02:57.589347 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:57.589087 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-oauth-serving-cert\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:02:57.589347 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:57.589095 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e-console-oauth-config\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:02:58.161422 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:58.161385 2575 generic.go:356] "Generic (PLEG): container finished" podID="64fb68cb-4133-4fb3-93f6-4bd2c343ea8e" containerID="4024be4be2c10ad809a0dd8712718a1c10ad94f5d0372020bbc32d421e436611" exitCode=0 Jul 23 21:02:58.161422 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:58.161424 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bf579b7c7-6c8gt" event={"ID":"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e","Type":"ContainerDied","Data":"4024be4be2c10ad809a0dd8712718a1c10ad94f5d0372020bbc32d421e436611"} Jul 23 21:02:58.161989 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:58.161460 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bf579b7c7-6c8gt" Jul 23 21:02:58.161989 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:58.161474 2575 scope.go:117] "RemoveContainer" containerID="4024be4be2c10ad809a0dd8712718a1c10ad94f5d0372020bbc32d421e436611" Jul 23 21:02:58.161989 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:58.161464 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bf579b7c7-6c8gt" event={"ID":"64fb68cb-4133-4fb3-93f6-4bd2c343ea8e","Type":"ContainerDied","Data":"be3da567e45f1ce80a880ac9b144dc4ac189ecb1e7428356357ec7969a38b8a8"} Jul 23 21:02:58.169754 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:58.169668 2575 scope.go:117] "RemoveContainer" containerID="4024be4be2c10ad809a0dd8712718a1c10ad94f5d0372020bbc32d421e436611" Jul 23 21:02:58.170151 ip-10-0-139-105 kubenswrapper[2575]: E0723 21:02:58.170130 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4024be4be2c10ad809a0dd8712718a1c10ad94f5d0372020bbc32d421e436611\": container with ID starting with 4024be4be2c10ad809a0dd8712718a1c10ad94f5d0372020bbc32d421e436611 not found: ID does not exist" containerID="4024be4be2c10ad809a0dd8712718a1c10ad94f5d0372020bbc32d421e436611" Jul 23 21:02:58.170234 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:58.170162 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4024be4be2c10ad809a0dd8712718a1c10ad94f5d0372020bbc32d421e436611"} err="failed to get container status \"4024be4be2c10ad809a0dd8712718a1c10ad94f5d0372020bbc32d421e436611\": rpc error: code = NotFound desc = could not find container \"4024be4be2c10ad809a0dd8712718a1c10ad94f5d0372020bbc32d421e436611\": container with ID starting with 4024be4be2c10ad809a0dd8712718a1c10ad94f5d0372020bbc32d421e436611 not found: ID does not exist" Jul 23 21:02:58.181973 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:58.181942 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bf579b7c7-6c8gt"] Jul 23 21:02:58.185376 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:58.185352 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bf579b7c7-6c8gt"] Jul 23 21:02:58.963427 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:02:58.963392 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64fb68cb-4133-4fb3-93f6-4bd2c343ea8e" path="/var/lib/kubelet/pods/64fb68cb-4133-4fb3-93f6-4bd2c343ea8e/volumes" Jul 23 21:03:07.326322 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:07.326281 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:03:07.417419 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:07.417378 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:03:34.329747 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:34.329702 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:03:35.167743 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:35.167713 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:03:37.907429 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:37.907398 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:03:38.007723 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:38.007687 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:03:43.297830 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:43.297795 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:03:43.389656 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:43.389620 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:03:43.661480 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:43.661399 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:03:43.794033 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:43.793999 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:03:43.932992 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:43.932917 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:03:46.080525 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:46.080451 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:03:46.277587 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:46.277550 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:03:50.426847 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:50.426815 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-54zc9"] Jul 23 21:03:50.427333 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:50.427152 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7eee33b-12ca-4f04-8da1-2c4fe09916f9" containerName="console" Jul 23 21:03:50.427333 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:50.427163 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7eee33b-12ca-4f04-8da1-2c4fe09916f9" containerName="console" Jul 23 21:03:50.427333 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:50.427178 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64fb68cb-4133-4fb3-93f6-4bd2c343ea8e" containerName="console" Jul 23 21:03:50.427333 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:50.427185 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="64fb68cb-4133-4fb3-93f6-4bd2c343ea8e" containerName="console" Jul 23 21:03:50.427333 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:50.427242 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="64fb68cb-4133-4fb3-93f6-4bd2c343ea8e" containerName="console" Jul 23 21:03:50.427333 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:50.427254 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7eee33b-12ca-4f04-8da1-2c4fe09916f9" containerName="console" Jul 23 21:03:50.429237 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:50.429219 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-54zc9" Jul 23 21:03:50.431422 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:50.431399 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 23 21:03:50.431524 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:50.431442 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-zzpgn\"" Jul 23 21:03:50.432250 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:50.432235 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 23 21:03:50.437527 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:50.437505 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-54zc9"] Jul 23 21:03:50.543189 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:50.543156 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glwj9\" (UniqueName: \"kubernetes.io/projected/a7f9aa29-c8af-4957-8a43-f9719a60d83f-kube-api-access-glwj9\") pod \"cert-manager-cainjector-559cdd8c87-54zc9\" (UID: \"a7f9aa29-c8af-4957-8a43-f9719a60d83f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-54zc9" Jul 23 21:03:50.543356 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:50.543290 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7f9aa29-c8af-4957-8a43-f9719a60d83f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-54zc9\" (UID: \"a7f9aa29-c8af-4957-8a43-f9719a60d83f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-54zc9" Jul 23 21:03:50.644052 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:50.644017 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7f9aa29-c8af-4957-8a43-f9719a60d83f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-54zc9\" (UID: \"a7f9aa29-c8af-4957-8a43-f9719a60d83f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-54zc9" Jul 23 21:03:50.644227 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:50.644064 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glwj9\" (UniqueName: \"kubernetes.io/projected/a7f9aa29-c8af-4957-8a43-f9719a60d83f-kube-api-access-glwj9\") pod \"cert-manager-cainjector-559cdd8c87-54zc9\" (UID: \"a7f9aa29-c8af-4957-8a43-f9719a60d83f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-54zc9" Jul 23 21:03:50.651828 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:50.651801 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7f9aa29-c8af-4957-8a43-f9719a60d83f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-54zc9\" (UID: \"a7f9aa29-c8af-4957-8a43-f9719a60d83f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-54zc9" Jul 23 21:03:50.651967 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:50.651833 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glwj9\" (UniqueName: \"kubernetes.io/projected/a7f9aa29-c8af-4957-8a43-f9719a60d83f-kube-api-access-glwj9\") pod \"cert-manager-cainjector-559cdd8c87-54zc9\" (UID: \"a7f9aa29-c8af-4957-8a43-f9719a60d83f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-54zc9" Jul 23 21:03:50.751197 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:50.751107 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-54zc9" Jul 23 21:03:50.877350 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:50.877325 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-54zc9"] Jul 23 21:03:50.880083 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:03:50.880060 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7f9aa29_c8af_4957_8a43_f9719a60d83f.slice/crio-d66672afd5c7d6572504d49b577aff010890b895a28091163a6bb203c003b735 WatchSource:0}: Error finding container d66672afd5c7d6572504d49b577aff010890b895a28091163a6bb203c003b735: Status 404 returned error can't find the container with id d66672afd5c7d6572504d49b577aff010890b895a28091163a6bb203c003b735 Jul 23 21:03:51.384558 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:51.384523 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-54zc9" event={"ID":"a7f9aa29-c8af-4957-8a43-f9719a60d83f","Type":"ContainerStarted","Data":"d66672afd5c7d6572504d49b577aff010890b895a28091163a6bb203c003b735"} Jul 23 21:03:53.870425 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:53.870370 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:03:54.007042 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:54.007011 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-f89sj"] Jul 23 21:03:54.010423 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:54.010401 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-f89sj" Jul 23 21:03:54.013027 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:54.013009 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-fx8cn\"" Jul 23 21:03:54.020694 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:54.020667 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-f89sj"] Jul 23 21:03:54.179770 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:54.179680 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9zlr\" (UniqueName: \"kubernetes.io/projected/72c927b2-c38d-4578-a436-726b67a02ab7-kube-api-access-p9zlr\") pod \"cert-manager-55b4d954d5-f89sj\" (UID: \"72c927b2-c38d-4578-a436-726b67a02ab7\") " pod="cert-manager/cert-manager-55b4d954d5-f89sj" Jul 23 21:03:54.179770 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:54.179736 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72c927b2-c38d-4578-a436-726b67a02ab7-bound-sa-token\") pod \"cert-manager-55b4d954d5-f89sj\" (UID: \"72c927b2-c38d-4578-a436-726b67a02ab7\") " pod="cert-manager/cert-manager-55b4d954d5-f89sj" Jul 23 21:03:54.281175 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:54.281133 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9zlr\" (UniqueName: \"kubernetes.io/projected/72c927b2-c38d-4578-a436-726b67a02ab7-kube-api-access-p9zlr\") pod \"cert-manager-55b4d954d5-f89sj\" (UID: \"72c927b2-c38d-4578-a436-726b67a02ab7\") " pod="cert-manager/cert-manager-55b4d954d5-f89sj" Jul 23 21:03:54.281353 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:54.281186 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72c927b2-c38d-4578-a436-726b67a02ab7-bound-sa-token\") pod \"cert-manager-55b4d954d5-f89sj\" (UID: \"72c927b2-c38d-4578-a436-726b67a02ab7\") " pod="cert-manager/cert-manager-55b4d954d5-f89sj" Jul 23 21:03:54.289444 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:54.289413 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72c927b2-c38d-4578-a436-726b67a02ab7-bound-sa-token\") pod \"cert-manager-55b4d954d5-f89sj\" (UID: \"72c927b2-c38d-4578-a436-726b67a02ab7\") " pod="cert-manager/cert-manager-55b4d954d5-f89sj" Jul 23 21:03:54.289617 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:54.289597 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9zlr\" (UniqueName: \"kubernetes.io/projected/72c927b2-c38d-4578-a436-726b67a02ab7-kube-api-access-p9zlr\") pod \"cert-manager-55b4d954d5-f89sj\" (UID: \"72c927b2-c38d-4578-a436-726b67a02ab7\") " pod="cert-manager/cert-manager-55b4d954d5-f89sj" Jul 23 21:03:54.319325 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:54.319297 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-f89sj" Jul 23 21:03:54.400657 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:54.400599 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-54zc9" event={"ID":"a7f9aa29-c8af-4957-8a43-f9719a60d83f","Type":"ContainerStarted","Data":"7e0c5863c6bd30ddbd1e117e360ce96a158abd4cd8ca8e502b3a80610f82430e"} Jul 23 21:03:54.417543 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:54.417483 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-54zc9" podStartSLOduration=1.3757119740000001 podStartE2EDuration="4.417462325s" totalImagesPullingTime="3.041750351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:03:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:03:54.415647801 +0000 UTC m=+271.978081787" watchObservedRunningTime="2026-07-23 21:03:54.417462325 +0000 UTC m=+271.979896338" Jul 23 21:03:54.457728 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:54.457582 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-f89sj"] Jul 23 21:03:54.461189 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:03:54.461158 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72c927b2_c38d_4578_a436_726b67a02ab7.slice/crio-9bc79d15960e3b9108ce80bb00a957c4db5d080bd965eeb727a76f6de3327ed6 WatchSource:0}: Error finding container 9bc79d15960e3b9108ce80bb00a957c4db5d080bd965eeb727a76f6de3327ed6: Status 404 returned error can't find the container with id 9bc79d15960e3b9108ce80bb00a957c4db5d080bd965eeb727a76f6de3327ed6 Jul 23 21:03:55.383338 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:55.383306 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:03:55.405728 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:55.405696 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-f89sj" event={"ID":"72c927b2-c38d-4578-a436-726b67a02ab7","Type":"ContainerStarted","Data":"1f0c28af235874c247387585422e6f20ac5b37ffa08e8a1f153a377cd06c3aac"} Jul 23 21:03:55.405893 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:55.405739 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-f89sj" event={"ID":"72c927b2-c38d-4578-a436-726b67a02ab7","Type":"ContainerStarted","Data":"9bc79d15960e3b9108ce80bb00a957c4db5d080bd965eeb727a76f6de3327ed6"} Jul 23 21:03:55.420997 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:03:55.420948 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-f89sj" podStartSLOduration=2.4209325059999998 podStartE2EDuration="2.420932506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:03:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:03:55.419773077 +0000 UTC m=+272.982207065" watchObservedRunningTime="2026-07-23 21:03:55.420932506 +0000 UTC m=+272.983366490" Jul 23 21:04:02.207775 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:02.207725 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:02.298561 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:02.298458 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:07.285893 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:07.285840 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:07.388034 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:07.388000 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:09.172955 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:09.172925 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:19.413071 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:19.413034 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:19.451841 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:19.451803 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-9f5c4b4f6-4p74n"] Jul 23 21:04:19.455788 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:19.455758 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9f5c4b4f6-4p74n" Jul 23 21:04:19.458610 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:19.458578 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xtjgj\"" Jul 23 21:04:19.458757 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:19.458702 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 23 21:04:19.459542 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:19.459521 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 23 21:04:19.459784 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:19.459749 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 23 21:04:19.459974 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:19.459749 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 23 21:04:19.460349 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:19.460316 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 23 21:04:19.466776 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:19.466751 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9f5c4b4f6-4p74n"] Jul 23 21:04:19.488579 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:19.488472 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:19.508949 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:19.508916 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5ad49517-c977-4b5a-81c7-804118ed9a11-manager-config\") pod \"lws-controller-manager-9f5c4b4f6-4p74n\" (UID: \"5ad49517-c977-4b5a-81c7-804118ed9a11\") " pod="openshift-lws-operator/lws-controller-manager-9f5c4b4f6-4p74n" Jul 23 21:04:19.509129 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:19.509055 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49cgm\" (UniqueName: \"kubernetes.io/projected/5ad49517-c977-4b5a-81c7-804118ed9a11-kube-api-access-49cgm\") pod \"lws-controller-manager-9f5c4b4f6-4p74n\" (UID: \"5ad49517-c977-4b5a-81c7-804118ed9a11\") " pod="openshift-lws-operator/lws-controller-manager-9f5c4b4f6-4p74n" Jul 23 21:04:19.509129 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:19.509096 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ad49517-c977-4b5a-81c7-804118ed9a11-cert\") pod \"lws-controller-manager-9f5c4b4f6-4p74n\" (UID: \"5ad49517-c977-4b5a-81c7-804118ed9a11\") " pod="openshift-lws-operator/lws-controller-manager-9f5c4b4f6-4p74n" Jul 23 21:04:19.509129 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:19.509113 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5ad49517-c977-4b5a-81c7-804118ed9a11-metrics-cert\") pod \"lws-controller-manager-9f5c4b4f6-4p74n\" (UID: \"5ad49517-c977-4b5a-81c7-804118ed9a11\") " pod="openshift-lws-operator/lws-controller-manager-9f5c4b4f6-4p74n" Jul 23 21:04:19.609841 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:19.609797 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5ad49517-c977-4b5a-81c7-804118ed9a11-metrics-cert\") pod \"lws-controller-manager-9f5c4b4f6-4p74n\" (UID: \"5ad49517-c977-4b5a-81c7-804118ed9a11\") " pod="openshift-lws-operator/lws-controller-manager-9f5c4b4f6-4p74n" Jul 23 21:04:19.610071 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:19.609903 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5ad49517-c977-4b5a-81c7-804118ed9a11-manager-config\") pod \"lws-controller-manager-9f5c4b4f6-4p74n\" (UID: \"5ad49517-c977-4b5a-81c7-804118ed9a11\") " pod="openshift-lws-operator/lws-controller-manager-9f5c4b4f6-4p74n" Jul 23 21:04:19.610071 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:19.609986 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49cgm\" (UniqueName: \"kubernetes.io/projected/5ad49517-c977-4b5a-81c7-804118ed9a11-kube-api-access-49cgm\") pod \"lws-controller-manager-9f5c4b4f6-4p74n\" (UID: \"5ad49517-c977-4b5a-81c7-804118ed9a11\") " pod="openshift-lws-operator/lws-controller-manager-9f5c4b4f6-4p74n" Jul 23 21:04:19.610071 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:19.610031 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ad49517-c977-4b5a-81c7-804118ed9a11-cert\") pod \"lws-controller-manager-9f5c4b4f6-4p74n\" (UID: \"5ad49517-c977-4b5a-81c7-804118ed9a11\") " pod="openshift-lws-operator/lws-controller-manager-9f5c4b4f6-4p74n" Jul 23 21:04:19.610678 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:19.610650 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5ad49517-c977-4b5a-81c7-804118ed9a11-manager-config\") pod \"lws-controller-manager-9f5c4b4f6-4p74n\" (UID: \"5ad49517-c977-4b5a-81c7-804118ed9a11\") " pod="openshift-lws-operator/lws-controller-manager-9f5c4b4f6-4p74n" Jul 23 21:04:19.612293 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:19.612259 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5ad49517-c977-4b5a-81c7-804118ed9a11-metrics-cert\") pod \"lws-controller-manager-9f5c4b4f6-4p74n\" (UID: \"5ad49517-c977-4b5a-81c7-804118ed9a11\") " pod="openshift-lws-operator/lws-controller-manager-9f5c4b4f6-4p74n" Jul 23 21:04:19.612397 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:19.612335 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ad49517-c977-4b5a-81c7-804118ed9a11-cert\") pod \"lws-controller-manager-9f5c4b4f6-4p74n\" (UID: \"5ad49517-c977-4b5a-81c7-804118ed9a11\") " pod="openshift-lws-operator/lws-controller-manager-9f5c4b4f6-4p74n" Jul 23 21:04:19.618526 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:19.618502 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49cgm\" (UniqueName: \"kubernetes.io/projected/5ad49517-c977-4b5a-81c7-804118ed9a11-kube-api-access-49cgm\") pod \"lws-controller-manager-9f5c4b4f6-4p74n\" (UID: \"5ad49517-c977-4b5a-81c7-804118ed9a11\") " pod="openshift-lws-operator/lws-controller-manager-9f5c4b4f6-4p74n" Jul 23 21:04:19.770119 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:19.770020 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9f5c4b4f6-4p74n" Jul 23 21:04:19.903471 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:19.903442 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9f5c4b4f6-4p74n"] Jul 23 21:04:19.905921 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:04:19.905890 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ad49517_c977_4b5a_81c7_804118ed9a11.slice/crio-48fbb5dc9a97a37af37375192b8602b89279dbbb3d61579660054ebf800a9df5 WatchSource:0}: Error finding container 48fbb5dc9a97a37af37375192b8602b89279dbbb3d61579660054ebf800a9df5: Status 404 returned error can't find the container with id 48fbb5dc9a97a37af37375192b8602b89279dbbb3d61579660054ebf800a9df5 Jul 23 21:04:20.510640 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:20.510603 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9f5c4b4f6-4p74n" event={"ID":"5ad49517-c977-4b5a-81c7-804118ed9a11","Type":"ContainerStarted","Data":"48fbb5dc9a97a37af37375192b8602b89279dbbb3d61579660054ebf800a9df5"} Jul 23 21:04:22.834359 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:22.834333 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dqgm_5e727997-ea44-49f3-a78a-2e639ce8f1a7/ovn-acl-logging/0.log" Jul 23 21:04:22.836264 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:22.836243 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dqgm_5e727997-ea44-49f3-a78a-2e639ce8f1a7/ovn-acl-logging/0.log" Jul 23 21:04:22.841645 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:22.841618 2575 kubelet.go:1648] "Image garbage collection succeeded" Jul 23 21:04:25.784345 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:25.784302 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:25.875296 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:25.875266 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:26.538388 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:26.538348 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9f5c4b4f6-4p74n" event={"ID":"5ad49517-c977-4b5a-81c7-804118ed9a11","Type":"ContainerStarted","Data":"6e00dc8f790828d93495990e3f0d82cf55b56776f383ae50e6f796d51fbc1210"} Jul 23 21:04:26.538574 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:26.538498 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-9f5c4b4f6-4p74n" Jul 23 21:04:26.582884 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:26.582821 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-9f5c4b4f6-4p74n" podStartSLOduration=1.274253813 podStartE2EDuration="7.582805491s" totalImagesPullingTime="6.308551678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:04:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:04:26.581295551 +0000 UTC m=+304.143729535" watchObservedRunningTime="2026-07-23 21:04:26.582805491 +0000 UTC m=+304.145239529" Jul 23 21:04:26.606596 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:26.606565 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:26.774852 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:26.774817 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:26.866760 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:26.866673 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:26.925061 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:26.925035 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77944bd489-77q5s"] Jul 23 21:04:26.930500 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:26.930458 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77944bd489-77q5s" Jul 23 21:04:26.933572 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:26.933541 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 23 21:04:26.933712 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:26.933698 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pvrrr\"" Jul 23 21:04:26.934511 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:26.934493 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 23 21:04:26.934673 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:26.934655 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 23 21:04:26.934779 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:26.934715 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 23 21:04:26.948117 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:26.948092 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77944bd489-77q5s"] Jul 23 21:04:27.038962 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:27.038926 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:27.075299 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:27.075273 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b5b495c5-be2e-4cc4-a864-7e5a81898e72-manifests\") pod \"opendatahub-operator-controller-manager-77944bd489-77q5s\" (UID: \"b5b495c5-be2e-4cc4-a864-7e5a81898e72\") " pod="opendatahub/opendatahub-operator-controller-manager-77944bd489-77q5s" Jul 23 21:04:27.075420 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:27.075310 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b5b495c5-be2e-4cc4-a864-7e5a81898e72-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77944bd489-77q5s\" (UID: \"b5b495c5-be2e-4cc4-a864-7e5a81898e72\") " pod="opendatahub/opendatahub-operator-controller-manager-77944bd489-77q5s" Jul 23 21:04:27.075420 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:27.075344 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5b495c5-be2e-4cc4-a864-7e5a81898e72-tmp\") pod \"opendatahub-operator-controller-manager-77944bd489-77q5s\" (UID: \"b5b495c5-be2e-4cc4-a864-7e5a81898e72\") " pod="opendatahub/opendatahub-operator-controller-manager-77944bd489-77q5s" Jul 23 21:04:27.075420 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:27.075397 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b5b495c5-be2e-4cc4-a864-7e5a81898e72-webhook-cert\") pod \"opendatahub-operator-controller-manager-77944bd489-77q5s\" (UID: \"b5b495c5-be2e-4cc4-a864-7e5a81898e72\") " pod="opendatahub/opendatahub-operator-controller-manager-77944bd489-77q5s" Jul 23 21:04:27.075420 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:27.075414 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24nhj\" (UniqueName: \"kubernetes.io/projected/b5b495c5-be2e-4cc4-a864-7e5a81898e72-kube-api-access-24nhj\") pod \"opendatahub-operator-controller-manager-77944bd489-77q5s\" (UID: \"b5b495c5-be2e-4cc4-a864-7e5a81898e72\") " pod="opendatahub/opendatahub-operator-controller-manager-77944bd489-77q5s" Jul 23 21:04:27.139978 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:27.139890 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:27.176171 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:27.176144 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b5b495c5-be2e-4cc4-a864-7e5a81898e72-manifests\") pod \"opendatahub-operator-controller-manager-77944bd489-77q5s\" (UID: \"b5b495c5-be2e-4cc4-a864-7e5a81898e72\") " pod="opendatahub/opendatahub-operator-controller-manager-77944bd489-77q5s" Jul 23 21:04:27.176312 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:27.176190 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b5b495c5-be2e-4cc4-a864-7e5a81898e72-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77944bd489-77q5s\" (UID: \"b5b495c5-be2e-4cc4-a864-7e5a81898e72\") " pod="opendatahub/opendatahub-operator-controller-manager-77944bd489-77q5s" Jul 23 21:04:27.176312 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:27.176226 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5b495c5-be2e-4cc4-a864-7e5a81898e72-tmp\") pod \"opendatahub-operator-controller-manager-77944bd489-77q5s\" (UID: \"b5b495c5-be2e-4cc4-a864-7e5a81898e72\") " pod="opendatahub/opendatahub-operator-controller-manager-77944bd489-77q5s" Jul 23 21:04:27.176312 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:27.176258 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b5b495c5-be2e-4cc4-a864-7e5a81898e72-webhook-cert\") pod \"opendatahub-operator-controller-manager-77944bd489-77q5s\" (UID: \"b5b495c5-be2e-4cc4-a864-7e5a81898e72\") " pod="opendatahub/opendatahub-operator-controller-manager-77944bd489-77q5s" Jul 23 21:04:27.176312 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:27.176278 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24nhj\" (UniqueName: \"kubernetes.io/projected/b5b495c5-be2e-4cc4-a864-7e5a81898e72-kube-api-access-24nhj\") pod \"opendatahub-operator-controller-manager-77944bd489-77q5s\" (UID: \"b5b495c5-be2e-4cc4-a864-7e5a81898e72\") " pod="opendatahub/opendatahub-operator-controller-manager-77944bd489-77q5s" Jul 23 21:04:27.176620 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:27.176599 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b5b495c5-be2e-4cc4-a864-7e5a81898e72-manifests\") pod \"opendatahub-operator-controller-manager-77944bd489-77q5s\" (UID: \"b5b495c5-be2e-4cc4-a864-7e5a81898e72\") " pod="opendatahub/opendatahub-operator-controller-manager-77944bd489-77q5s" Jul 23 21:04:27.178763 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:27.178733 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5b495c5-be2e-4cc4-a864-7e5a81898e72-tmp\") pod \"opendatahub-operator-controller-manager-77944bd489-77q5s\" (UID: \"b5b495c5-be2e-4cc4-a864-7e5a81898e72\") " pod="opendatahub/opendatahub-operator-controller-manager-77944bd489-77q5s" Jul 23 21:04:27.178895 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:27.178875 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b5b495c5-be2e-4cc4-a864-7e5a81898e72-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77944bd489-77q5s\" (UID: \"b5b495c5-be2e-4cc4-a864-7e5a81898e72\") " pod="opendatahub/opendatahub-operator-controller-manager-77944bd489-77q5s" Jul 23 21:04:27.178955 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:27.178892 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b5b495c5-be2e-4cc4-a864-7e5a81898e72-webhook-cert\") pod \"opendatahub-operator-controller-manager-77944bd489-77q5s\" (UID: \"b5b495c5-be2e-4cc4-a864-7e5a81898e72\") " pod="opendatahub/opendatahub-operator-controller-manager-77944bd489-77q5s" Jul 23 21:04:27.183607 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:27.183585 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24nhj\" (UniqueName: \"kubernetes.io/projected/b5b495c5-be2e-4cc4-a864-7e5a81898e72-kube-api-access-24nhj\") pod \"opendatahub-operator-controller-manager-77944bd489-77q5s\" (UID: \"b5b495c5-be2e-4cc4-a864-7e5a81898e72\") " pod="opendatahub/opendatahub-operator-controller-manager-77944bd489-77q5s" Jul 23 21:04:27.238737 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:27.238706 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:27.242739 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:27.242717 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77944bd489-77q5s" Jul 23 21:04:27.347568 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:27.347536 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:27.379847 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:27.379803 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77944bd489-77q5s"] Jul 23 21:04:27.387160 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:04:27.387129 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5b495c5_be2e_4cc4_a864_7e5a81898e72.slice/crio-74947505a7c529e067c22693bb3db158412e93a12a546d236390b2fbd043ff90 WatchSource:0}: Error finding container 74947505a7c529e067c22693bb3db158412e93a12a546d236390b2fbd043ff90: Status 404 returned error can't find the container with id 74947505a7c529e067c22693bb3db158412e93a12a546d236390b2fbd043ff90 Jul 23 21:04:27.389180 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:27.389159 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 21:04:27.439646 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:27.439616 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:27.540526 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:27.540495 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:27.543524 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:27.543491 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77944bd489-77q5s" event={"ID":"b5b495c5-be2e-4cc4-a864-7e5a81898e72","Type":"ContainerStarted","Data":"74947505a7c529e067c22693bb3db158412e93a12a546d236390b2fbd043ff90"} Jul 23 21:04:30.560165 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:30.560127 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77944bd489-77q5s" event={"ID":"b5b495c5-be2e-4cc4-a864-7e5a81898e72","Type":"ContainerStarted","Data":"e8a7e96b67d850975951de1561e3f4cb133ad4ebfc7244c50f19677e2ea7d1f1"} Jul 23 21:04:31.571758 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:31.571724 2575 generic.go:356] "Generic (PLEG): container finished" podID="b5b495c5-be2e-4cc4-a864-7e5a81898e72" containerID="e8a7e96b67d850975951de1561e3f4cb133ad4ebfc7244c50f19677e2ea7d1f1" exitCode=0 Jul 23 21:04:31.572156 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:31.571817 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77944bd489-77q5s" event={"ID":"b5b495c5-be2e-4cc4-a864-7e5a81898e72","Type":"ContainerDied","Data":"e8a7e96b67d850975951de1561e3f4cb133ad4ebfc7244c50f19677e2ea7d1f1"} Jul 23 21:04:32.578840 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:32.578808 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77944bd489-77q5s" event={"ID":"b5b495c5-be2e-4cc4-a864-7e5a81898e72","Type":"ContainerStarted","Data":"e19e128da810040817aac58ae9f6792fb66212d1fe05200772001c3dce962ddb"} Jul 23 21:04:32.579335 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:32.578928 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-77944bd489-77q5s" Jul 23 21:04:32.601107 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:32.601053 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-77944bd489-77q5s" podStartSLOduration=2.140459352 podStartE2EDuration="6.601035924s" totalImagesPullingTime="3.433647382s" totalInitContainerRuntime="1.02692919s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:04:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:04:32.598557892 +0000 UTC m=+310.160991876" watchObservedRunningTime="2026-07-23 21:04:32.601035924 +0000 UTC m=+310.163469909" Jul 23 21:04:37.545900 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:37.545841 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-9f5c4b4f6-4p74n" Jul 23 21:04:38.766596 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:38.766563 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:38.867613 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:38.867577 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:39.283761 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:39.283726 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:43.585804 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:43.585768 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-77944bd489-77q5s" Jul 23 21:04:46.258725 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:46.258684 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:46.445388 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:46.445342 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:46.883273 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:46.883236 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:46.912096 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:46.912063 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5cc7f4f888-n7vn2"] Jul 23 21:04:46.915773 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:46.915749 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5cc7f4f888-n7vn2" Jul 23 21:04:46.918614 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:46.918592 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 23 21:04:46.919097 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:46.919076 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 23 21:04:46.919367 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:46.919353 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tdfj7\"" Jul 23 21:04:46.919684 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:46.919669 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 23 21:04:46.919934 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:46.919922 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 23 21:04:46.930854 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:46.930830 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5cc7f4f888-n7vn2"] Jul 23 21:04:46.963518 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:46.963485 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27427d7e-269a-4048-ac06-186a738a9c68-tls-certs\") pod \"kube-auth-proxy-5cc7f4f888-n7vn2\" (UID: \"27427d7e-269a-4048-ac06-186a738a9c68\") " pod="openshift-ingress/kube-auth-proxy-5cc7f4f888-n7vn2" Jul 23 21:04:46.963705 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:46.963527 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27427d7e-269a-4048-ac06-186a738a9c68-tmp\") pod \"kube-auth-proxy-5cc7f4f888-n7vn2\" (UID: \"27427d7e-269a-4048-ac06-186a738a9c68\") " pod="openshift-ingress/kube-auth-proxy-5cc7f4f888-n7vn2" Jul 23 21:04:46.963705 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:46.963650 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4kkg\" (UniqueName: \"kubernetes.io/projected/27427d7e-269a-4048-ac06-186a738a9c68-kube-api-access-l4kkg\") pod \"kube-auth-proxy-5cc7f4f888-n7vn2\" (UID: \"27427d7e-269a-4048-ac06-186a738a9c68\") " pod="openshift-ingress/kube-auth-proxy-5cc7f4f888-n7vn2" Jul 23 21:04:47.064783 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:47.064747 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27427d7e-269a-4048-ac06-186a738a9c68-tls-certs\") pod \"kube-auth-proxy-5cc7f4f888-n7vn2\" (UID: \"27427d7e-269a-4048-ac06-186a738a9c68\") " pod="openshift-ingress/kube-auth-proxy-5cc7f4f888-n7vn2" Jul 23 21:04:47.064998 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:47.064803 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27427d7e-269a-4048-ac06-186a738a9c68-tmp\") pod \"kube-auth-proxy-5cc7f4f888-n7vn2\" (UID: \"27427d7e-269a-4048-ac06-186a738a9c68\") " pod="openshift-ingress/kube-auth-proxy-5cc7f4f888-n7vn2" Jul 23 21:04:47.064998 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:47.064893 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4kkg\" (UniqueName: \"kubernetes.io/projected/27427d7e-269a-4048-ac06-186a738a9c68-kube-api-access-l4kkg\") pod \"kube-auth-proxy-5cc7f4f888-n7vn2\" (UID: \"27427d7e-269a-4048-ac06-186a738a9c68\") " pod="openshift-ingress/kube-auth-proxy-5cc7f4f888-n7vn2" Jul 23 21:04:47.064998 ip-10-0-139-105 kubenswrapper[2575]: E0723 21:04:47.064923 2575 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 23 21:04:47.065166 ip-10-0-139-105 kubenswrapper[2575]: E0723 21:04:47.065006 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27427d7e-269a-4048-ac06-186a738a9c68-tls-certs podName:27427d7e-269a-4048-ac06-186a738a9c68 nodeName:}" failed. No retries permitted until 2026-07-23 21:04:47.564984605 +0000 UTC m=+325.127418569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/27427d7e-269a-4048-ac06-186a738a9c68-tls-certs") pod "kube-auth-proxy-5cc7f4f888-n7vn2" (UID: "27427d7e-269a-4048-ac06-186a738a9c68") : secret "kube-auth-proxy-tls" not found Jul 23 21:04:47.067113 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:47.067086 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27427d7e-269a-4048-ac06-186a738a9c68-tmp\") pod \"kube-auth-proxy-5cc7f4f888-n7vn2\" (UID: \"27427d7e-269a-4048-ac06-186a738a9c68\") " pod="openshift-ingress/kube-auth-proxy-5cc7f4f888-n7vn2" Jul 23 21:04:47.089071 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:47.089033 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4kkg\" (UniqueName: \"kubernetes.io/projected/27427d7e-269a-4048-ac06-186a738a9c68-kube-api-access-l4kkg\") pod \"kube-auth-proxy-5cc7f4f888-n7vn2\" (UID: \"27427d7e-269a-4048-ac06-186a738a9c68\") " pod="openshift-ingress/kube-auth-proxy-5cc7f4f888-n7vn2" Jul 23 21:04:47.191015 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:47.190884 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:47.299665 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:47.299633 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:47.406342 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:47.406306 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:47.570235 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:47.570202 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27427d7e-269a-4048-ac06-186a738a9c68-tls-certs\") pod \"kube-auth-proxy-5cc7f4f888-n7vn2\" (UID: \"27427d7e-269a-4048-ac06-186a738a9c68\") " pod="openshift-ingress/kube-auth-proxy-5cc7f4f888-n7vn2" Jul 23 21:04:47.570444 ip-10-0-139-105 kubenswrapper[2575]: E0723 21:04:47.570385 2575 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 23 21:04:47.570516 ip-10-0-139-105 kubenswrapper[2575]: E0723 21:04:47.570500 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27427d7e-269a-4048-ac06-186a738a9c68-tls-certs podName:27427d7e-269a-4048-ac06-186a738a9c68 nodeName:}" failed. No retries permitted until 2026-07-23 21:04:48.570477561 +0000 UTC m=+326.132911529 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/27427d7e-269a-4048-ac06-186a738a9c68-tls-certs") pod "kube-auth-proxy-5cc7f4f888-n7vn2" (UID: "27427d7e-269a-4048-ac06-186a738a9c68") : secret "kube-auth-proxy-tls" not found Jul 23 21:04:47.830088 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:47.829998 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:47.925681 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:47.925643 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:48.156956 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:48.156877 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:48.272134 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:48.272069 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:48.364708 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:48.364671 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:48.581132 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:48.581092 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27427d7e-269a-4048-ac06-186a738a9c68-tls-certs\") pod \"kube-auth-proxy-5cc7f4f888-n7vn2\" (UID: \"27427d7e-269a-4048-ac06-186a738a9c68\") " pod="openshift-ingress/kube-auth-proxy-5cc7f4f888-n7vn2" Jul 23 21:04:48.583530 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:48.583505 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27427d7e-269a-4048-ac06-186a738a9c68-tls-certs\") pod \"kube-auth-proxy-5cc7f4f888-n7vn2\" (UID: \"27427d7e-269a-4048-ac06-186a738a9c68\") " pod="openshift-ingress/kube-auth-proxy-5cc7f4f888-n7vn2" Jul 23 21:04:48.725895 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:48.725840 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5cc7f4f888-n7vn2" Jul 23 21:04:48.865107 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:48.865080 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5cc7f4f888-n7vn2"] Jul 23 21:04:48.868052 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:04:48.868021 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27427d7e_269a_4048_ac06_186a738a9c68.slice/crio-beb776fa9c1b90b86e047b991735614928119665b88b1a55ba8fbf90761410f3 WatchSource:0}: Error finding container beb776fa9c1b90b86e047b991735614928119665b88b1a55ba8fbf90761410f3: Status 404 returned error can't find the container with id beb776fa9c1b90b86e047b991735614928119665b88b1a55ba8fbf90761410f3 Jul 23 21:04:49.290843 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:49.290807 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:49.659548 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:49.659452 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5cc7f4f888-n7vn2" event={"ID":"27427d7e-269a-4048-ac06-186a738a9c68","Type":"ContainerStarted","Data":"beb776fa9c1b90b86e047b991735614928119665b88b1a55ba8fbf90761410f3"} Jul 23 21:04:52.677622 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:52.677586 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5cc7f4f888-n7vn2" event={"ID":"27427d7e-269a-4048-ac06-186a738a9c68","Type":"ContainerStarted","Data":"f85f42309c44ca8ae0b5ab1bc028ae8081500a9640a4d5e0f3e963393c8bed43"} Jul 23 21:04:52.694737 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:52.694682 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5cc7f4f888-n7vn2" podStartSLOduration=3.604347187 podStartE2EDuration="6.694667323s" totalImagesPullingTime="3.090320136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:04:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:04:52.693029268 +0000 UTC m=+330.255463253" watchObservedRunningTime="2026-07-23 21:04:52.694667323 +0000 UTC m=+330.257101307" Jul 23 21:04:57.170634 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:57.170596 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:57.268843 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:57.268806 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:57.414403 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:57.414368 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:57.559387 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:57.559347 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:57.761326 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:57.761294 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:57.858025 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:57.857941 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:58.358341 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:58.358292 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:58.510640 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:58.510601 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:58.777515 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:58.777482 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:58.875312 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:58.875281 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:59.233038 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:59.232962 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:04:59.299555 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:04:59.299525 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:05:04.277660 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:05:04.277627 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:05:04.405104 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:05:04.405066 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:05:16.690929 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:05:16.690827 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:05:16.745479 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:05:16.745444 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:05:47.721325 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:05:47.721281 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:05:47.823366 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:05:47.823311 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:05:47.919927 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:05:47.919891 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:06:02.756589 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:02.756554 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:06:17.388249 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:17.388210 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:06:20.773193 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:20.773162 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:06:21.587201 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:21.587165 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:06:24.647809 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:24.647764 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:06:25.035233 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:25.035195 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:06:25.137699 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:25.137664 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:06:27.253150 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:27.253117 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:06:29.127404 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:29.127373 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:06:30.201211 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:30.201171 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:06:32.175099 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:32.175057 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-swd5c"] Jul 23 21:06:32.177621 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:32.177598 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-swd5c" Jul 23 21:06:32.180153 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:32.180134 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 23 21:06:32.180244 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:32.180199 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 23 21:06:32.180293 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:32.180287 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 23 21:06:32.180988 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:32.180971 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-pj89m\"" Jul 23 21:06:32.193068 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:32.193048 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-swd5c"] Jul 23 21:06:32.315468 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:32.315433 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kw9w\" (UniqueName: \"kubernetes.io/projected/94287978-52fa-471f-a85e-fd2bbcee3f4e-kube-api-access-6kw9w\") pod \"dns-operator-controller-manager-864dd78c4c-swd5c\" (UID: \"94287978-52fa-471f-a85e-fd2bbcee3f4e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-swd5c" Jul 23 21:06:32.416276 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:32.416238 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kw9w\" (UniqueName: \"kubernetes.io/projected/94287978-52fa-471f-a85e-fd2bbcee3f4e-kube-api-access-6kw9w\") pod \"dns-operator-controller-manager-864dd78c4c-swd5c\" (UID: \"94287978-52fa-471f-a85e-fd2bbcee3f4e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-swd5c" Jul 23 21:06:32.430979 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:32.430917 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kw9w\" (UniqueName: \"kubernetes.io/projected/94287978-52fa-471f-a85e-fd2bbcee3f4e-kube-api-access-6kw9w\") pod \"dns-operator-controller-manager-864dd78c4c-swd5c\" (UID: \"94287978-52fa-471f-a85e-fd2bbcee3f4e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-swd5c" Jul 23 21:06:32.487347 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:32.487310 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-swd5c" Jul 23 21:06:32.625532 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:32.625371 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-swd5c"] Jul 23 21:06:32.628330 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:06:32.628300 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94287978_52fa_471f_a85e_fd2bbcee3f4e.slice/crio-d2f809d7ef2784c2461406355587b096d13a85c34757f8713a9f3a51a6b43f86 WatchSource:0}: Error finding container d2f809d7ef2784c2461406355587b096d13a85c34757f8713a9f3a51a6b43f86: Status 404 returned error can't find the container with id d2f809d7ef2784c2461406355587b096d13a85c34757f8713a9f3a51a6b43f86 Jul 23 21:06:33.135146 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:33.135111 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-swd5c" event={"ID":"94287978-52fa-471f-a85e-fd2bbcee3f4e","Type":"ContainerStarted","Data":"d2f809d7ef2784c2461406355587b096d13a85c34757f8713a9f3a51a6b43f86"} Jul 23 21:06:33.233913 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:33.233833 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:06:36.080697 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:36.080664 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:06:36.152490 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:36.152454 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-swd5c" event={"ID":"94287978-52fa-471f-a85e-fd2bbcee3f4e","Type":"ContainerStarted","Data":"6f91d1cd7938929e5758efceed42df6b9c8e2b3e14ffe66804467d4b7e8d4d53"} Jul 23 21:06:36.152664 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:36.152541 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-swd5c" Jul 23 21:06:36.169333 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:36.169286 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-swd5c" podStartSLOduration=1.326561235 podStartE2EDuration="4.169268709s" totalImagesPullingTime="2.842707474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:06:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:06:36.167784587 +0000 UTC m=+433.730218573" watchObservedRunningTime="2026-07-23 21:06:36.169268709 +0000 UTC m=+433.731702693" Jul 23 21:06:36.176218 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:36.176187 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:06:37.780986 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:37.780952 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-gp2zv"] Jul 23 21:06:37.781355 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:37.780986 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:06:37.783533 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:37.783517 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gp2zv" Jul 23 21:06:37.785655 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:37.785626 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 23 21:06:37.785815 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:37.785799 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9p2v6\"" Jul 23 21:06:37.785919 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:37.785822 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 23 21:06:37.791951 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:37.791932 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-gp2zv"] Jul 23 21:06:37.871986 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:37.871952 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3bd249c1-ba72-4e9f-bc9e-886cf4f9fcf4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gp2zv\" (UID: \"3bd249c1-ba72-4e9f-bc9e-886cf4f9fcf4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gp2zv" Jul 23 21:06:37.872189 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:37.872024 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3bd249c1-ba72-4e9f-bc9e-886cf4f9fcf4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-gp2zv\" (UID: \"3bd249c1-ba72-4e9f-bc9e-886cf4f9fcf4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gp2zv" Jul 23 21:06:37.872189 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:37.872108 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9khl4\" (UniqueName: \"kubernetes.io/projected/3bd249c1-ba72-4e9f-bc9e-886cf4f9fcf4-kube-api-access-9khl4\") pod \"kuadrant-console-plugin-66b5774985-gp2zv\" (UID: \"3bd249c1-ba72-4e9f-bc9e-886cf4f9fcf4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gp2zv" Jul 23 21:06:37.957590 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:37.957552 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:06:37.973458 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:37.973428 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3bd249c1-ba72-4e9f-bc9e-886cf4f9fcf4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gp2zv\" (UID: \"3bd249c1-ba72-4e9f-bc9e-886cf4f9fcf4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gp2zv" Jul 23 21:06:37.973627 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:37.973515 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3bd249c1-ba72-4e9f-bc9e-886cf4f9fcf4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-gp2zv\" (UID: \"3bd249c1-ba72-4e9f-bc9e-886cf4f9fcf4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gp2zv" Jul 23 21:06:37.973627 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:37.973553 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9khl4\" (UniqueName: \"kubernetes.io/projected/3bd249c1-ba72-4e9f-bc9e-886cf4f9fcf4-kube-api-access-9khl4\") pod \"kuadrant-console-plugin-66b5774985-gp2zv\" (UID: \"3bd249c1-ba72-4e9f-bc9e-886cf4f9fcf4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gp2zv" Jul 23 21:06:37.974190 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:37.974171 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3bd249c1-ba72-4e9f-bc9e-886cf4f9fcf4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-gp2zv\" (UID: \"3bd249c1-ba72-4e9f-bc9e-886cf4f9fcf4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gp2zv" Jul 23 21:06:37.975805 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:37.975787 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3bd249c1-ba72-4e9f-bc9e-886cf4f9fcf4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gp2zv\" (UID: \"3bd249c1-ba72-4e9f-bc9e-886cf4f9fcf4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gp2zv" Jul 23 21:06:37.981898 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:37.981856 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9khl4\" (UniqueName: \"kubernetes.io/projected/3bd249c1-ba72-4e9f-bc9e-886cf4f9fcf4-kube-api-access-9khl4\") pod \"kuadrant-console-plugin-66b5774985-gp2zv\" (UID: \"3bd249c1-ba72-4e9f-bc9e-886cf4f9fcf4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gp2zv" Jul 23 21:06:38.093152 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:38.093061 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gp2zv" Jul 23 21:06:38.224134 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:38.224099 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-gp2zv"] Jul 23 21:06:38.227131 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:06:38.227108 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3bd249c1_ba72_4e9f_bc9e_886cf4f9fcf4.slice/crio-789f15dd97350e3998f184b18a01488800984c109b5005cbe4071e7b02fc9cb9 WatchSource:0}: Error finding container 789f15dd97350e3998f184b18a01488800984c109b5005cbe4071e7b02fc9cb9: Status 404 returned error can't find the container with id 789f15dd97350e3998f184b18a01488800984c109b5005cbe4071e7b02fc9cb9 Jul 23 21:06:39.168577 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:39.168542 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gp2zv" event={"ID":"3bd249c1-ba72-4e9f-bc9e-886cf4f9fcf4","Type":"ContainerStarted","Data":"789f15dd97350e3998f184b18a01488800984c109b5005cbe4071e7b02fc9cb9"} Jul 23 21:06:40.188959 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:40.188853 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:06:40.245518 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:40.245482 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:06:40.794318 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:40.794275 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:06:40.873607 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:40.873523 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:06:45.191736 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:45.191619 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:06:45.292113 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:45.292080 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:06:47.159652 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:47.159613 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-swd5c" Jul 23 21:06:48.044059 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:48.044019 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r7pr2"] Jul 23 21:06:48.051325 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:48.051298 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r7pr2" Jul 23 21:06:48.053850 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:48.053828 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nw228\"" Jul 23 21:06:48.061416 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:48.061390 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r7pr2"] Jul 23 21:06:48.063203 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:48.063173 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbx85\" (UniqueName: \"kubernetes.io/projected/cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3-kube-api-access-cbx85\") pod \"kuadrant-operator-controller-manager-55467d9f7-r7pr2\" (UID: \"cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r7pr2" Jul 23 21:06:48.063343 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:48.063230 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-r7pr2\" (UID: \"cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r7pr2" Jul 23 21:06:48.163831 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:48.163801 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbx85\" (UniqueName: \"kubernetes.io/projected/cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3-kube-api-access-cbx85\") pod \"kuadrant-operator-controller-manager-55467d9f7-r7pr2\" (UID: \"cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r7pr2" Jul 23 21:06:48.164288 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:48.163840 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-r7pr2\" (UID: \"cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r7pr2" Jul 23 21:06:48.164288 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:48.164237 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-r7pr2\" (UID: \"cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r7pr2" Jul 23 21:06:48.172452 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:48.172425 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbx85\" (UniqueName: \"kubernetes.io/projected/cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3-kube-api-access-cbx85\") pod \"kuadrant-operator-controller-manager-55467d9f7-r7pr2\" (UID: \"cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r7pr2" Jul 23 21:06:48.365380 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:48.365290 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r7pr2" Jul 23 21:06:51.509749 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:51.509701 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:06:51.877677 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:51.877633 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:06:55.877083 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:55.877047 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:06:55.975999 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:06:55.975941 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:07:00.908245 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:00.908220 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r7pr2"] Jul 23 21:07:00.909774 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:07:00.909745 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbbc930a_cca5_44c3_a6dc_bfd77a5ee7c3.slice/crio-9c3e80a286ef95abd1e2bb76be22edd751315cd47c30f7c517efa832c71d36e8 WatchSource:0}: Error finding container 9c3e80a286ef95abd1e2bb76be22edd751315cd47c30f7c517efa832c71d36e8: Status 404 returned error can't find the container with id 9c3e80a286ef95abd1e2bb76be22edd751315cd47c30f7c517efa832c71d36e8 Jul 23 21:07:01.269755 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:01.269679 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:07:01.291670 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:01.291634 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r7pr2" event={"ID":"cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3","Type":"ContainerStarted","Data":"9c3e80a286ef95abd1e2bb76be22edd751315cd47c30f7c517efa832c71d36e8"} Jul 23 21:07:01.293335 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:01.293307 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gp2zv" event={"ID":"3bd249c1-ba72-4e9f-bc9e-886cf4f9fcf4","Type":"ContainerStarted","Data":"1ba7037e1352973ef4c856ba50f6e3509c87f79ec8eb00eb7673c8007d199f93"} Jul 23 21:07:01.310502 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:01.310458 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gp2zv" podStartSLOduration=1.680466221 podStartE2EDuration="24.310442429s" totalImagesPullingTime="22.629976208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:06:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:07:01.309301975 +0000 UTC m=+458.871735960" watchObservedRunningTime="2026-07-23 21:07:01.310442429 +0000 UTC m=+458.872876414" Jul 23 21:07:01.371029 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:01.370997 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:07:01.881399 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:01.881354 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:07:01.977684 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:01.977603 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:07:05.363580 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:05.363541 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:07:05.487315 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:05.487261 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:07:05.608283 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:05.608244 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:07:06.324103 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:06.324068 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r7pr2" event={"ID":"cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3","Type":"ContainerStarted","Data":"9d6db9e347ddf9531b25ca9a0af66028759b1682bc033fddc9346a231eeec36a"} Jul 23 21:07:06.324310 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:06.324244 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r7pr2" Jul 23 21:07:06.342466 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:06.342413 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r7pr2" podStartSLOduration=13.516347098 podStartE2EDuration="18.342396702s" totalImagesPullingTime="4.826049604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:06:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:07:06.340390088 +0000 UTC m=+463.902824075" watchObservedRunningTime="2026-07-23 21:07:06.342396702 +0000 UTC m=+463.904830686" Jul 23 21:07:11.524953 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:11.524915 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:07:11.582588 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:11.582553 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:07:13.353138 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:13.353101 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9bdb6c96-4ddxr"] Jul 23 21:07:13.402745 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:13.402713 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9bdb6c96-4ddxr"] Jul 23 21:07:13.402928 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:13.402810 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9bdb6c96-4ddxr" Jul 23 21:07:13.419528 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:13.419499 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:07:13.509664 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:13.509612 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqf6k\" (UniqueName: \"kubernetes.io/projected/33bd348e-479d-4abd-a47e-94edbd4ebd3e-kube-api-access-sqf6k\") pod \"console-9bdb6c96-4ddxr\" (UID: \"33bd348e-479d-4abd-a47e-94edbd4ebd3e\") " pod="openshift-console/console-9bdb6c96-4ddxr" Jul 23 21:07:13.509664 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:13.509676 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33bd348e-479d-4abd-a47e-94edbd4ebd3e-service-ca\") pod \"console-9bdb6c96-4ddxr\" (UID: \"33bd348e-479d-4abd-a47e-94edbd4ebd3e\") " pod="openshift-console/console-9bdb6c96-4ddxr" Jul 23 21:07:13.509921 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:13.509738 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33bd348e-479d-4abd-a47e-94edbd4ebd3e-oauth-serving-cert\") pod \"console-9bdb6c96-4ddxr\" (UID: \"33bd348e-479d-4abd-a47e-94edbd4ebd3e\") " pod="openshift-console/console-9bdb6c96-4ddxr" Jul 23 21:07:13.509921 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:13.509763 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33bd348e-479d-4abd-a47e-94edbd4ebd3e-console-config\") pod \"console-9bdb6c96-4ddxr\" (UID: \"33bd348e-479d-4abd-a47e-94edbd4ebd3e\") " pod="openshift-console/console-9bdb6c96-4ddxr" Jul 23 21:07:13.509921 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:13.509785 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33bd348e-479d-4abd-a47e-94edbd4ebd3e-console-serving-cert\") pod \"console-9bdb6c96-4ddxr\" (UID: \"33bd348e-479d-4abd-a47e-94edbd4ebd3e\") " pod="openshift-console/console-9bdb6c96-4ddxr" Jul 23 21:07:13.509921 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:13.509801 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33bd348e-479d-4abd-a47e-94edbd4ebd3e-console-oauth-config\") pod \"console-9bdb6c96-4ddxr\" (UID: \"33bd348e-479d-4abd-a47e-94edbd4ebd3e\") " pod="openshift-console/console-9bdb6c96-4ddxr" Jul 23 21:07:13.509921 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:13.509857 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33bd348e-479d-4abd-a47e-94edbd4ebd3e-trusted-ca-bundle\") pod \"console-9bdb6c96-4ddxr\" (UID: \"33bd348e-479d-4abd-a47e-94edbd4ebd3e\") " pod="openshift-console/console-9bdb6c96-4ddxr" Jul 23 21:07:13.520213 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:13.520174 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:07:13.610972 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:13.610854 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqf6k\" (UniqueName: \"kubernetes.io/projected/33bd348e-479d-4abd-a47e-94edbd4ebd3e-kube-api-access-sqf6k\") pod \"console-9bdb6c96-4ddxr\" (UID: \"33bd348e-479d-4abd-a47e-94edbd4ebd3e\") " pod="openshift-console/console-9bdb6c96-4ddxr" Jul 23 21:07:13.610972 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:13.610933 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33bd348e-479d-4abd-a47e-94edbd4ebd3e-service-ca\") pod \"console-9bdb6c96-4ddxr\" (UID: \"33bd348e-479d-4abd-a47e-94edbd4ebd3e\") " pod="openshift-console/console-9bdb6c96-4ddxr" Jul 23 21:07:13.611229 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:13.610983 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33bd348e-479d-4abd-a47e-94edbd4ebd3e-oauth-serving-cert\") pod \"console-9bdb6c96-4ddxr\" (UID: \"33bd348e-479d-4abd-a47e-94edbd4ebd3e\") " pod="openshift-console/console-9bdb6c96-4ddxr" Jul 23 21:07:13.611229 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:13.611002 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33bd348e-479d-4abd-a47e-94edbd4ebd3e-console-config\") pod \"console-9bdb6c96-4ddxr\" (UID: \"33bd348e-479d-4abd-a47e-94edbd4ebd3e\") " pod="openshift-console/console-9bdb6c96-4ddxr" Jul 23 21:07:13.611229 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:13.611190 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33bd348e-479d-4abd-a47e-94edbd4ebd3e-console-serving-cert\") pod \"console-9bdb6c96-4ddxr\" (UID: \"33bd348e-479d-4abd-a47e-94edbd4ebd3e\") " pod="openshift-console/console-9bdb6c96-4ddxr" Jul 23 21:07:13.611229 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:13.611215 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33bd348e-479d-4abd-a47e-94edbd4ebd3e-console-oauth-config\") pod \"console-9bdb6c96-4ddxr\" (UID: \"33bd348e-479d-4abd-a47e-94edbd4ebd3e\") " pod="openshift-console/console-9bdb6c96-4ddxr" Jul 23 21:07:13.611417 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:13.611273 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33bd348e-479d-4abd-a47e-94edbd4ebd3e-trusted-ca-bundle\") pod \"console-9bdb6c96-4ddxr\" (UID: \"33bd348e-479d-4abd-a47e-94edbd4ebd3e\") " pod="openshift-console/console-9bdb6c96-4ddxr" Jul 23 21:07:13.611818 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:13.611787 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33bd348e-479d-4abd-a47e-94edbd4ebd3e-service-ca\") pod \"console-9bdb6c96-4ddxr\" (UID: \"33bd348e-479d-4abd-a47e-94edbd4ebd3e\") " pod="openshift-console/console-9bdb6c96-4ddxr" Jul 23 21:07:13.611818 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:13.611811 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33bd348e-479d-4abd-a47e-94edbd4ebd3e-console-config\") pod \"console-9bdb6c96-4ddxr\" (UID: \"33bd348e-479d-4abd-a47e-94edbd4ebd3e\") " pod="openshift-console/console-9bdb6c96-4ddxr" Jul 23 21:07:13.611991 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:13.611794 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33bd348e-479d-4abd-a47e-94edbd4ebd3e-oauth-serving-cert\") pod \"console-9bdb6c96-4ddxr\" (UID: \"33bd348e-479d-4abd-a47e-94edbd4ebd3e\") " pod="openshift-console/console-9bdb6c96-4ddxr" Jul 23 21:07:13.612044 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:13.612028 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33bd348e-479d-4abd-a47e-94edbd4ebd3e-trusted-ca-bundle\") pod \"console-9bdb6c96-4ddxr\" (UID: \"33bd348e-479d-4abd-a47e-94edbd4ebd3e\") " pod="openshift-console/console-9bdb6c96-4ddxr" Jul 23 21:07:13.613753 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:13.613728 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33bd348e-479d-4abd-a47e-94edbd4ebd3e-console-serving-cert\") pod \"console-9bdb6c96-4ddxr\" (UID: \"33bd348e-479d-4abd-a47e-94edbd4ebd3e\") " pod="openshift-console/console-9bdb6c96-4ddxr" Jul 23 21:07:13.613959 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:13.613940 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33bd348e-479d-4abd-a47e-94edbd4ebd3e-console-oauth-config\") pod \"console-9bdb6c96-4ddxr\" (UID: \"33bd348e-479d-4abd-a47e-94edbd4ebd3e\") " pod="openshift-console/console-9bdb6c96-4ddxr" Jul 23 21:07:13.618573 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:13.618542 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqf6k\" (UniqueName: \"kubernetes.io/projected/33bd348e-479d-4abd-a47e-94edbd4ebd3e-kube-api-access-sqf6k\") pod \"console-9bdb6c96-4ddxr\" (UID: \"33bd348e-479d-4abd-a47e-94edbd4ebd3e\") " pod="openshift-console/console-9bdb6c96-4ddxr" Jul 23 21:07:13.714429 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:13.714390 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9bdb6c96-4ddxr" Jul 23 21:07:13.949593 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:13.949558 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9bdb6c96-4ddxr"] Jul 23 21:07:13.951479 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:07:13.951453 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33bd348e_479d_4abd_a47e_94edbd4ebd3e.slice/crio-cbc2ee2a301d7b9387c1224d54965ee119a5b971254890087118b32653362c6e WatchSource:0}: Error finding container cbc2ee2a301d7b9387c1224d54965ee119a5b971254890087118b32653362c6e: Status 404 returned error can't find the container with id cbc2ee2a301d7b9387c1224d54965ee119a5b971254890087118b32653362c6e Jul 23 21:07:14.363601 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:14.363559 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9bdb6c96-4ddxr" event={"ID":"33bd348e-479d-4abd-a47e-94edbd4ebd3e","Type":"ContainerStarted","Data":"7158863545a42cfba13147f6068eb1df583a40cacc430c656b543bbb63fee5e2"} Jul 23 21:07:14.364017 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:14.363622 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9bdb6c96-4ddxr" event={"ID":"33bd348e-479d-4abd-a47e-94edbd4ebd3e","Type":"ContainerStarted","Data":"cbc2ee2a301d7b9387c1224d54965ee119a5b971254890087118b32653362c6e"} Jul 23 21:07:14.386037 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:14.385981 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9bdb6c96-4ddxr" podStartSLOduration=1.385964871 podStartE2EDuration="1.385964871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:07:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:07:14.383409631 +0000 UTC m=+471.945843629" watchObservedRunningTime="2026-07-23 21:07:14.385964871 +0000 UTC m=+471.948398931" Jul 23 21:07:17.331665 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:17.331628 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r7pr2" Jul 23 21:07:23.714661 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:23.714606 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9bdb6c96-4ddxr" Jul 23 21:07:23.715131 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:23.714686 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9bdb6c96-4ddxr" Jul 23 21:07:23.719302 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:23.719281 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9bdb6c96-4ddxr" Jul 23 21:07:24.423359 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:24.423327 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9bdb6c96-4ddxr" Jul 23 21:07:24.469731 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:24.469696 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fd88c5d5b-nbk6j"] Jul 23 21:07:24.602056 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:24.602001 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:07:24.711575 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:24.711491 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:07:24.777328 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:24.777296 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:07:29.665091 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:29.665058 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r7pr2"] Jul 23 21:07:29.665516 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:29.665303 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r7pr2" podUID="cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3" containerName="manager" containerID="cri-o://9d6db9e347ddf9531b25ca9a0af66028759b1682bc033fddc9346a231eeec36a" gracePeriod=10 Jul 23 21:07:29.913247 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:29.913215 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r7pr2" Jul 23 21:07:29.972782 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:29.972692 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbx85\" (UniqueName: \"kubernetes.io/projected/cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3-kube-api-access-cbx85\") pod \"cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3\" (UID: \"cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3\") " Jul 23 21:07:29.972966 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:29.972796 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3-extensions-socket-volume\") pod \"cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3\" (UID: \"cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3\") " Jul 23 21:07:29.973185 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:29.973160 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3" (UID: "cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 21:07:29.975031 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:29.975007 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3-kube-api-access-cbx85" (OuterVolumeSpecName: "kube-api-access-cbx85") pod "cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3" (UID: "cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3"). InnerVolumeSpecName "kube-api-access-cbx85". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:07:30.074416 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:30.074362 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbx85\" (UniqueName: \"kubernetes.io/projected/cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3-kube-api-access-cbx85\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:07:30.074416 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:30.074405 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3-extensions-socket-volume\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:07:30.442892 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:30.442836 2575 generic.go:356] "Generic (PLEG): container finished" podID="cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3" containerID="9d6db9e347ddf9531b25ca9a0af66028759b1682bc033fddc9346a231eeec36a" exitCode=0 Jul 23 21:07:30.443066 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:30.442932 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r7pr2" Jul 23 21:07:30.443066 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:30.442924 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r7pr2" event={"ID":"cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3","Type":"ContainerDied","Data":"9d6db9e347ddf9531b25ca9a0af66028759b1682bc033fddc9346a231eeec36a"} Jul 23 21:07:30.443066 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:30.443019 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r7pr2" event={"ID":"cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3","Type":"ContainerDied","Data":"9c3e80a286ef95abd1e2bb76be22edd751315cd47c30f7c517efa832c71d36e8"} Jul 23 21:07:30.443066 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:30.443046 2575 scope.go:117] "RemoveContainer" containerID="9d6db9e347ddf9531b25ca9a0af66028759b1682bc033fddc9346a231eeec36a" Jul 23 21:07:30.452572 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:30.452551 2575 scope.go:117] "RemoveContainer" containerID="9d6db9e347ddf9531b25ca9a0af66028759b1682bc033fddc9346a231eeec36a" Jul 23 21:07:30.452829 ip-10-0-139-105 kubenswrapper[2575]: E0723 21:07:30.452810 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d6db9e347ddf9531b25ca9a0af66028759b1682bc033fddc9346a231eeec36a\": container with ID starting with 9d6db9e347ddf9531b25ca9a0af66028759b1682bc033fddc9346a231eeec36a not found: ID does not exist" containerID="9d6db9e347ddf9531b25ca9a0af66028759b1682bc033fddc9346a231eeec36a" Jul 23 21:07:30.452882 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:30.452838 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d6db9e347ddf9531b25ca9a0af66028759b1682bc033fddc9346a231eeec36a"} err="failed to get container status \"9d6db9e347ddf9531b25ca9a0af66028759b1682bc033fddc9346a231eeec36a\": rpc error: code = NotFound desc = could not find container \"9d6db9e347ddf9531b25ca9a0af66028759b1682bc033fddc9346a231eeec36a\": container with ID starting with 9d6db9e347ddf9531b25ca9a0af66028759b1682bc033fddc9346a231eeec36a not found: ID does not exist" Jul 23 21:07:30.467575 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:30.467548 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r7pr2"] Jul 23 21:07:30.473250 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:30.473230 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-r7pr2"] Jul 23 21:07:30.963750 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:30.963713 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3" path="/var/lib/kubelet/pods/cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3/volumes" Jul 23 21:07:33.699871 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:33.699828 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:07:34.054912 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:34.054857 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:07:37.328063 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:37.328023 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:07:37.388049 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:37.388017 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:07:37.877453 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:37.877420 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-dq2n5"] Jul 23 21:07:37.877907 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:37.877888 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3" containerName="manager" Jul 23 21:07:37.877997 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:37.877909 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3" containerName="manager" Jul 23 21:07:37.878058 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:37.878049 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbbc930a-cca5-44c3-a6dc-bfd77a5ee7c3" containerName="manager" Jul 23 21:07:38.151467 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:38.151375 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:07:38.175225 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:38.175195 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-dq2n5"] Jul 23 21:07:38.175372 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:38.175308 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-dq2n5" Jul 23 21:07:38.177572 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:38.177548 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xr9t7\"" Jul 23 21:07:38.248001 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:38.247959 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jnrm\" (UniqueName: \"kubernetes.io/projected/cf09a8c4-e91f-4ee9-a501-b3a0dd5c2a07-kube-api-access-7jnrm\") pod \"authorino-58cd955675-dq2n5\" (UID: \"cf09a8c4-e91f-4ee9-a501-b3a0dd5c2a07\") " pod="kuadrant-system/authorino-58cd955675-dq2n5" Jul 23 21:07:38.251749 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:38.251720 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:07:38.348716 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:38.348678 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jnrm\" (UniqueName: \"kubernetes.io/projected/cf09a8c4-e91f-4ee9-a501-b3a0dd5c2a07-kube-api-access-7jnrm\") pod \"authorino-58cd955675-dq2n5\" (UID: \"cf09a8c4-e91f-4ee9-a501-b3a0dd5c2a07\") " pod="kuadrant-system/authorino-58cd955675-dq2n5" Jul 23 21:07:38.356614 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:38.356588 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jnrm\" (UniqueName: \"kubernetes.io/projected/cf09a8c4-e91f-4ee9-a501-b3a0dd5c2a07-kube-api-access-7jnrm\") pod \"authorino-58cd955675-dq2n5\" (UID: \"cf09a8c4-e91f-4ee9-a501-b3a0dd5c2a07\") " pod="kuadrant-system/authorino-58cd955675-dq2n5" Jul 23 21:07:38.483971 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:38.483882 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-dq2n5" Jul 23 21:07:38.612414 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:38.612304 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-dq2n5"] Jul 23 21:07:38.615248 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:07:38.615219 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf09a8c4_e91f_4ee9_a501_b3a0dd5c2a07.slice/crio-63c40c896b0e85eac6697a508a5063f195a859670f9c9c7a70a34d60741c4924 WatchSource:0}: Error finding container 63c40c896b0e85eac6697a508a5063f195a859670f9c9c7a70a34d60741c4924: Status 404 returned error can't find the container with id 63c40c896b0e85eac6697a508a5063f195a859670f9c9c7a70a34d60741c4924 Jul 23 21:07:39.494217 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:39.494180 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-dq2n5" event={"ID":"cf09a8c4-e91f-4ee9-a501-b3a0dd5c2a07","Type":"ContainerStarted","Data":"63c40c896b0e85eac6697a508a5063f195a859670f9c9c7a70a34d60741c4924"} Jul 23 21:07:42.513692 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:42.513650 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-dq2n5" event={"ID":"cf09a8c4-e91f-4ee9-a501-b3a0dd5c2a07","Type":"ContainerStarted","Data":"a44f63efef63655d93e07ec71da4343698c4ab4c75b3b91925119cbb639decb5"} Jul 23 21:07:42.527540 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:42.527491 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-dq2n5" podStartSLOduration=2.146147982 podStartE2EDuration="5.527474526s" totalImagesPullingTime="3.381326544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:07:42.526182057 +0000 UTC m=+500.088616043" watchObservedRunningTime="2026-07-23 21:07:42.527474526 +0000 UTC m=+500.089908510" Jul 23 21:07:42.802041 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:42.802008 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-dq2n5"] Jul 23 21:07:44.522727 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:44.522688 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-dq2n5" podUID="cf09a8c4-e91f-4ee9-a501-b3a0dd5c2a07" containerName="authorino" containerID="cri-o://a44f63efef63655d93e07ec71da4343698c4ab4c75b3b91925119cbb639decb5" gracePeriod=30 Jul 23 21:07:44.765714 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:44.765690 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-dq2n5" Jul 23 21:07:44.912342 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:44.912257 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jnrm\" (UniqueName: \"kubernetes.io/projected/cf09a8c4-e91f-4ee9-a501-b3a0dd5c2a07-kube-api-access-7jnrm\") pod \"cf09a8c4-e91f-4ee9-a501-b3a0dd5c2a07\" (UID: \"cf09a8c4-e91f-4ee9-a501-b3a0dd5c2a07\") " Jul 23 21:07:44.914348 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:44.914307 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf09a8c4-e91f-4ee9-a501-b3a0dd5c2a07-kube-api-access-7jnrm" (OuterVolumeSpecName: "kube-api-access-7jnrm") pod "cf09a8c4-e91f-4ee9-a501-b3a0dd5c2a07" (UID: "cf09a8c4-e91f-4ee9-a501-b3a0dd5c2a07"). InnerVolumeSpecName "kube-api-access-7jnrm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:07:45.013350 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:45.013319 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jnrm\" (UniqueName: \"kubernetes.io/projected/cf09a8c4-e91f-4ee9-a501-b3a0dd5c2a07-kube-api-access-7jnrm\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:07:45.528486 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:45.528444 2575 generic.go:356] "Generic (PLEG): container finished" podID="cf09a8c4-e91f-4ee9-a501-b3a0dd5c2a07" containerID="a44f63efef63655d93e07ec71da4343698c4ab4c75b3b91925119cbb639decb5" exitCode=0 Jul 23 21:07:45.528913 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:45.528505 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-dq2n5" Jul 23 21:07:45.528913 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:45.528520 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-dq2n5" event={"ID":"cf09a8c4-e91f-4ee9-a501-b3a0dd5c2a07","Type":"ContainerDied","Data":"a44f63efef63655d93e07ec71da4343698c4ab4c75b3b91925119cbb639decb5"} Jul 23 21:07:45.528913 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:45.528570 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-dq2n5" event={"ID":"cf09a8c4-e91f-4ee9-a501-b3a0dd5c2a07","Type":"ContainerDied","Data":"63c40c896b0e85eac6697a508a5063f195a859670f9c9c7a70a34d60741c4924"} Jul 23 21:07:45.528913 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:45.528588 2575 scope.go:117] "RemoveContainer" containerID="a44f63efef63655d93e07ec71da4343698c4ab4c75b3b91925119cbb639decb5" Jul 23 21:07:45.536912 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:45.536894 2575 scope.go:117] "RemoveContainer" containerID="a44f63efef63655d93e07ec71da4343698c4ab4c75b3b91925119cbb639decb5" Jul 23 21:07:45.537147 ip-10-0-139-105 kubenswrapper[2575]: E0723 21:07:45.537125 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a44f63efef63655d93e07ec71da4343698c4ab4c75b3b91925119cbb639decb5\": container with ID starting with a44f63efef63655d93e07ec71da4343698c4ab4c75b3b91925119cbb639decb5 not found: ID does not exist" containerID="a44f63efef63655d93e07ec71da4343698c4ab4c75b3b91925119cbb639decb5" Jul 23 21:07:45.537200 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:45.537154 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a44f63efef63655d93e07ec71da4343698c4ab4c75b3b91925119cbb639decb5"} err="failed to get container status \"a44f63efef63655d93e07ec71da4343698c4ab4c75b3b91925119cbb639decb5\": rpc error: code = NotFound desc = could not find container \"a44f63efef63655d93e07ec71da4343698c4ab4c75b3b91925119cbb639decb5\": container with ID starting with a44f63efef63655d93e07ec71da4343698c4ab4c75b3b91925119cbb639decb5 not found: ID does not exist" Jul 23 21:07:45.544987 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:45.544964 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-dq2n5"] Jul 23 21:07:45.551052 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:45.551030 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-dq2n5"] Jul 23 21:07:46.963378 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:46.963346 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf09a8c4-e91f-4ee9-a501-b3a0dd5c2a07" path="/var/lib/kubelet/pods/cf09a8c4-e91f-4ee9-a501-b3a0dd5c2a07/volumes" Jul 23 21:07:47.098963 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:47.098929 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:07:48.705057 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:48.705022 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:07:48.764779 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:48.764735 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:07:49.492460 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:49.492419 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-fd88c5d5b-nbk6j" podUID="bb71af3a-e358-41cd-9cfa-7753dcccbeac" containerName="console" containerID="cri-o://e961c9c1581b6d48f3e067d11d977bad0a8acfe09c0bfd28f0de6dc292b4a9f8" gracePeriod=15 Jul 23 21:07:49.732424 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:49.732398 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:07:49.865362 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:49.865328 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5z7k\" (UniqueName: \"kubernetes.io/projected/bb71af3a-e358-41cd-9cfa-7753dcccbeac-kube-api-access-k5z7k\") pod \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\" (UID: \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\") " Jul 23 21:07:49.865528 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:49.865373 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb71af3a-e358-41cd-9cfa-7753dcccbeac-service-ca\") pod \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\" (UID: \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\") " Jul 23 21:07:49.865528 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:49.865405 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb71af3a-e358-41cd-9cfa-7753dcccbeac-console-config\") pod \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\" (UID: \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\") " Jul 23 21:07:49.865528 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:49.865438 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb71af3a-e358-41cd-9cfa-7753dcccbeac-console-oauth-config\") pod \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\" (UID: \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\") " Jul 23 21:07:49.865528 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:49.865496 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb71af3a-e358-41cd-9cfa-7753dcccbeac-console-serving-cert\") pod \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\" (UID: \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\") " Jul 23 21:07:49.865674 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:49.865530 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb71af3a-e358-41cd-9cfa-7753dcccbeac-oauth-serving-cert\") pod \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\" (UID: \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\") " Jul 23 21:07:49.865674 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:49.865597 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb71af3a-e358-41cd-9cfa-7753dcccbeac-trusted-ca-bundle\") pod \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\" (UID: \"bb71af3a-e358-41cd-9cfa-7753dcccbeac\") " Jul 23 21:07:49.865952 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:49.865908 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb71af3a-e358-41cd-9cfa-7753dcccbeac-console-config" (OuterVolumeSpecName: "console-config") pod "bb71af3a-e358-41cd-9cfa-7753dcccbeac" (UID: "bb71af3a-e358-41cd-9cfa-7753dcccbeac"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:07:49.866090 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:49.865969 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb71af3a-e358-41cd-9cfa-7753dcccbeac-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bb71af3a-e358-41cd-9cfa-7753dcccbeac" (UID: "bb71af3a-e358-41cd-9cfa-7753dcccbeac"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:07:49.866090 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:49.866066 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb71af3a-e358-41cd-9cfa-7753dcccbeac-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bb71af3a-e358-41cd-9cfa-7753dcccbeac" (UID: "bb71af3a-e358-41cd-9cfa-7753dcccbeac"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:07:49.866202 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:49.866116 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb71af3a-e358-41cd-9cfa-7753dcccbeac-service-ca" (OuterVolumeSpecName: "service-ca") pod "bb71af3a-e358-41cd-9cfa-7753dcccbeac" (UID: "bb71af3a-e358-41cd-9cfa-7753dcccbeac"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:07:49.867652 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:49.867628 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb71af3a-e358-41cd-9cfa-7753dcccbeac-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bb71af3a-e358-41cd-9cfa-7753dcccbeac" (UID: "bb71af3a-e358-41cd-9cfa-7753dcccbeac"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:07:49.867652 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:49.867647 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb71af3a-e358-41cd-9cfa-7753dcccbeac-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bb71af3a-e358-41cd-9cfa-7753dcccbeac" (UID: "bb71af3a-e358-41cd-9cfa-7753dcccbeac"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:07:49.867802 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:49.867722 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb71af3a-e358-41cd-9cfa-7753dcccbeac-kube-api-access-k5z7k" (OuterVolumeSpecName: "kube-api-access-k5z7k") pod "bb71af3a-e358-41cd-9cfa-7753dcccbeac" (UID: "bb71af3a-e358-41cd-9cfa-7753dcccbeac"). InnerVolumeSpecName "kube-api-access-k5z7k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:07:49.967286 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:49.967248 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb71af3a-e358-41cd-9cfa-7753dcccbeac-trusted-ca-bundle\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:07:49.967286 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:49.967280 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5z7k\" (UniqueName: \"kubernetes.io/projected/bb71af3a-e358-41cd-9cfa-7753dcccbeac-kube-api-access-k5z7k\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:07:49.967286 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:49.967293 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb71af3a-e358-41cd-9cfa-7753dcccbeac-service-ca\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:07:49.967524 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:49.967305 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb71af3a-e358-41cd-9cfa-7753dcccbeac-console-config\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:07:49.967524 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:49.967318 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb71af3a-e358-41cd-9cfa-7753dcccbeac-console-oauth-config\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:07:49.967524 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:49.967331 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb71af3a-e358-41cd-9cfa-7753dcccbeac-console-serving-cert\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:07:49.967524 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:49.967342 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb71af3a-e358-41cd-9cfa-7753dcccbeac-oauth-serving-cert\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:07:50.564351 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:50.564309 2575 generic.go:356] "Generic (PLEG): container finished" podID="bb71af3a-e358-41cd-9cfa-7753dcccbeac" containerID="e961c9c1581b6d48f3e067d11d977bad0a8acfe09c0bfd28f0de6dc292b4a9f8" exitCode=0 Jul 23 21:07:50.564546 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:50.564371 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fd88c5d5b-nbk6j" Jul 23 21:07:50.564546 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:50.564380 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fd88c5d5b-nbk6j" event={"ID":"bb71af3a-e358-41cd-9cfa-7753dcccbeac","Type":"ContainerDied","Data":"e961c9c1581b6d48f3e067d11d977bad0a8acfe09c0bfd28f0de6dc292b4a9f8"} Jul 23 21:07:50.564546 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:50.564454 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fd88c5d5b-nbk6j" event={"ID":"bb71af3a-e358-41cd-9cfa-7753dcccbeac","Type":"ContainerDied","Data":"c3283f90c8eb95b9cea349473c18c646abdc655690ade876e6aba00748f848c9"} Jul 23 21:07:50.564546 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:50.564481 2575 scope.go:117] "RemoveContainer" containerID="e961c9c1581b6d48f3e067d11d977bad0a8acfe09c0bfd28f0de6dc292b4a9f8" Jul 23 21:07:50.573435 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:50.573417 2575 scope.go:117] "RemoveContainer" containerID="e961c9c1581b6d48f3e067d11d977bad0a8acfe09c0bfd28f0de6dc292b4a9f8" Jul 23 21:07:50.573695 ip-10-0-139-105 kubenswrapper[2575]: E0723 21:07:50.573672 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e961c9c1581b6d48f3e067d11d977bad0a8acfe09c0bfd28f0de6dc292b4a9f8\": container with ID starting with e961c9c1581b6d48f3e067d11d977bad0a8acfe09c0bfd28f0de6dc292b4a9f8 not found: ID does not exist" containerID="e961c9c1581b6d48f3e067d11d977bad0a8acfe09c0bfd28f0de6dc292b4a9f8" Jul 23 21:07:50.573761 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:50.573701 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e961c9c1581b6d48f3e067d11d977bad0a8acfe09c0bfd28f0de6dc292b4a9f8"} err="failed to get container status \"e961c9c1581b6d48f3e067d11d977bad0a8acfe09c0bfd28f0de6dc292b4a9f8\": rpc error: code = NotFound desc = could not find container \"e961c9c1581b6d48f3e067d11d977bad0a8acfe09c0bfd28f0de6dc292b4a9f8\": container with ID starting with e961c9c1581b6d48f3e067d11d977bad0a8acfe09c0bfd28f0de6dc292b4a9f8 not found: ID does not exist" Jul 23 21:07:50.585691 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:50.585663 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fd88c5d5b-nbk6j"] Jul 23 21:07:50.590130 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:50.590109 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fd88c5d5b-nbk6j"] Jul 23 21:07:50.963528 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:50.963448 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb71af3a-e358-41cd-9cfa-7753dcccbeac" path="/var/lib/kubelet/pods/bb71af3a-e358-41cd-9cfa-7753dcccbeac/volumes" Jul 23 21:07:56.927768 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:56.927729 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:07:57.028019 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:57.027985 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:07:57.333518 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:57.333486 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-htgfp"] Jul 23 21:07:57.333987 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:57.333970 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf09a8c4-e91f-4ee9-a501-b3a0dd5c2a07" containerName="authorino" Jul 23 21:07:57.334091 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:57.333990 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf09a8c4-e91f-4ee9-a501-b3a0dd5c2a07" containerName="authorino" Jul 23 21:07:57.334091 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:57.334017 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb71af3a-e358-41cd-9cfa-7753dcccbeac" containerName="console" Jul 23 21:07:57.334091 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:57.334025 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb71af3a-e358-41cd-9cfa-7753dcccbeac" containerName="console" Jul 23 21:07:57.334243 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:57.334103 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb71af3a-e358-41cd-9cfa-7753dcccbeac" containerName="console" Jul 23 21:07:57.334243 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:57.334118 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf09a8c4-e91f-4ee9-a501-b3a0dd5c2a07" containerName="authorino" Jul 23 21:07:57.337542 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:57.337520 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-htgfp" Jul 23 21:07:57.339774 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:57.339752 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 23 21:07:57.339916 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:57.339872 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 23 21:07:57.339916 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:57.339895 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-7dntm\"" Jul 23 21:07:57.340034 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:57.339916 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 23 21:07:57.351829 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:57.349282 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-htgfp"] Jul 23 21:07:57.371974 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:57.371942 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:07:57.435130 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:57.435100 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/45c491bc-abc0-4259-baf4-7ccf36cc98fb-data\") pod \"postgres-69fb4594cf-htgfp\" (UID: \"45c491bc-abc0-4259-baf4-7ccf36cc98fb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-htgfp" Jul 23 21:07:57.435264 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:57.435229 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9xwz\" (UniqueName: \"kubernetes.io/projected/45c491bc-abc0-4259-baf4-7ccf36cc98fb-kube-api-access-k9xwz\") pod \"postgres-69fb4594cf-htgfp\" (UID: \"45c491bc-abc0-4259-baf4-7ccf36cc98fb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-htgfp" Jul 23 21:07:57.536667 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:57.536632 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/45c491bc-abc0-4259-baf4-7ccf36cc98fb-data\") pod \"postgres-69fb4594cf-htgfp\" (UID: \"45c491bc-abc0-4259-baf4-7ccf36cc98fb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-htgfp" Jul 23 21:07:57.536818 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:57.536731 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9xwz\" (UniqueName: \"kubernetes.io/projected/45c491bc-abc0-4259-baf4-7ccf36cc98fb-kube-api-access-k9xwz\") pod \"postgres-69fb4594cf-htgfp\" (UID: \"45c491bc-abc0-4259-baf4-7ccf36cc98fb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-htgfp" Jul 23 21:07:57.537026 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:57.537006 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/45c491bc-abc0-4259-baf4-7ccf36cc98fb-data\") pod \"postgres-69fb4594cf-htgfp\" (UID: \"45c491bc-abc0-4259-baf4-7ccf36cc98fb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-htgfp" Jul 23 21:07:57.552799 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:57.552774 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9xwz\" (UniqueName: \"kubernetes.io/projected/45c491bc-abc0-4259-baf4-7ccf36cc98fb-kube-api-access-k9xwz\") pod \"postgres-69fb4594cf-htgfp\" (UID: \"45c491bc-abc0-4259-baf4-7ccf36cc98fb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-htgfp" Jul 23 21:07:57.661217 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:57.661122 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-htgfp" Jul 23 21:07:57.672190 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:57.672163 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:07:57.795937 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:57.795915 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-htgfp"] Jul 23 21:07:57.797541 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:07:57.797514 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45c491bc_abc0_4259_baf4_7ccf36cc98fb.slice/crio-ea580f3a7b0c8834af47ea660b4f10b076147a9b9faee0cb48a78cab966ae320 WatchSource:0}: Error finding container ea580f3a7b0c8834af47ea660b4f10b076147a9b9faee0cb48a78cab966ae320: Status 404 returned error can't find the container with id ea580f3a7b0c8834af47ea660b4f10b076147a9b9faee0cb48a78cab966ae320 Jul 23 21:07:58.603465 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:07:58.603433 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-htgfp" event={"ID":"45c491bc-abc0-4259-baf4-7ccf36cc98fb","Type":"ContainerStarted","Data":"ea580f3a7b0c8834af47ea660b4f10b076147a9b9faee0cb48a78cab966ae320"} Jul 23 21:08:03.641244 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:03.641211 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-htgfp" event={"ID":"45c491bc-abc0-4259-baf4-7ccf36cc98fb","Type":"ContainerStarted","Data":"8fd1dfae759ce4b860c39284da0fc7ff00dfb510c5e2d4f92bfbfde429f13400"} Jul 23 21:08:03.641656 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:03.641329 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-htgfp" Jul 23 21:08:03.659990 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:03.659932 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-htgfp" podStartSLOduration=1.598320631 podStartE2EDuration="6.659910812s" totalImagesPullingTime="5.061590181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:07:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:08:03.657495112 +0000 UTC m=+521.219929098" watchObservedRunningTime="2026-07-23 21:08:03.659910812 +0000 UTC m=+521.222344801" Jul 23 21:08:09.677732 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:09.677705 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-htgfp" Jul 23 21:08:10.001314 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:10.001223 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:08:10.216017 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:10.215969 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4mk2t"] Jul 23 21:08:10.222594 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:10.222571 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4mk2t" Jul 23 21:08:10.224900 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:10.224852 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xr9t7\"" Jul 23 21:08:10.225779 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:10.225749 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4mk2t"] Jul 23 21:08:10.243520 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:10.243489 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-799zz\" (UniqueName: \"kubernetes.io/projected/b1f85c72-c4fc-4b2d-a064-4503967fd256-kube-api-access-799zz\") pod \"authorino-5d4b67c446-4mk2t\" (UID: \"b1f85c72-c4fc-4b2d-a064-4503967fd256\") " pod="kuadrant-system/authorino-5d4b67c446-4mk2t" Jul 23 21:08:10.344144 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:10.344105 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-799zz\" (UniqueName: \"kubernetes.io/projected/b1f85c72-c4fc-4b2d-a064-4503967fd256-kube-api-access-799zz\") pod \"authorino-5d4b67c446-4mk2t\" (UID: \"b1f85c72-c4fc-4b2d-a064-4503967fd256\") " pod="kuadrant-system/authorino-5d4b67c446-4mk2t" Jul 23 21:08:10.352706 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:10.352676 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-799zz\" (UniqueName: \"kubernetes.io/projected/b1f85c72-c4fc-4b2d-a064-4503967fd256-kube-api-access-799zz\") pod \"authorino-5d4b67c446-4mk2t\" (UID: \"b1f85c72-c4fc-4b2d-a064-4503967fd256\") " pod="kuadrant-system/authorino-5d4b67c446-4mk2t" Jul 23 21:08:10.433102 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:10.433073 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:08:10.455583 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:10.455543 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4mk2t"] Jul 23 21:08:10.455893 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:10.455848 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4mk2t" Jul 23 21:08:10.481063 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:10.481035 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76dcb866b9-md9g8"] Jul 23 21:08:10.486350 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:10.486326 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76dcb866b9-md9g8" Jul 23 21:08:10.491308 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:10.491283 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76dcb866b9-md9g8"] Jul 23 21:08:10.546529 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:10.546497 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnnkj\" (UniqueName: \"kubernetes.io/projected/c80272d4-8982-4bef-a564-dc367043357b-kube-api-access-hnnkj\") pod \"authorino-76dcb866b9-md9g8\" (UID: \"c80272d4-8982-4bef-a564-dc367043357b\") " pod="kuadrant-system/authorino-76dcb866b9-md9g8" Jul 23 21:08:10.589371 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:10.589343 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4mk2t"] Jul 23 21:08:10.591392 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:08:10.591366 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1f85c72_c4fc_4b2d_a064_4503967fd256.slice/crio-3e8a518ee55aa33d8dd51bc1bd54a3bdb9f155aa02898039b6cce5c64ad9fd5b WatchSource:0}: Error finding container 3e8a518ee55aa33d8dd51bc1bd54a3bdb9f155aa02898039b6cce5c64ad9fd5b: Status 404 returned error can't find the container with id 3e8a518ee55aa33d8dd51bc1bd54a3bdb9f155aa02898039b6cce5c64ad9fd5b Jul 23 21:08:10.647751 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:10.647715 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnnkj\" (UniqueName: \"kubernetes.io/projected/c80272d4-8982-4bef-a564-dc367043357b-kube-api-access-hnnkj\") pod \"authorino-76dcb866b9-md9g8\" (UID: \"c80272d4-8982-4bef-a564-dc367043357b\") " pod="kuadrant-system/authorino-76dcb866b9-md9g8" Jul 23 21:08:10.656192 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:10.656161 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnnkj\" (UniqueName: \"kubernetes.io/projected/c80272d4-8982-4bef-a564-dc367043357b-kube-api-access-hnnkj\") pod \"authorino-76dcb866b9-md9g8\" (UID: \"c80272d4-8982-4bef-a564-dc367043357b\") " pod="kuadrant-system/authorino-76dcb866b9-md9g8" Jul 23 21:08:10.677303 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:10.677272 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-4mk2t" event={"ID":"b1f85c72-c4fc-4b2d-a064-4503967fd256","Type":"ContainerStarted","Data":"3e8a518ee55aa33d8dd51bc1bd54a3bdb9f155aa02898039b6cce5c64ad9fd5b"} Jul 23 21:08:10.730452 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:10.730413 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76dcb866b9-md9g8"] Jul 23 21:08:10.730839 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:10.730706 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76dcb866b9-md9g8" Jul 23 21:08:10.862066 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:10.862038 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76dcb866b9-md9g8"] Jul 23 21:08:10.864352 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:08:10.864325 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc80272d4_8982_4bef_a564_dc367043357b.slice/crio-fd3569c963ae112e6e88fd27753ce40ff6cd31679a90ca9f1b3aab4705da8004 WatchSource:0}: Error finding container fd3569c963ae112e6e88fd27753ce40ff6cd31679a90ca9f1b3aab4705da8004: Status 404 returned error can't find the container with id fd3569c963ae112e6e88fd27753ce40ff6cd31679a90ca9f1b3aab4705da8004 Jul 23 21:08:11.683611 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:11.683518 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-4mk2t" event={"ID":"b1f85c72-c4fc-4b2d-a064-4503967fd256","Type":"ContainerStarted","Data":"c4aa520f23e6ba372d442836c8f6948d5ae14eaee85b8ceffdf7f0b25478ca06"} Jul 23 21:08:11.683611 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:11.683588 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-4mk2t" podUID="b1f85c72-c4fc-4b2d-a064-4503967fd256" containerName="authorino" containerID="cri-o://c4aa520f23e6ba372d442836c8f6948d5ae14eaee85b8ceffdf7f0b25478ca06" gracePeriod=30 Jul 23 21:08:11.685161 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:11.685139 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-76dcb866b9-md9g8" podUID="c80272d4-8982-4bef-a564-dc367043357b" containerName="authorino" containerID="cri-o://76df677dae97dd759bc140170d30826c1ef9efe0a18e7e8b799cb0ae5b997f92" gracePeriod=30 Jul 23 21:08:11.685249 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:11.685141 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76dcb866b9-md9g8" event={"ID":"c80272d4-8982-4bef-a564-dc367043357b","Type":"ContainerStarted","Data":"76df677dae97dd759bc140170d30826c1ef9efe0a18e7e8b799cb0ae5b997f92"} Jul 23 21:08:11.685249 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:11.685223 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76dcb866b9-md9g8" event={"ID":"c80272d4-8982-4bef-a564-dc367043357b","Type":"ContainerStarted","Data":"fd3569c963ae112e6e88fd27753ce40ff6cd31679a90ca9f1b3aab4705da8004"} Jul 23 21:08:11.699785 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:11.699741 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-4mk2t" podStartSLOduration=1.3484653180000001 podStartE2EDuration="1.699704806s" totalImagesPullingTime="351.239488ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:08:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:08:11.697301773 +0000 UTC m=+529.259735757" watchObservedRunningTime="2026-07-23 21:08:11.699704806 +0000 UTC m=+529.262138791" Jul 23 21:08:11.711575 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:11.711526 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-76dcb866b9-md9g8" podStartSLOduration=1.285154203 podStartE2EDuration="1.711511688s" totalImagesPullingTime="426.357485ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:08:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:08:11.709785165 +0000 UTC m=+529.272219150" watchObservedRunningTime="2026-07-23 21:08:11.711511688 +0000 UTC m=+529.273945673" Jul 23 21:08:11.956235 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:11.956213 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4mk2t" Jul 23 21:08:11.961616 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:11.961594 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76dcb866b9-md9g8" Jul 23 21:08:12.061013 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:12.060967 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnnkj\" (UniqueName: \"kubernetes.io/projected/c80272d4-8982-4bef-a564-dc367043357b-kube-api-access-hnnkj\") pod \"c80272d4-8982-4bef-a564-dc367043357b\" (UID: \"c80272d4-8982-4bef-a564-dc367043357b\") " Jul 23 21:08:12.061013 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:12.061018 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-799zz\" (UniqueName: \"kubernetes.io/projected/b1f85c72-c4fc-4b2d-a064-4503967fd256-kube-api-access-799zz\") pod \"b1f85c72-c4fc-4b2d-a064-4503967fd256\" (UID: \"b1f85c72-c4fc-4b2d-a064-4503967fd256\") " Jul 23 21:08:12.063165 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:12.063139 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c80272d4-8982-4bef-a564-dc367043357b-kube-api-access-hnnkj" (OuterVolumeSpecName: "kube-api-access-hnnkj") pod "c80272d4-8982-4bef-a564-dc367043357b" (UID: "c80272d4-8982-4bef-a564-dc367043357b"). InnerVolumeSpecName "kube-api-access-hnnkj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:08:12.063165 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:12.063152 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1f85c72-c4fc-4b2d-a064-4503967fd256-kube-api-access-799zz" (OuterVolumeSpecName: "kube-api-access-799zz") pod "b1f85c72-c4fc-4b2d-a064-4503967fd256" (UID: "b1f85c72-c4fc-4b2d-a064-4503967fd256"). InnerVolumeSpecName "kube-api-access-799zz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:08:12.161887 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:12.161833 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnnkj\" (UniqueName: \"kubernetes.io/projected/c80272d4-8982-4bef-a564-dc367043357b-kube-api-access-hnnkj\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:08:12.161887 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:12.161857 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-799zz\" (UniqueName: \"kubernetes.io/projected/b1f85c72-c4fc-4b2d-a064-4503967fd256-kube-api-access-799zz\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:08:12.691472 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:12.691391 2575 generic.go:356] "Generic (PLEG): container finished" podID="b1f85c72-c4fc-4b2d-a064-4503967fd256" containerID="c4aa520f23e6ba372d442836c8f6948d5ae14eaee85b8ceffdf7f0b25478ca06" exitCode=0 Jul 23 21:08:12.691472 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:12.691437 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4mk2t" Jul 23 21:08:12.691472 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:12.691463 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-4mk2t" event={"ID":"b1f85c72-c4fc-4b2d-a064-4503967fd256","Type":"ContainerDied","Data":"c4aa520f23e6ba372d442836c8f6948d5ae14eaee85b8ceffdf7f0b25478ca06"} Jul 23 21:08:12.691732 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:12.691499 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-4mk2t" event={"ID":"b1f85c72-c4fc-4b2d-a064-4503967fd256","Type":"ContainerDied","Data":"3e8a518ee55aa33d8dd51bc1bd54a3bdb9f155aa02898039b6cce5c64ad9fd5b"} Jul 23 21:08:12.691732 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:12.691517 2575 scope.go:117] "RemoveContainer" containerID="c4aa520f23e6ba372d442836c8f6948d5ae14eaee85b8ceffdf7f0b25478ca06" Jul 23 21:08:12.692842 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:12.692650 2575 generic.go:356] "Generic (PLEG): container finished" podID="c80272d4-8982-4bef-a564-dc367043357b" containerID="76df677dae97dd759bc140170d30826c1ef9efe0a18e7e8b799cb0ae5b997f92" exitCode=0 Jul 23 21:08:12.692842 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:12.692682 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76dcb866b9-md9g8" event={"ID":"c80272d4-8982-4bef-a564-dc367043357b","Type":"ContainerDied","Data":"76df677dae97dd759bc140170d30826c1ef9efe0a18e7e8b799cb0ae5b997f92"} Jul 23 21:08:12.692842 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:12.692720 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76dcb866b9-md9g8" event={"ID":"c80272d4-8982-4bef-a564-dc367043357b","Type":"ContainerDied","Data":"fd3569c963ae112e6e88fd27753ce40ff6cd31679a90ca9f1b3aab4705da8004"} Jul 23 21:08:12.692842 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:12.692690 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76dcb866b9-md9g8" Jul 23 21:08:12.701278 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:12.701261 2575 scope.go:117] "RemoveContainer" containerID="c4aa520f23e6ba372d442836c8f6948d5ae14eaee85b8ceffdf7f0b25478ca06" Jul 23 21:08:12.701528 ip-10-0-139-105 kubenswrapper[2575]: E0723 21:08:12.701508 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4aa520f23e6ba372d442836c8f6948d5ae14eaee85b8ceffdf7f0b25478ca06\": container with ID starting with c4aa520f23e6ba372d442836c8f6948d5ae14eaee85b8ceffdf7f0b25478ca06 not found: ID does not exist" containerID="c4aa520f23e6ba372d442836c8f6948d5ae14eaee85b8ceffdf7f0b25478ca06" Jul 23 21:08:12.701629 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:12.701533 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4aa520f23e6ba372d442836c8f6948d5ae14eaee85b8ceffdf7f0b25478ca06"} err="failed to get container status \"c4aa520f23e6ba372d442836c8f6948d5ae14eaee85b8ceffdf7f0b25478ca06\": rpc error: code = NotFound desc = could not find container \"c4aa520f23e6ba372d442836c8f6948d5ae14eaee85b8ceffdf7f0b25478ca06\": container with ID starting with c4aa520f23e6ba372d442836c8f6948d5ae14eaee85b8ceffdf7f0b25478ca06 not found: ID does not exist" Jul 23 21:08:12.701629 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:12.701548 2575 scope.go:117] "RemoveContainer" containerID="76df677dae97dd759bc140170d30826c1ef9efe0a18e7e8b799cb0ae5b997f92" Jul 23 21:08:12.709524 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:12.709504 2575 scope.go:117] "RemoveContainer" containerID="76df677dae97dd759bc140170d30826c1ef9efe0a18e7e8b799cb0ae5b997f92" Jul 23 21:08:12.709755 ip-10-0-139-105 kubenswrapper[2575]: E0723 21:08:12.709738 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76df677dae97dd759bc140170d30826c1ef9efe0a18e7e8b799cb0ae5b997f92\": container with ID starting with 76df677dae97dd759bc140170d30826c1ef9efe0a18e7e8b799cb0ae5b997f92 not found: ID does not exist" containerID="76df677dae97dd759bc140170d30826c1ef9efe0a18e7e8b799cb0ae5b997f92" Jul 23 21:08:12.709802 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:12.709763 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76df677dae97dd759bc140170d30826c1ef9efe0a18e7e8b799cb0ae5b997f92"} err="failed to get container status \"76df677dae97dd759bc140170d30826c1ef9efe0a18e7e8b799cb0ae5b997f92\": rpc error: code = NotFound desc = could not find container \"76df677dae97dd759bc140170d30826c1ef9efe0a18e7e8b799cb0ae5b997f92\": container with ID starting with 76df677dae97dd759bc140170d30826c1ef9efe0a18e7e8b799cb0ae5b997f92 not found: ID does not exist" Jul 23 21:08:12.712531 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:12.712511 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4mk2t"] Jul 23 21:08:12.715128 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:12.715111 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4mk2t"] Jul 23 21:08:12.724818 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:12.724799 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76dcb866b9-md9g8"] Jul 23 21:08:12.729250 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:12.729229 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76dcb866b9-md9g8"] Jul 23 21:08:12.968065 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:12.966193 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1f85c72-c4fc-4b2d-a064-4503967fd256" path="/var/lib/kubelet/pods/b1f85c72-c4fc-4b2d-a064-4503967fd256/volumes" Jul 23 21:08:12.968065 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:12.966782 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c80272d4-8982-4bef-a564-dc367043357b" path="/var/lib/kubelet/pods/c80272d4-8982-4bef-a564-dc367043357b/volumes" Jul 23 21:08:17.525923 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.525824 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-77c6dc999d-nqkzj"] Jul 23 21:08:17.526389 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.526258 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1f85c72-c4fc-4b2d-a064-4503967fd256" containerName="authorino" Jul 23 21:08:17.526389 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.526281 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1f85c72-c4fc-4b2d-a064-4503967fd256" containerName="authorino" Jul 23 21:08:17.526389 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.526292 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c80272d4-8982-4bef-a564-dc367043357b" containerName="authorino" Jul 23 21:08:17.526389 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.526298 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c80272d4-8982-4bef-a564-dc367043357b" containerName="authorino" Jul 23 21:08:17.526389 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.526355 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c80272d4-8982-4bef-a564-dc367043357b" containerName="authorino" Jul 23 21:08:17.526389 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.526366 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1f85c72-c4fc-4b2d-a064-4503967fd256" containerName="authorino" Jul 23 21:08:17.528420 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.528394 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:08:17.621134 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.621100 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:08:17.628318 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.628297 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77c6dc999d-nqkzj"] Jul 23 21:08:17.628405 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.628382 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77c6dc999d-nqkzj" Jul 23 21:08:17.630694 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.630671 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 23 21:08:17.630694 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.630683 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 23 21:08:17.630841 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.630722 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tvsjf\"" Jul 23 21:08:17.671309 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.671272 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:08:17.703140 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.703111 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b956f9cf6-dpcmv"] Jul 23 21:08:17.715989 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.715961 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr7zx\" (UniqueName: \"kubernetes.io/projected/641f1abf-053d-474c-991b-e411727db63a-kube-api-access-xr7zx\") pod \"maas-controller-77c6dc999d-nqkzj\" (UID: \"641f1abf-053d-474c-991b-e411727db63a\") " pod="opendatahub/maas-controller-77c6dc999d-nqkzj" Jul 23 21:08:17.716150 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.716109 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/641f1abf-053d-474c-991b-e411727db63a-webhook-cert\") pod \"maas-controller-77c6dc999d-nqkzj\" (UID: \"641f1abf-053d-474c-991b-e411727db63a\") " pod="opendatahub/maas-controller-77c6dc999d-nqkzj" Jul 23 21:08:17.725857 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.725834 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b956f9cf6-dpcmv"] Jul 23 21:08:17.725996 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.725955 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b956f9cf6-dpcmv" Jul 23 21:08:17.817171 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.817069 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/641f1abf-053d-474c-991b-e411727db63a-webhook-cert\") pod \"maas-controller-77c6dc999d-nqkzj\" (UID: \"641f1abf-053d-474c-991b-e411727db63a\") " pod="opendatahub/maas-controller-77c6dc999d-nqkzj" Jul 23 21:08:17.817171 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.817125 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxr2h\" (UniqueName: \"kubernetes.io/projected/0ba009eb-7441-4054-b357-56730a13f340-kube-api-access-fxr2h\") pod \"maas-controller-b956f9cf6-dpcmv\" (UID: \"0ba009eb-7441-4054-b357-56730a13f340\") " pod="opendatahub/maas-controller-b956f9cf6-dpcmv" Jul 23 21:08:17.817171 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.817167 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr7zx\" (UniqueName: \"kubernetes.io/projected/641f1abf-053d-474c-991b-e411727db63a-kube-api-access-xr7zx\") pod \"maas-controller-77c6dc999d-nqkzj\" (UID: \"641f1abf-053d-474c-991b-e411727db63a\") " pod="opendatahub/maas-controller-77c6dc999d-nqkzj" Jul 23 21:08:17.817461 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.817196 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ba009eb-7441-4054-b357-56730a13f340-webhook-cert\") pod \"maas-controller-b956f9cf6-dpcmv\" (UID: \"0ba009eb-7441-4054-b357-56730a13f340\") " pod="opendatahub/maas-controller-b956f9cf6-dpcmv" Jul 23 21:08:17.819527 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.819508 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/641f1abf-053d-474c-991b-e411727db63a-webhook-cert\") pod \"maas-controller-77c6dc999d-nqkzj\" (UID: \"641f1abf-053d-474c-991b-e411727db63a\") " pod="opendatahub/maas-controller-77c6dc999d-nqkzj" Jul 23 21:08:17.824402 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.824383 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr7zx\" (UniqueName: \"kubernetes.io/projected/641f1abf-053d-474c-991b-e411727db63a-kube-api-access-xr7zx\") pod \"maas-controller-77c6dc999d-nqkzj\" (UID: \"641f1abf-053d-474c-991b-e411727db63a\") " pod="opendatahub/maas-controller-77c6dc999d-nqkzj" Jul 23 21:08:17.830367 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.830326 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:08:17.917662 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.917617 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxr2h\" (UniqueName: \"kubernetes.io/projected/0ba009eb-7441-4054-b357-56730a13f340-kube-api-access-fxr2h\") pod \"maas-controller-b956f9cf6-dpcmv\" (UID: \"0ba009eb-7441-4054-b357-56730a13f340\") " pod="opendatahub/maas-controller-b956f9cf6-dpcmv" Jul 23 21:08:17.917839 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.917685 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ba009eb-7441-4054-b357-56730a13f340-webhook-cert\") pod \"maas-controller-b956f9cf6-dpcmv\" (UID: \"0ba009eb-7441-4054-b357-56730a13f340\") " pod="opendatahub/maas-controller-b956f9cf6-dpcmv" Jul 23 21:08:17.920174 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.920142 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ba009eb-7441-4054-b357-56730a13f340-webhook-cert\") pod \"maas-controller-b956f9cf6-dpcmv\" (UID: \"0ba009eb-7441-4054-b357-56730a13f340\") " pod="opendatahub/maas-controller-b956f9cf6-dpcmv" Jul 23 21:08:17.924926 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.924907 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxr2h\" (UniqueName: \"kubernetes.io/projected/0ba009eb-7441-4054-b357-56730a13f340-kube-api-access-fxr2h\") pod \"maas-controller-b956f9cf6-dpcmv\" (UID: \"0ba009eb-7441-4054-b357-56730a13f340\") " pod="opendatahub/maas-controller-b956f9cf6-dpcmv" Jul 23 21:08:17.938820 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:17.938795 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77c6dc999d-nqkzj" Jul 23 21:08:18.036039 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:18.036006 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b956f9cf6-dpcmv" Jul 23 21:08:18.091213 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:18.091171 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77c6dc999d-nqkzj"] Jul 23 21:08:18.094552 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:08:18.094521 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod641f1abf_053d_474c_991b_e411727db63a.slice/crio-9308b478c9da043233fb975562b8e040b47a86f84f6103c8922d52ffe9389a04 WatchSource:0}: Error finding container 9308b478c9da043233fb975562b8e040b47a86f84f6103c8922d52ffe9389a04: Status 404 returned error can't find the container with id 9308b478c9da043233fb975562b8e040b47a86f84f6103c8922d52ffe9389a04 Jul 23 21:08:18.211120 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:18.211087 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b956f9cf6-dpcmv"] Jul 23 21:08:18.214035 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:08:18.214009 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ba009eb_7441_4054_b357_56730a13f340.slice/crio-8b6634c1178eda66a1a94d53ce94b0071d6875ee818c63c235cbdff6d3fa83e7 WatchSource:0}: Error finding container 8b6634c1178eda66a1a94d53ce94b0071d6875ee818c63c235cbdff6d3fa83e7: Status 404 returned error can't find the container with id 8b6634c1178eda66a1a94d53ce94b0071d6875ee818c63c235cbdff6d3fa83e7 Jul 23 21:08:18.729019 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:18.728967 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b956f9cf6-dpcmv" event={"ID":"0ba009eb-7441-4054-b357-56730a13f340","Type":"ContainerStarted","Data":"8b6634c1178eda66a1a94d53ce94b0071d6875ee818c63c235cbdff6d3fa83e7"} Jul 23 21:08:18.730357 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:18.730327 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77c6dc999d-nqkzj" event={"ID":"641f1abf-053d-474c-991b-e411727db63a","Type":"ContainerStarted","Data":"9308b478c9da043233fb975562b8e040b47a86f84f6103c8922d52ffe9389a04"} Jul 23 21:08:20.746803 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:20.746762 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77c6dc999d-nqkzj" event={"ID":"641f1abf-053d-474c-991b-e411727db63a","Type":"ContainerStarted","Data":"c3676f3ebb942ceaa5611577f97801841d87a2ef0905ca15d4846a3b39fefa71"} Jul 23 21:08:20.747261 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:20.746824 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77c6dc999d-nqkzj" Jul 23 21:08:20.748772 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:20.748746 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b956f9cf6-dpcmv" event={"ID":"0ba009eb-7441-4054-b357-56730a13f340","Type":"ContainerStarted","Data":"1b9e485e7601ceac3dfc118f2f8226b9fabe641f4f2ffb6fbe7c9221d66baf79"} Jul 23 21:08:20.748939 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:20.748918 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b956f9cf6-dpcmv" Jul 23 21:08:20.792376 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:20.792317 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-77c6dc999d-nqkzj" podStartSLOduration=1.271977307 podStartE2EDuration="3.792300249s" totalImagesPullingTime="2.520322942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:08:20.786545529 +0000 UTC m=+538.348979515" watchObservedRunningTime="2026-07-23 21:08:20.792300249 +0000 UTC m=+538.354734233" Jul 23 21:08:20.814684 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:20.814649 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:08:20.824043 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:20.823996 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-b956f9cf6-dpcmv" podStartSLOduration=1.432754095 podStartE2EDuration="3.823979858s" totalImagesPullingTime="2.391225763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:08:20.820959192 +0000 UTC m=+538.383393178" watchObservedRunningTime="2026-07-23 21:08:20.823979858 +0000 UTC m=+538.386413843" Jul 23 21:08:20.929946 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:20.929849 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:08:31.757790 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:31.757757 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b956f9cf6-dpcmv" Jul 23 21:08:31.758308 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:31.757918 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-77c6dc999d-nqkzj" Jul 23 21:08:31.817922 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:31.817887 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77c6dc999d-nqkzj"] Jul 23 21:08:31.818120 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:31.818091 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-77c6dc999d-nqkzj" podUID="641f1abf-053d-474c-991b-e411727db63a" containerName="manager" containerID="cri-o://c3676f3ebb942ceaa5611577f97801841d87a2ef0905ca15d4846a3b39fefa71" gracePeriod=30 Jul 23 21:08:32.064593 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:32.064569 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77c6dc999d-nqkzj" Jul 23 21:08:32.151385 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:32.151354 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/641f1abf-053d-474c-991b-e411727db63a-webhook-cert\") pod \"641f1abf-053d-474c-991b-e411727db63a\" (UID: \"641f1abf-053d-474c-991b-e411727db63a\") " Jul 23 21:08:32.151581 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:32.151399 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xr7zx\" (UniqueName: \"kubernetes.io/projected/641f1abf-053d-474c-991b-e411727db63a-kube-api-access-xr7zx\") pod \"641f1abf-053d-474c-991b-e411727db63a\" (UID: \"641f1abf-053d-474c-991b-e411727db63a\") " Jul 23 21:08:32.153501 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:32.153473 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/641f1abf-053d-474c-991b-e411727db63a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "641f1abf-053d-474c-991b-e411727db63a" (UID: "641f1abf-053d-474c-991b-e411727db63a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:08:32.153614 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:32.153531 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/641f1abf-053d-474c-991b-e411727db63a-kube-api-access-xr7zx" (OuterVolumeSpecName: "kube-api-access-xr7zx") pod "641f1abf-053d-474c-991b-e411727db63a" (UID: "641f1abf-053d-474c-991b-e411727db63a"). InnerVolumeSpecName "kube-api-access-xr7zx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:08:32.252371 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:32.252334 2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/641f1abf-053d-474c-991b-e411727db63a-webhook-cert\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:08:32.252371 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:32.252362 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xr7zx\" (UniqueName: \"kubernetes.io/projected/641f1abf-053d-474c-991b-e411727db63a-kube-api-access-xr7zx\") on node \"ip-10-0-139-105.ec2.internal\" DevicePath \"\"" Jul 23 21:08:32.810007 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:32.809975 2575 generic.go:356] "Generic (PLEG): container finished" podID="641f1abf-053d-474c-991b-e411727db63a" containerID="c3676f3ebb942ceaa5611577f97801841d87a2ef0905ca15d4846a3b39fefa71" exitCode=0 Jul 23 21:08:32.810465 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:32.810016 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77c6dc999d-nqkzj" Jul 23 21:08:32.810465 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:32.810051 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77c6dc999d-nqkzj" event={"ID":"641f1abf-053d-474c-991b-e411727db63a","Type":"ContainerDied","Data":"c3676f3ebb942ceaa5611577f97801841d87a2ef0905ca15d4846a3b39fefa71"} Jul 23 21:08:32.810465 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:32.810090 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77c6dc999d-nqkzj" event={"ID":"641f1abf-053d-474c-991b-e411727db63a","Type":"ContainerDied","Data":"9308b478c9da043233fb975562b8e040b47a86f84f6103c8922d52ffe9389a04"} Jul 23 21:08:32.810465 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:32.810112 2575 scope.go:117] "RemoveContainer" containerID="c3676f3ebb942ceaa5611577f97801841d87a2ef0905ca15d4846a3b39fefa71" Jul 23 21:08:32.818995 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:32.818814 2575 scope.go:117] "RemoveContainer" containerID="c3676f3ebb942ceaa5611577f97801841d87a2ef0905ca15d4846a3b39fefa71" Jul 23 21:08:32.819097 ip-10-0-139-105 kubenswrapper[2575]: E0723 21:08:32.819079 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3676f3ebb942ceaa5611577f97801841d87a2ef0905ca15d4846a3b39fefa71\": container with ID starting with c3676f3ebb942ceaa5611577f97801841d87a2ef0905ca15d4846a3b39fefa71 not found: ID does not exist" containerID="c3676f3ebb942ceaa5611577f97801841d87a2ef0905ca15d4846a3b39fefa71" Jul 23 21:08:32.819140 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:32.819107 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3676f3ebb942ceaa5611577f97801841d87a2ef0905ca15d4846a3b39fefa71"} err="failed to get container status \"c3676f3ebb942ceaa5611577f97801841d87a2ef0905ca15d4846a3b39fefa71\": rpc error: code = NotFound desc = could not find container \"c3676f3ebb942ceaa5611577f97801841d87a2ef0905ca15d4846a3b39fefa71\": container with ID starting with c3676f3ebb942ceaa5611577f97801841d87a2ef0905ca15d4846a3b39fefa71 not found: ID does not exist" Jul 23 21:08:32.830205 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:32.830182 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77c6dc999d-nqkzj"] Jul 23 21:08:32.836424 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:32.836404 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-77c6dc999d-nqkzj"] Jul 23 21:08:32.963762 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:32.963735 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="641f1abf-053d-474c-991b-e411727db63a" path="/var/lib/kubelet/pods/641f1abf-053d-474c-991b-e411727db63a/volumes" Jul 23 21:08:34.211200 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:34.211161 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:08:34.556292 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:34.556259 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:08:40.003819 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:40.003788 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:08:52.544736 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:52.544687 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:08:52.641042 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:52.641002 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:08:53.237562 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:53.237525 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:08:53.372018 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:53.371983 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-8554f97c95-qpxhz"] Jul 23 21:08:53.372373 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:53.372360 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="641f1abf-053d-474c-991b-e411727db63a" containerName="manager" Jul 23 21:08:53.372416 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:53.372374 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="641f1abf-053d-474c-991b-e411727db63a" containerName="manager" Jul 23 21:08:53.372470 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:53.372461 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="641f1abf-053d-474c-991b-e411727db63a" containerName="manager" Jul 23 21:08:53.376961 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:53.376944 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8554f97c95-qpxhz" Jul 23 21:08:53.380049 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:53.380029 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tjdv7\"" Jul 23 21:08:53.380144 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:53.380054 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 23 21:08:53.386254 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:53.386234 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8554f97c95-qpxhz"] Jul 23 21:08:53.439121 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:53.439089 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:08:53.449311 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:53.449284 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f91ac386-d4d3-449d-ab02-a9c053221138-openshift-service-ca\") pod \"maas-api-8554f97c95-qpxhz\" (UID: \"f91ac386-d4d3-449d-ab02-a9c053221138\") " pod="odh-ai-gateway-infra/maas-api-8554f97c95-qpxhz" Jul 23 21:08:53.449469 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:53.449405 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f91ac386-d4d3-449d-ab02-a9c053221138-maas-api-tls\") pod \"maas-api-8554f97c95-qpxhz\" (UID: \"f91ac386-d4d3-449d-ab02-a9c053221138\") " pod="odh-ai-gateway-infra/maas-api-8554f97c95-qpxhz" Jul 23 21:08:53.449513 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:53.449466 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45kct\" (UniqueName: \"kubernetes.io/projected/f91ac386-d4d3-449d-ab02-a9c053221138-kube-api-access-45kct\") pod \"maas-api-8554f97c95-qpxhz\" (UID: \"f91ac386-d4d3-449d-ab02-a9c053221138\") " pod="odh-ai-gateway-infra/maas-api-8554f97c95-qpxhz" Jul 23 21:08:53.550548 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:53.550480 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f91ac386-d4d3-449d-ab02-a9c053221138-maas-api-tls\") pod \"maas-api-8554f97c95-qpxhz\" (UID: \"f91ac386-d4d3-449d-ab02-a9c053221138\") " pod="odh-ai-gateway-infra/maas-api-8554f97c95-qpxhz" Jul 23 21:08:53.551097 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:53.550604 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45kct\" (UniqueName: \"kubernetes.io/projected/f91ac386-d4d3-449d-ab02-a9c053221138-kube-api-access-45kct\") pod \"maas-api-8554f97c95-qpxhz\" (UID: \"f91ac386-d4d3-449d-ab02-a9c053221138\") " pod="odh-ai-gateway-infra/maas-api-8554f97c95-qpxhz" Jul 23 21:08:53.551097 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:53.550672 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f91ac386-d4d3-449d-ab02-a9c053221138-openshift-service-ca\") pod \"maas-api-8554f97c95-qpxhz\" (UID: \"f91ac386-d4d3-449d-ab02-a9c053221138\") " pod="odh-ai-gateway-infra/maas-api-8554f97c95-qpxhz" Jul 23 21:08:53.551547 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:53.551518 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f91ac386-d4d3-449d-ab02-a9c053221138-openshift-service-ca\") pod \"maas-api-8554f97c95-qpxhz\" (UID: \"f91ac386-d4d3-449d-ab02-a9c053221138\") " pod="odh-ai-gateway-infra/maas-api-8554f97c95-qpxhz" Jul 23 21:08:53.553642 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:53.553616 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f91ac386-d4d3-449d-ab02-a9c053221138-maas-api-tls\") pod \"maas-api-8554f97c95-qpxhz\" (UID: \"f91ac386-d4d3-449d-ab02-a9c053221138\") " pod="odh-ai-gateway-infra/maas-api-8554f97c95-qpxhz" Jul 23 21:08:53.559410 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:53.559386 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45kct\" (UniqueName: \"kubernetes.io/projected/f91ac386-d4d3-449d-ab02-a9c053221138-kube-api-access-45kct\") pod \"maas-api-8554f97c95-qpxhz\" (UID: \"f91ac386-d4d3-449d-ab02-a9c053221138\") " pod="odh-ai-gateway-infra/maas-api-8554f97c95-qpxhz" Jul 23 21:08:53.688518 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:53.688483 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8554f97c95-qpxhz" Jul 23 21:08:53.732014 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:53.731971 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:08:53.825628 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:53.825555 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:08:53.831412 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:53.831391 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8554f97c95-qpxhz"] Jul 23 21:08:53.833111 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:08:53.833075 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf91ac386_d4d3_449d_ab02_a9c053221138.slice/crio-7f1fd90f315562f7c0d839bfc06fe09673f4da7882777fa56aaa5e85c9784cb5 WatchSource:0}: Error finding container 7f1fd90f315562f7c0d839bfc06fe09673f4da7882777fa56aaa5e85c9784cb5: Status 404 returned error can't find the container with id 7f1fd90f315562f7c0d839bfc06fe09673f4da7882777fa56aaa5e85c9784cb5 Jul 23 21:08:53.908927 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:53.908889 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8554f97c95-qpxhz" event={"ID":"f91ac386-d4d3-449d-ab02-a9c053221138","Type":"ContainerStarted","Data":"7f1fd90f315562f7c0d839bfc06fe09673f4da7882777fa56aaa5e85c9784cb5"} Jul 23 21:08:55.925059 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:55.925025 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8554f97c95-qpxhz" event={"ID":"f91ac386-d4d3-449d-ab02-a9c053221138","Type":"ContainerStarted","Data":"aab95ccaef4520012103ef7590b8006a5322a728e6ebee95bd5bd005f127720b"} Jul 23 21:08:55.925460 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:55.925099 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-8554f97c95-qpxhz" Jul 23 21:08:55.940817 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:08:55.940771 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-8554f97c95-qpxhz" podStartSLOduration=1.33474908 podStartE2EDuration="2.94075401s" totalImagesPullingTime="1.60600493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:08:55.939194659 +0000 UTC m=+573.501628656" watchObservedRunningTime="2026-07-23 21:08:55.94075401 +0000 UTC m=+573.503188035" Jul 23 21:09:01.936604 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:01.936570 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-8554f97c95-qpxhz" Jul 23 21:09:03.525357 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:03.525321 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:09:04.787238 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:04.787191 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:09:12.979949 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:12.979919 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt"] Jul 23 21:09:12.983898 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:12.983853 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt" Jul 23 21:09:12.987036 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:12.987015 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 23 21:09:12.987201 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:12.987184 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 23 21:09:12.987278 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:12.987201 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 23 21:09:12.987337 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:12.987288 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2l7z4\"" Jul 23 21:09:12.993673 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:12.993650 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt"] Jul 23 21:09:13.004283 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:13.004257 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:09:13.136004 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:13.135973 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1cc166d0-2395-4b63-8fda-5a300d474e2c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt\" (UID: \"1cc166d0-2395-4b63-8fda-5a300d474e2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt" Jul 23 21:09:13.136165 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:13.136013 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cc166d0-2395-4b63-8fda-5a300d474e2c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt\" (UID: \"1cc166d0-2395-4b63-8fda-5a300d474e2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt" Jul 23 21:09:13.136165 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:13.136063 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1cc166d0-2395-4b63-8fda-5a300d474e2c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt\" (UID: \"1cc166d0-2395-4b63-8fda-5a300d474e2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt" Jul 23 21:09:13.136165 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:13.136156 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1cc166d0-2395-4b63-8fda-5a300d474e2c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt\" (UID: \"1cc166d0-2395-4b63-8fda-5a300d474e2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt" Jul 23 21:09:13.136270 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:13.136229 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lrzn\" (UniqueName: \"kubernetes.io/projected/1cc166d0-2395-4b63-8fda-5a300d474e2c-kube-api-access-6lrzn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt\" (UID: \"1cc166d0-2395-4b63-8fda-5a300d474e2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt" Jul 23 21:09:13.136310 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:13.136268 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1cc166d0-2395-4b63-8fda-5a300d474e2c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt\" (UID: \"1cc166d0-2395-4b63-8fda-5a300d474e2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt" Jul 23 21:09:13.237742 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:13.237663 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1cc166d0-2395-4b63-8fda-5a300d474e2c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt\" (UID: \"1cc166d0-2395-4b63-8fda-5a300d474e2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt" Jul 23 21:09:13.237742 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:13.237707 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lrzn\" (UniqueName: \"kubernetes.io/projected/1cc166d0-2395-4b63-8fda-5a300d474e2c-kube-api-access-6lrzn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt\" (UID: \"1cc166d0-2395-4b63-8fda-5a300d474e2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt" Jul 23 21:09:13.237742 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:13.237734 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1cc166d0-2395-4b63-8fda-5a300d474e2c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt\" (UID: \"1cc166d0-2395-4b63-8fda-5a300d474e2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt" Jul 23 21:09:13.238040 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:13.237761 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1cc166d0-2395-4b63-8fda-5a300d474e2c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt\" (UID: \"1cc166d0-2395-4b63-8fda-5a300d474e2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt" Jul 23 21:09:13.238040 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:13.237780 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cc166d0-2395-4b63-8fda-5a300d474e2c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt\" (UID: \"1cc166d0-2395-4b63-8fda-5a300d474e2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt" Jul 23 21:09:13.238040 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:13.237797 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1cc166d0-2395-4b63-8fda-5a300d474e2c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt\" (UID: \"1cc166d0-2395-4b63-8fda-5a300d474e2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt" Jul 23 21:09:13.238196 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:13.238141 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1cc166d0-2395-4b63-8fda-5a300d474e2c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt\" (UID: \"1cc166d0-2395-4b63-8fda-5a300d474e2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt" Jul 23 21:09:13.238244 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:13.238196 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cc166d0-2395-4b63-8fda-5a300d474e2c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt\" (UID: \"1cc166d0-2395-4b63-8fda-5a300d474e2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt" Jul 23 21:09:13.238244 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:13.238230 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1cc166d0-2395-4b63-8fda-5a300d474e2c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt\" (UID: \"1cc166d0-2395-4b63-8fda-5a300d474e2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt" Jul 23 21:09:13.239935 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:13.239910 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1cc166d0-2395-4b63-8fda-5a300d474e2c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt\" (UID: \"1cc166d0-2395-4b63-8fda-5a300d474e2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt" Jul 23 21:09:13.240188 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:13.240172 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1cc166d0-2395-4b63-8fda-5a300d474e2c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt\" (UID: \"1cc166d0-2395-4b63-8fda-5a300d474e2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt" Jul 23 21:09:13.245787 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:13.245770 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lrzn\" (UniqueName: \"kubernetes.io/projected/1cc166d0-2395-4b63-8fda-5a300d474e2c-kube-api-access-6lrzn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt\" (UID: \"1cc166d0-2395-4b63-8fda-5a300d474e2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt" Jul 23 21:09:13.294459 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:13.294430 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt" Jul 23 21:09:13.425568 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:13.425545 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt"] Jul 23 21:09:13.427663 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:09:13.427625 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cc166d0_2395_4b63_8fda_5a300d474e2c.slice/crio-a208ba3a500f3be14b0c60938ce08fa67c2fcab67c1d8ee70ba92af3d6e42280 WatchSource:0}: Error finding container a208ba3a500f3be14b0c60938ce08fa67c2fcab67c1d8ee70ba92af3d6e42280: Status 404 returned error can't find the container with id a208ba3a500f3be14b0c60938ce08fa67c2fcab67c1d8ee70ba92af3d6e42280 Jul 23 21:09:14.013993 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:14.013951 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt" event={"ID":"1cc166d0-2395-4b63-8fda-5a300d474e2c","Type":"ContainerStarted","Data":"a208ba3a500f3be14b0c60938ce08fa67c2fcab67c1d8ee70ba92af3d6e42280"} Jul 23 21:09:15.019631 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:15.019549 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt" event={"ID":"1cc166d0-2395-4b63-8fda-5a300d474e2c","Type":"ContainerStarted","Data":"f49ba413a2b850cae0c4c3c82a6b7f22d9da025afaf1b3cce5eea5b4dfad211a"} Jul 23 21:09:15.037011 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:15.036966 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt" podStartSLOduration=1.866362683 podStartE2EDuration="3.036952494s" totalImagesPullingTime="1.170589811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:09:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:09:15.034849046 +0000 UTC m=+592.597283029" watchObservedRunningTime="2026-07-23 21:09:15.036952494 +0000 UTC m=+592.599386479" Jul 23 21:09:22.870393 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:22.870364 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dqgm_5e727997-ea44-49f3-a78a-2e639ce8f1a7/ovn-acl-logging/0.log" Jul 23 21:09:22.870921 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:22.870591 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6dqgm_5e727997-ea44-49f3-a78a-2e639ce8f1a7/ovn-acl-logging/0.log" Jul 23 21:09:23.294650 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:23.294619 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt" Jul 23 21:09:23.294806 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:23.294684 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt" Jul 23 21:09:23.307120 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:23.307095 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt" Jul 23 21:09:24.078756 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:24.078727 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt" Jul 23 21:09:26.799548 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:26.799515 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:09:38.569283 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:38.569033 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd"] Jul 23 21:09:38.571999 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:38.571978 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd" Jul 23 21:09:38.574434 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:38.574412 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 23 21:09:38.582222 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:38.582198 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd"] Jul 23 21:09:38.664695 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:38.664663 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:09:38.672071 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:38.672044 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df37785d-3571-4990-a6d7-b0aef2fce98c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvfwd\" (UID: \"df37785d-3571-4990-a6d7-b0aef2fce98c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd" Jul 23 21:09:38.672216 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:38.672074 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df37785d-3571-4990-a6d7-b0aef2fce98c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvfwd\" (UID: \"df37785d-3571-4990-a6d7-b0aef2fce98c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd" Jul 23 21:09:38.672216 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:38.672105 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df37785d-3571-4990-a6d7-b0aef2fce98c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvfwd\" (UID: \"df37785d-3571-4990-a6d7-b0aef2fce98c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd" Jul 23 21:09:38.672216 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:38.672125 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv4xg\" (UniqueName: \"kubernetes.io/projected/df37785d-3571-4990-a6d7-b0aef2fce98c-kube-api-access-zv4xg\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvfwd\" (UID: \"df37785d-3571-4990-a6d7-b0aef2fce98c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd" Jul 23 21:09:38.672329 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:38.672231 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df37785d-3571-4990-a6d7-b0aef2fce98c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvfwd\" (UID: \"df37785d-3571-4990-a6d7-b0aef2fce98c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd" Jul 23 21:09:38.672329 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:38.672269 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df37785d-3571-4990-a6d7-b0aef2fce98c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvfwd\" (UID: \"df37785d-3571-4990-a6d7-b0aef2fce98c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd" Jul 23 21:09:38.773539 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:38.773503 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df37785d-3571-4990-a6d7-b0aef2fce98c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvfwd\" (UID: \"df37785d-3571-4990-a6d7-b0aef2fce98c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd" Jul 23 21:09:38.773539 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:38.773537 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df37785d-3571-4990-a6d7-b0aef2fce98c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvfwd\" (UID: \"df37785d-3571-4990-a6d7-b0aef2fce98c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd" Jul 23 21:09:38.773777 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:38.773569 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df37785d-3571-4990-a6d7-b0aef2fce98c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvfwd\" (UID: \"df37785d-3571-4990-a6d7-b0aef2fce98c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd" Jul 23 21:09:38.773777 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:38.773598 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv4xg\" (UniqueName: \"kubernetes.io/projected/df37785d-3571-4990-a6d7-b0aef2fce98c-kube-api-access-zv4xg\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvfwd\" (UID: \"df37785d-3571-4990-a6d7-b0aef2fce98c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd" Jul 23 21:09:38.773777 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:38.773661 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df37785d-3571-4990-a6d7-b0aef2fce98c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvfwd\" (UID: \"df37785d-3571-4990-a6d7-b0aef2fce98c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd" Jul 23 21:09:38.773777 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:38.773698 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df37785d-3571-4990-a6d7-b0aef2fce98c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvfwd\" (UID: \"df37785d-3571-4990-a6d7-b0aef2fce98c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd" Jul 23 21:09:38.774044 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:38.774028 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df37785d-3571-4990-a6d7-b0aef2fce98c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvfwd\" (UID: \"df37785d-3571-4990-a6d7-b0aef2fce98c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd" Jul 23 21:09:38.774101 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:38.774063 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df37785d-3571-4990-a6d7-b0aef2fce98c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvfwd\" (UID: \"df37785d-3571-4990-a6d7-b0aef2fce98c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd" Jul 23 21:09:38.774101 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:38.774089 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df37785d-3571-4990-a6d7-b0aef2fce98c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvfwd\" (UID: \"df37785d-3571-4990-a6d7-b0aef2fce98c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd" Jul 23 21:09:38.775985 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:38.775956 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df37785d-3571-4990-a6d7-b0aef2fce98c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvfwd\" (UID: \"df37785d-3571-4990-a6d7-b0aef2fce98c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd" Jul 23 21:09:38.776235 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:38.776219 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df37785d-3571-4990-a6d7-b0aef2fce98c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvfwd\" (UID: \"df37785d-3571-4990-a6d7-b0aef2fce98c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd" Jul 23 21:09:38.782071 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:38.782048 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv4xg\" (UniqueName: \"kubernetes.io/projected/df37785d-3571-4990-a6d7-b0aef2fce98c-kube-api-access-zv4xg\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvfwd\" (UID: \"df37785d-3571-4990-a6d7-b0aef2fce98c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd" Jul 23 21:09:38.884508 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:38.884426 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd" Jul 23 21:09:39.016722 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:39.016694 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd"] Jul 23 21:09:39.018992 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:09:39.018966 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf37785d_3571_4990_a6d7_b0aef2fce98c.slice/crio-7770069d771be358e7832dfd21fead6f3337275823d0ff7c74d8223d967e8ea8 WatchSource:0}: Error finding container 7770069d771be358e7832dfd21fead6f3337275823d0ff7c74d8223d967e8ea8: Status 404 returned error can't find the container with id 7770069d771be358e7832dfd21fead6f3337275823d0ff7c74d8223d967e8ea8 Jul 23 21:09:39.020723 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:39.020696 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 21:09:39.136965 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:39.136877 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd" event={"ID":"df37785d-3571-4990-a6d7-b0aef2fce98c","Type":"ContainerStarted","Data":"7770069d771be358e7832dfd21fead6f3337275823d0ff7c74d8223d967e8ea8"} Jul 23 21:09:40.143560 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:40.143521 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd" event={"ID":"df37785d-3571-4990-a6d7-b0aef2fce98c","Type":"ContainerStarted","Data":"bc1798bede93b907f910a2a5f6983e32017c30b859e451a143d1ed26459b2a69"} Jul 23 21:09:40.160616 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:40.160566 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd" podStartSLOduration=1.9856780619999999 podStartE2EDuration="2.160550281s" totalImagesPullingTime="174.872219ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:09:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:09:40.159586679 +0000 UTC m=+617.722020664" watchObservedRunningTime="2026-07-23 21:09:40.160550281 +0000 UTC m=+617.722984266" Jul 23 21:09:48.384333 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:48.384225 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:09:48.885012 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:48.884982 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd" Jul 23 21:09:48.885177 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:48.885073 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd" Jul 23 21:09:48.897446 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:48.897418 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd" Jul 23 21:09:49.206992 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:49.206911 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvfwd" Jul 23 21:09:56.314886 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:09:56.314824 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:10:08.100272 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:10:08.100234 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:10:25.302151 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:10:25.302119 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:10:44.106492 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:10:44.106438 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:11:06.259647 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:06.259607 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5569c5544-cdx9q"] Jul 23 21:11:06.263035 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:06.263012 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5569c5544-cdx9q" Jul 23 21:11:06.266068 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:06.266049 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xr9t7\"" Jul 23 21:11:06.266183 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:06.266071 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 23 21:11:06.272334 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:06.272313 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5569c5544-cdx9q"] Jul 23 21:11:06.448518 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:06.448483 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8942z\" (UniqueName: \"kubernetes.io/projected/9ca5a004-3e8d-4c70-9270-dff148d18959-kube-api-access-8942z\") pod \"authorino-5569c5544-cdx9q\" (UID: \"9ca5a004-3e8d-4c70-9270-dff148d18959\") " pod="kuadrant-system/authorino-5569c5544-cdx9q" Jul 23 21:11:06.448689 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:06.448528 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9ca5a004-3e8d-4c70-9270-dff148d18959-tls-cert\") pod \"authorino-5569c5544-cdx9q\" (UID: \"9ca5a004-3e8d-4c70-9270-dff148d18959\") " pod="kuadrant-system/authorino-5569c5544-cdx9q" Jul 23 21:11:06.549373 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:06.549335 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8942z\" (UniqueName: \"kubernetes.io/projected/9ca5a004-3e8d-4c70-9270-dff148d18959-kube-api-access-8942z\") pod \"authorino-5569c5544-cdx9q\" (UID: \"9ca5a004-3e8d-4c70-9270-dff148d18959\") " pod="kuadrant-system/authorino-5569c5544-cdx9q" Jul 23 21:11:06.549546 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:06.549384 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9ca5a004-3e8d-4c70-9270-dff148d18959-tls-cert\") pod \"authorino-5569c5544-cdx9q\" (UID: \"9ca5a004-3e8d-4c70-9270-dff148d18959\") " pod="kuadrant-system/authorino-5569c5544-cdx9q" Jul 23 21:11:06.551839 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:06.551815 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9ca5a004-3e8d-4c70-9270-dff148d18959-tls-cert\") pod \"authorino-5569c5544-cdx9q\" (UID: \"9ca5a004-3e8d-4c70-9270-dff148d18959\") " pod="kuadrant-system/authorino-5569c5544-cdx9q" Jul 23 21:11:06.557158 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:06.557134 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8942z\" (UniqueName: \"kubernetes.io/projected/9ca5a004-3e8d-4c70-9270-dff148d18959-kube-api-access-8942z\") pod \"authorino-5569c5544-cdx9q\" (UID: \"9ca5a004-3e8d-4c70-9270-dff148d18959\") " pod="kuadrant-system/authorino-5569c5544-cdx9q" Jul 23 21:11:06.573298 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:06.573275 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5569c5544-cdx9q" Jul 23 21:11:06.707421 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:06.707392 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5569c5544-cdx9q"] Jul 23 21:11:06.709665 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:11:06.709637 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ca5a004_3e8d_4c70_9270_dff148d18959.slice/crio-acc3e489e2648d487b19c990ca580fe43ada3a6a645e0e0db0e25c509c9c6b2b WatchSource:0}: Error finding container acc3e489e2648d487b19c990ca580fe43ada3a6a645e0e0db0e25c509c9c6b2b: Status 404 returned error can't find the container with id acc3e489e2648d487b19c990ca580fe43ada3a6a645e0e0db0e25c509c9c6b2b Jul 23 21:11:07.584295 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:07.584261 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5569c5544-cdx9q" event={"ID":"9ca5a004-3e8d-4c70-9270-dff148d18959","Type":"ContainerStarted","Data":"5ae9fa2ea78f9606387c252460236b812d38cbc57d6e47d4e3090e9dfdf389db"} Jul 23 21:11:07.584761 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:07.584304 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5569c5544-cdx9q" event={"ID":"9ca5a004-3e8d-4c70-9270-dff148d18959","Type":"ContainerStarted","Data":"acc3e489e2648d487b19c990ca580fe43ada3a6a645e0e0db0e25c509c9c6b2b"} Jul 23 21:11:07.606015 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:07.605954 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5569c5544-cdx9q" podStartSLOduration=1.106010016 podStartE2EDuration="1.605931171s" totalImagesPullingTime="499.921155ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:11:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:11:07.605321904 +0000 UTC m=+705.167755889" watchObservedRunningTime="2026-07-23 21:11:07.605931171 +0000 UTC m=+705.168365156" Jul 23 21:11:08.139264 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:08.139230 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:11:08.239194 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:08.239162 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:11:09.207407 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:09.207359 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:11:09.335164 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:09.335130 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:11:23.730225 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:23.730155 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5569c5544-cdx9q_9ca5a004-3e8d-4c70-9270-dff148d18959/authorino/0.log" Jul 23 21:11:29.041664 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:29.041624 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-b956f9cf6-dpcmv_0ba009eb-7441-4054-b357-56730a13f340/manager/0.log" Jul 23 21:11:29.374168 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:29.374089 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77944bd489-77q5s_b5b495c5-be2e-4cc4-a864-7e5a81898e72/manager/0.log" Jul 23 21:11:29.380425 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:29.380405 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77944bd489-77q5s_b5b495c5-be2e-4cc4-a864-7e5a81898e72/copy-manifests/0.log" Jul 23 21:11:29.946516 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:29.946485 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-8554f97c95-qpxhz_f91ac386-d4d3-449d-ab02-a9c053221138/maas-api/0.log" Jul 23 21:11:30.046596 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:30.046559 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-htgfp_45c491bc-abc0-4259-baf4-7ccf36cc98fb/postgres/0.log" Jul 23 21:11:31.283664 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:31.283632 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5569c5544-cdx9q_9ca5a004-3e8d-4c70-9270-dff148d18959/authorino/0.log" Jul 23 21:11:31.503988 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:31.503955 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-swd5c_94287978-52fa-471f-a85e-fd2bbcee3f4e/manager/0.log" Jul 23 21:11:31.606016 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:31.605939 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-gp2zv_3bd249c1-ba72-4e9f-bc9e-886cf4f9fcf4/kuadrant-console-plugin/0.log" Jul 23 21:11:32.686752 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:32.686723 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cc7f4f888-n7vn2_27427d7e-269a-4048-ac06-186a738a9c68/kube-auth-proxy/0.log" Jul 23 21:11:33.461896 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:33.461848 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-crgqt_1cc166d0-2395-4b63-8fda-5a300d474e2c/main/0.log" Jul 23 21:11:33.673493 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:33.673462 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-tvfwd_df37785d-3571-4990-a6d7-b0aef2fce98c/main/0.log" Jul 23 21:11:39.011089 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:39.011058 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:11:39.073196 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:39.073154 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" limit=1024 Jul 23 21:11:42.018625 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:42.018593 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wqmks_1bc0eede-3f89-44b8-9acc-244ddd68e26b/global-pull-secret-syncer/0.log" Jul 23 21:11:42.061204 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:42.061179 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-k4mpd_c360a063-018a-4e22-978b-69dc9b659c9b/konnectivity-agent/0.log" Jul 23 21:11:42.190170 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:42.190142 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-105.ec2.internal_a88942796a5b6b2c5f36a7e709e10120/haproxy/0.log" Jul 23 21:11:47.919135 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:47.919105 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5569c5544-cdx9q_9ca5a004-3e8d-4c70-9270-dff148d18959/authorino/0.log" Jul 23 21:11:48.000497 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:48.000471 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-swd5c_94287978-52fa-471f-a85e-fd2bbcee3f4e/manager/0.log" Jul 23 21:11:48.050409 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:48.050384 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-gp2zv_3bd249c1-ba72-4e9f-bc9e-886cf4f9fcf4/kuadrant-console-plugin/0.log" Jul 23 21:11:50.039034 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:50.039009 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_998be41c-d4c6-475f-a6e1-ecc5d2091633/alertmanager/0.log" Jul 23 21:11:50.067068 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:50.067037 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_998be41c-d4c6-475f-a6e1-ecc5d2091633/config-reloader/0.log" Jul 23 21:11:50.094258 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:50.094232 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_998be41c-d4c6-475f-a6e1-ecc5d2091633/kube-rbac-proxy-web/0.log" Jul 23 21:11:50.124452 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:50.124427 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_998be41c-d4c6-475f-a6e1-ecc5d2091633/kube-rbac-proxy/0.log" Jul 23 21:11:50.158304 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:50.152826 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_998be41c-d4c6-475f-a6e1-ecc5d2091633/kube-rbac-proxy-metric/0.log" Jul 23 21:11:50.181459 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:50.181389 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_998be41c-d4c6-475f-a6e1-ecc5d2091633/prom-label-proxy/0.log" Jul 23 21:11:50.210591 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:50.210563 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_998be41c-d4c6-475f-a6e1-ecc5d2091633/init-config-reloader/0.log" Jul 23 21:11:50.278253 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:50.278230 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-jwggh_dfbe5270-88f6-4718-b03c-a5282c6cf728/kube-state-metrics/0.log" Jul 23 21:11:50.305188 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:50.305160 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-jwggh_dfbe5270-88f6-4718-b03c-a5282c6cf728/kube-rbac-proxy-main/0.log" Jul 23 21:11:50.329653 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:50.329626 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-jwggh_dfbe5270-88f6-4718-b03c-a5282c6cf728/kube-rbac-proxy-self/0.log" Jul 23 21:11:50.362679 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:50.362655 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-588596fc7-s4mbs_d25481e8-e46e-4575-8c72-a127394fbda3/metrics-server/0.log" Jul 23 21:11:50.399402 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:50.399379 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-rp65r_69121ee2-87c5-4d30-9c8d-36d216bf259e/monitoring-plugin/0.log" Jul 23 21:11:50.442602 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:50.442519 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7wf6r_ece2e4ce-4de0-4bb1-9991-13a53d8103b3/node-exporter/0.log" Jul 23 21:11:50.469879 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:50.469837 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7wf6r_ece2e4ce-4de0-4bb1-9991-13a53d8103b3/kube-rbac-proxy/0.log" Jul 23 21:11:50.491554 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:50.491527 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7wf6r_ece2e4ce-4de0-4bb1-9991-13a53d8103b3/init-textfile/0.log" Jul 23 21:11:50.683565 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:50.683534 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-j5ph7_f2dcc106-2cc3-451a-8d1b-8d25448442f9/kube-rbac-proxy-main/0.log" Jul 23 21:11:50.712362 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:50.712290 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-j5ph7_f2dcc106-2cc3-451a-8d1b-8d25448442f9/kube-rbac-proxy-self/0.log" Jul 23 21:11:50.737989 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:50.737964 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-j5ph7_f2dcc106-2cc3-451a-8d1b-8d25448442f9/openshift-state-metrics/0.log" Jul 23 21:11:50.781474 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:50.781446 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_caea3587-84a9-45bf-ac03-b7b0e70315e4/prometheus/0.log" Jul 23 21:11:50.807189 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:50.807154 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_caea3587-84a9-45bf-ac03-b7b0e70315e4/config-reloader/0.log" Jul 23 21:11:50.841885 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:50.841852 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_caea3587-84a9-45bf-ac03-b7b0e70315e4/thanos-sidecar/0.log" Jul 23 21:11:50.864371 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:50.864346 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_caea3587-84a9-45bf-ac03-b7b0e70315e4/kube-rbac-proxy-web/0.log" Jul 23 21:11:50.891881 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:50.891843 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_caea3587-84a9-45bf-ac03-b7b0e70315e4/kube-rbac-proxy/0.log" Jul 23 21:11:50.918394 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:50.918371 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_caea3587-84a9-45bf-ac03-b7b0e70315e4/kube-rbac-proxy-thanos/0.log" Jul 23 21:11:50.943402 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:50.943373 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_caea3587-84a9-45bf-ac03-b7b0e70315e4/init-config-reloader/0.log" Jul 23 21:11:50.976473 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:50.976406 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-kqnm4_4049e25e-6c23-4409-b219-9de21593d82b/prometheus-operator/0.log" Jul 23 21:11:51.013301 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.013276 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-kqnm4_4049e25e-6c23-4409-b219-9de21593d82b/kube-rbac-proxy/0.log" Jul 23 21:11:51.041310 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.041279 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-8cskx_4b602227-08f5-40ed-926f-85b793e1ffa4/prometheus-operator-admission-webhook/0.log" Jul 23 21:11:51.073404 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.073378 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d6b84f7cf-vwmcr_30fe405a-4de9-4bb9-afae-baadcb814267/telemeter-client/0.log" Jul 23 21:11:51.096695 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.096652 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d6b84f7cf-vwmcr_30fe405a-4de9-4bb9-afae-baadcb814267/reload/0.log" Jul 23 21:11:51.123076 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.123051 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d6b84f7cf-vwmcr_30fe405a-4de9-4bb9-afae-baadcb814267/kube-rbac-proxy/0.log" Jul 23 21:11:51.164875 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.164843 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b5585fff-nr566_760c8194-715d-4d30-b590-275c2f457a8a/thanos-query/0.log" Jul 23 21:11:51.186804 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.186777 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b5585fff-nr566_760c8194-715d-4d30-b590-275c2f457a8a/kube-rbac-proxy-web/0.log" Jul 23 21:11:51.209257 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.209223 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b5585fff-nr566_760c8194-715d-4d30-b590-275c2f457a8a/kube-rbac-proxy/0.log" Jul 23 21:11:51.238541 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.238476 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b5585fff-nr566_760c8194-715d-4d30-b590-275c2f457a8a/prom-label-proxy/0.log" Jul 23 21:11:51.263097 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.263078 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b5585fff-nr566_760c8194-715d-4d30-b590-275c2f457a8a/kube-rbac-proxy-rules/0.log" Jul 23 21:11:51.285163 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.285142 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b5585fff-nr566_760c8194-715d-4d30-b590-275c2f457a8a/kube-rbac-proxy-metrics/0.log" Jul 23 21:11:51.836723 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.836686 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kxk68/perf-node-gather-daemonset-7559x"] Jul 23 21:11:51.840546 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.840524 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kxk68/perf-node-gather-daemonset-7559x" Jul 23 21:11:51.842791 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.842771 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kxk68\"/\"kube-root-ca.crt\"" Jul 23 21:11:51.843547 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.843529 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kxk68\"/\"openshift-service-ca.crt\"" Jul 23 21:11:51.843662 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.843568 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kxk68\"/\"default-dockercfg-fgvfl\"" Jul 23 21:11:51.850210 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.850188 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kxk68/perf-node-gather-daemonset-7559x"] Jul 23 21:11:51.888027 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.887994 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ce284ae-d8af-4da2-a79e-3a1a5275c169-proc\") pod \"perf-node-gather-daemonset-7559x\" (UID: \"7ce284ae-d8af-4da2-a79e-3a1a5275c169\") " pod="openshift-must-gather-kxk68/perf-node-gather-daemonset-7559x" Jul 23 21:11:51.888204 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.888045 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgbxz\" (UniqueName: \"kubernetes.io/projected/7ce284ae-d8af-4da2-a79e-3a1a5275c169-kube-api-access-jgbxz\") pod \"perf-node-gather-daemonset-7559x\" (UID: \"7ce284ae-d8af-4da2-a79e-3a1a5275c169\") " pod="openshift-must-gather-kxk68/perf-node-gather-daemonset-7559x" Jul 23 21:11:51.888204 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.888180 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ce284ae-d8af-4da2-a79e-3a1a5275c169-sys\") pod \"perf-node-gather-daemonset-7559x\" (UID: \"7ce284ae-d8af-4da2-a79e-3a1a5275c169\") " pod="openshift-must-gather-kxk68/perf-node-gather-daemonset-7559x" Jul 23 21:11:51.888333 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.888226 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ce284ae-d8af-4da2-a79e-3a1a5275c169-lib-modules\") pod \"perf-node-gather-daemonset-7559x\" (UID: \"7ce284ae-d8af-4da2-a79e-3a1a5275c169\") " pod="openshift-must-gather-kxk68/perf-node-gather-daemonset-7559x" Jul 23 21:11:51.888333 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.888268 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ce284ae-d8af-4da2-a79e-3a1a5275c169-podres\") pod \"perf-node-gather-daemonset-7559x\" (UID: \"7ce284ae-d8af-4da2-a79e-3a1a5275c169\") " pod="openshift-must-gather-kxk68/perf-node-gather-daemonset-7559x" Jul 23 21:11:51.989574 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.989543 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ce284ae-d8af-4da2-a79e-3a1a5275c169-sys\") pod \"perf-node-gather-daemonset-7559x\" (UID: \"7ce284ae-d8af-4da2-a79e-3a1a5275c169\") " pod="openshift-must-gather-kxk68/perf-node-gather-daemonset-7559x" Jul 23 21:11:51.989723 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.989592 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ce284ae-d8af-4da2-a79e-3a1a5275c169-lib-modules\") pod \"perf-node-gather-daemonset-7559x\" (UID: \"7ce284ae-d8af-4da2-a79e-3a1a5275c169\") " pod="openshift-must-gather-kxk68/perf-node-gather-daemonset-7559x" Jul 23 21:11:51.989723 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.989624 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ce284ae-d8af-4da2-a79e-3a1a5275c169-podres\") pod \"perf-node-gather-daemonset-7559x\" (UID: \"7ce284ae-d8af-4da2-a79e-3a1a5275c169\") " pod="openshift-must-gather-kxk68/perf-node-gather-daemonset-7559x" Jul 23 21:11:51.989723 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.989656 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ce284ae-d8af-4da2-a79e-3a1a5275c169-sys\") pod \"perf-node-gather-daemonset-7559x\" (UID: \"7ce284ae-d8af-4da2-a79e-3a1a5275c169\") " pod="openshift-must-gather-kxk68/perf-node-gather-daemonset-7559x" Jul 23 21:11:51.989723 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.989677 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ce284ae-d8af-4da2-a79e-3a1a5275c169-proc\") pod \"perf-node-gather-daemonset-7559x\" (UID: \"7ce284ae-d8af-4da2-a79e-3a1a5275c169\") " pod="openshift-must-gather-kxk68/perf-node-gather-daemonset-7559x" Jul 23 21:11:51.989723 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.989710 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgbxz\" (UniqueName: \"kubernetes.io/projected/7ce284ae-d8af-4da2-a79e-3a1a5275c169-kube-api-access-jgbxz\") pod \"perf-node-gather-daemonset-7559x\" (UID: \"7ce284ae-d8af-4da2-a79e-3a1a5275c169\") " pod="openshift-must-gather-kxk68/perf-node-gather-daemonset-7559x" Jul 23 21:11:51.989963 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.989780 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ce284ae-d8af-4da2-a79e-3a1a5275c169-podres\") pod \"perf-node-gather-daemonset-7559x\" (UID: \"7ce284ae-d8af-4da2-a79e-3a1a5275c169\") " pod="openshift-must-gather-kxk68/perf-node-gather-daemonset-7559x" Jul 23 21:11:51.989963 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.989781 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ce284ae-d8af-4da2-a79e-3a1a5275c169-lib-modules\") pod \"perf-node-gather-daemonset-7559x\" (UID: \"7ce284ae-d8af-4da2-a79e-3a1a5275c169\") " pod="openshift-must-gather-kxk68/perf-node-gather-daemonset-7559x" Jul 23 21:11:51.989963 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.989787 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ce284ae-d8af-4da2-a79e-3a1a5275c169-proc\") pod \"perf-node-gather-daemonset-7559x\" (UID: \"7ce284ae-d8af-4da2-a79e-3a1a5275c169\") " pod="openshift-must-gather-kxk68/perf-node-gather-daemonset-7559x" Jul 23 21:11:51.997505 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:51.997480 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgbxz\" (UniqueName: \"kubernetes.io/projected/7ce284ae-d8af-4da2-a79e-3a1a5275c169-kube-api-access-jgbxz\") pod \"perf-node-gather-daemonset-7559x\" (UID: \"7ce284ae-d8af-4da2-a79e-3a1a5275c169\") " pod="openshift-must-gather-kxk68/perf-node-gather-daemonset-7559x" Jul 23 21:11:52.150625 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:52.150541 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kxk68/perf-node-gather-daemonset-7559x" Jul 23 21:11:52.282848 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:52.282825 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kxk68/perf-node-gather-daemonset-7559x"] Jul 23 21:11:52.285052 ip-10-0-139-105 kubenswrapper[2575]: W0723 21:11:52.285025 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7ce284ae_d8af_4da2_a79e_3a1a5275c169.slice/crio-53529a81a9b22088d035805fb5ce52bd46c98db6d430d8e4ce871f444b7ff4cd WatchSource:0}: Error finding container 53529a81a9b22088d035805fb5ce52bd46c98db6d430d8e4ce871f444b7ff4cd: Status 404 returned error can't find the container with id 53529a81a9b22088d035805fb5ce52bd46c98db6d430d8e4ce871f444b7ff4cd Jul 23 21:11:52.807510 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:52.807472 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kxk68/perf-node-gather-daemonset-7559x" event={"ID":"7ce284ae-d8af-4da2-a79e-3a1a5275c169","Type":"ContainerStarted","Data":"070acf14ece77101771a2f2551a0ac29ae6f9a097bbc7bddca060645f866d2e3"} Jul 23 21:11:52.807707 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:52.807537 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kxk68/perf-node-gather-daemonset-7559x" Jul 23 21:11:52.807707 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:52.807561 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kxk68/perf-node-gather-daemonset-7559x" event={"ID":"7ce284ae-d8af-4da2-a79e-3a1a5275c169","Type":"ContainerStarted","Data":"53529a81a9b22088d035805fb5ce52bd46c98db6d430d8e4ce871f444b7ff4cd"} Jul 23 21:11:52.824746 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:52.824697 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kxk68/perf-node-gather-daemonset-7559x" podStartSLOduration=1.824682599 podStartE2EDuration="1.824682599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:11:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:11:52.823000284 +0000 UTC m=+750.385434270" watchObservedRunningTime="2026-07-23 21:11:52.824682599 +0000 UTC m=+750.387116582" Jul 23 21:11:53.598418 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:53.598390 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9bdb6c96-4ddxr_33bd348e-479d-4abd-a47e-94edbd4ebd3e/console/0.log" Jul 23 21:11:55.365877 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:55.365839 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zd8fn_8c5a9523-0ee8-46f8-9141-4adcb46752d8/dns/0.log" Jul 23 21:11:55.388539 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:55.388513 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zd8fn_8c5a9523-0ee8-46f8-9141-4adcb46752d8/kube-rbac-proxy/0.log" Jul 23 21:11:55.412489 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:55.412465 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5t58l_f66dc9f4-cf62-41d2-a924-3c99f035c6fa/dns-node-resolver/0.log" Jul 23 21:11:56.062039 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:56.062009 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ndd69_d6c822b6-da7a-488f-9c36-cfb188240ae4/node-ca/0.log" Jul 23 21:11:57.126355 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:57.126326 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cc7f4f888-n7vn2_27427d7e-269a-4048-ac06-186a738a9c68/kube-auth-proxy/0.log" Jul 23 21:11:57.927380 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:57.927351 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n6m9n_a00a011b-50be-45d9-814c-ac4d821e8038/serve-healthcheck-canary/0.log" Jul 23 21:11:58.581602 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:58.581572 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pxc5q_130c768a-ee37-4d6e-905b-443f99d697fa/kube-rbac-proxy/0.log" Jul 23 21:11:58.607678 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:58.607652 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pxc5q_130c768a-ee37-4d6e-905b-443f99d697fa/exporter/0.log" Jul 23 21:11:58.631633 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:58.631611 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pxc5q_130c768a-ee37-4d6e-905b-443f99d697fa/extractor/0.log" Jul 23 21:11:58.822009 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:11:58.821984 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kxk68/perf-node-gather-daemonset-7559x" Jul 23 21:12:00.926913 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:12:00.926886 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-b956f9cf6-dpcmv_0ba009eb-7441-4054-b357-56730a13f340/manager/0.log" Jul 23 21:12:01.061740 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:12:01.061714 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77944bd489-77q5s_b5b495c5-be2e-4cc4-a864-7e5a81898e72/manager/0.log" Jul 23 21:12:01.082100 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:12:01.082033 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77944bd489-77q5s_b5b495c5-be2e-4cc4-a864-7e5a81898e72/copy-manifests/0.log" Jul 23 21:12:02.532232 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:12:02.532205 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-9f5c4b4f6-4p74n_5ad49517-c977-4b5a-81c7-804118ed9a11/manager/0.log" Jul 23 21:12:03.130476 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:12:03.130451 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cc7f4f888-n7vn2_27427d7e-269a-4048-ac06-186a738a9c68/kube-auth-proxy/0.log" Jul 23 21:12:04.377790 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:12:04.377759 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cc7f4f888-n7vn2_27427d7e-269a-4048-ac06-186a738a9c68/kube-auth-proxy/0.log" Jul 23 21:12:09.174074 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:12:09.174045 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7lf94_db899d82-4b93-4bc9-9c96-7eff79204586/kube-multus-additional-cni-plugins/0.log" Jul 23 21:12:09.197999 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:12:09.197972 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7lf94_db899d82-4b93-4bc9-9c96-7eff79204586/egress-router-binary-copy/0.log" Jul 23 21:12:09.220454 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:12:09.220428 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7lf94_db899d82-4b93-4bc9-9c96-7eff79204586/cni-plugins/0.log" Jul 23 21:12:09.241964 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:12:09.241939 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7lf94_db899d82-4b93-4bc9-9c96-7eff79204586/bond-cni-plugin/0.log" Jul 23 21:12:09.264703 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:12:09.264683 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7lf94_db899d82-4b93-4bc9-9c96-7eff79204586/routeoverride-cni/0.log" Jul 23 21:12:09.287301 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:12:09.287284 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7lf94_db899d82-4b93-4bc9-9c96-7eff79204586/whereabouts-cni-bincopy/0.log" Jul 23 21:12:09.310833 ip-10-0-139-105 kubenswrapper[2575]: I0723 21:12:09.310783 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7lf94_db899d82-4b93-4bc9-9c96-7eff79204586/whereabouts-cni/0.log"